-- Logs begin at Fri 2022-09-23 00:26:37 UTC, end at Fri 2022-09-23 01:47:50 UTC. -- Sep 23 01:04:14.131574 dv-cinder-849143-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 23 01:04:14.141485 dv-cinder-849143-7-smb devstack@keystone.service[81911]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 23 01:04:14.144916 dv-cinder-849143-7-smb devstack@keystone.service[81911]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 23 01:04:14 2022] *** Sep 23 01:04:14.144916 dv-cinder-849143-7-smb devstack@keystone.service[81911]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 23 01:04:14.144916 dv-cinder-849143-7-smb devstack@keystone.service[81911]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 23 01:04:14.144916 dv-cinder-849143-7-smb devstack@keystone.service[81911]: nodename: dv-cinder-849143-7-smb Sep 23 01:04:14.144916 dv-cinder-849143-7-smb devstack@keystone.service[81911]: machine: x86_64 Sep 23 01:04:14.144916 dv-cinder-849143-7-smb devstack@keystone.service[81911]: clock source: unix Sep 23 01:04:14.144916 dv-cinder-849143-7-smb devstack@keystone.service[81911]: pcre jit disabled Sep 23 01:04:14.144916 dv-cinder-849143-7-smb devstack@keystone.service[81911]: detected number of CPU cores: 4 Sep 23 01:04:14.144916 dv-cinder-849143-7-smb devstack@keystone.service[81911]: current working directory: / Sep 23 01:04:14.144916 dv-cinder-849143-7-smb devstack@keystone.service[81911]: detected binary path: /usr/bin/uwsgi-core Sep 23 01:04:14.144916 dv-cinder-849143-7-smb devstack@keystone.service[81911]: your processes number limit is 47680 Sep 23 01:04:14.144916 dv-cinder-849143-7-smb devstack@keystone.service[81911]: your memory page size is 4096 bytes Sep 23 01:04:14.144916 dv-cinder-849143-7-smb devstack@keystone.service[81911]: detected max file descriptor number: 2048 Sep 23 01:04:14.144916 dv-cinder-849143-7-smb devstack@keystone.service[81911]: lock engine: pthread robust mutexes Sep 23 01:04:14.144916 dv-cinder-849143-7-smb devstack@keystone.service[81911]: thunder lock: enabled Sep 23 01:04:14.144916 dv-cinder-849143-7-smb devstack@keystone.service[81911]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 23 01:04:14.144916 dv-cinder-849143-7-smb devstack@keystone.service[81911]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 23 01:04:14.183198 dv-cinder-849143-7-smb devstack@keystone.service[81911]: Python main interpreter initialized at 0x55d25e10f9c0 Sep 23 01:04:14.183198 dv-cinder-849143-7-smb devstack@keystone.service[81911]: python threads support enabled Sep 23 01:04:14.183198 dv-cinder-849143-7-smb devstack@keystone.service[81911]: your server socket listen backlog is limited to 100 connections Sep 23 01:04:14.183198 dv-cinder-849143-7-smb devstack@keystone.service[81911]: your mercy for graceful operations on workers is 90 seconds Sep 23 01:04:14.183590 dv-cinder-849143-7-smb devstack@keystone.service[81911]: mapped 403077 bytes (393 KB) for 2 cores Sep 23 01:04:14.183666 dv-cinder-849143-7-smb devstack@keystone.service[81911]: *** Operational MODE: preforking *** Sep 23 01:04:14.183932 dv-cinder-849143-7-smb devstack@keystone.service[81911]: *** uWSGI is running in multiple interpreter mode *** Sep 23 01:04:14.183932 dv-cinder-849143-7-smb devstack@keystone.service[81911]: spawned uWSGI master process (pid: 81911) Sep 23 01:04:14.184191 dv-cinder-849143-7-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 23 01:04:14.184986 dv-cinder-849143-7-smb devstack@keystone.service[81911]: spawned uWSGI worker 1 (pid: 81923, cores: 1) Sep 23 01:04:14.185089 dv-cinder-849143-7-smb devstack@keystone.service[81911]: spawned uWSGI worker 2 (pid: 81924, cores: 1) Sep 23 01:04:14.185401 dv-cinder-849143-7-smb devstack@keystone.service[81911]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 23 01:04:18.722227 dv-cinder-849143-7-smb devstack@keystone.service[81923]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 01:04:18.722227 dv-cinder-849143-7-smb devstack@keystone.service[81923]: from cryptography.utils import int_from_bytes Sep 23 01:04:18.723529 dv-cinder-849143-7-smb devstack@keystone.service[81923]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 01:04:18.723529 dv-cinder-849143-7-smb devstack@keystone.service[81923]: from cryptography.utils import int_from_bytes Sep 23 01:04:18.723890 dv-cinder-849143-7-smb devstack@keystone.service[81924]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 01:04:18.723890 dv-cinder-849143-7-smb devstack@keystone.service[81924]: from cryptography.utils import int_from_bytes Sep 23 01:04:18.724693 dv-cinder-849143-7-smb devstack@keystone.service[81924]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 01:04:18.724693 dv-cinder-849143-7-smb devstack@keystone.service[81924]: from cryptography.utils import int_from_bytes Sep 23 01:04:18.782089 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 01:04:18.782327 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 01:04:18.782484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] command line args: [] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 01:04:18.782770 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 01:04:18.783068 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ================================================================================ {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 01:04:18.783261 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] admin_token = **** {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.783652 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] config_dir = [] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.783853 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.783853 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] config_source = [] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.784130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] debug = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.784248 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.785339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.785339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.785339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.785339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.785998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] list_limit = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.785998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] log_config_append = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.785998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.785998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] log_dir = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.786655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] log_file = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.786655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.786655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.787120 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.787120 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.787427 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.787427 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.787737 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.787907 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.788131 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.788407 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.788739 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.788934 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.789162 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.789416 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.789693 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.790205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.83/identity {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.790407 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] publish_errors = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.790668 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.790854 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.791023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.791233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.791475 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.791709 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] standard_threads = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.791941 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.792186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.792372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.792517 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 01:04:18.792660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] use_journal = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.792660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] use_json = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.792991 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 01:04:18.793120 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] use_stderr = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.793248 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] command line args: [] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 01:04:18.793378 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] use_syslog = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.793516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 01:04:18.793642 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.793762 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ================================================================================ {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 01:04:18.793891 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.794010 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] admin_token = **** {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.794182 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.794387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] config_dir = [] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.794509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.794654 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.794654 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] config_source = [] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.794873 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.795047 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] debug = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.795249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.795382 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.795529 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.795720 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.795858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.796034 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.796141 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.796320 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.796435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.796560 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.796668 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.796803 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] list_limit = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.796803 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] log_config_append = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.797064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.797196 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.797314 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.797455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] log_dir = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.797587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.797696 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] log_file = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.797812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.797923 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.798050 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.798157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.798280 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.798397 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.798524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.798664 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.798866 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.798984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.798984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.799201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.799323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.799450 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.799603 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.799756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.799874 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.800000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.800122 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.800247 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.800365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.800476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.800596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.800705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.800827 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.800957 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.801065 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.801257 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.801377 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.801488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.801488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.801720 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.83/identity {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.801837 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.801946 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] publish_errors = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.802057 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.802178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.802282 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.802416 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.802416 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.802663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.809081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.809276 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.809396 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.809524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.809639 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] standard_threads = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.809765 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.809880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.810013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.810127 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.810254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.810379 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.810502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.810698 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] use_journal = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.810698 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] use_json = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.810986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.811108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] use_stderr = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.811291 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.811408 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] use_syslog = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.811520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.811657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:04:18.811775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.811893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.812004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.812127 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.812235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.812360 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.812473 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.812597 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.812706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.812818 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.812929 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.813054 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.813179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.813288 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.813399 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.813511 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.813633 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.813758 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.813866 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.813866 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.814095 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.814203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.814333 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.814452 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.814562 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.814732 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.814907 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.815028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.815155 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.815270 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.815386 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.815502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.815618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.815775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.816004 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.816162 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.816315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.816467 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.816625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.816780 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.816952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.817112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.817338 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.817498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.817673 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.817933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.817933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.818202 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.818329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.818455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.818657 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.818827 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.818937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.818937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.819231 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.819401 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.819401 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.819648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.819777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.819937 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.820070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.820505 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.820615 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.820615 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.821413 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.821535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.821714 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.821833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.821833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.822105 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.822222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.822349 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.822533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.822533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.822901 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.823016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.823016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.823310 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.823477 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.823477 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.823792 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.823954 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.823954 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.824215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.824333 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.824470 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.824625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.824625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.824842 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.824964 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.824964 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.825177 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.825301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.825301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.825518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.825718 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.825831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.826000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.826000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.826220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.826337 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.826475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.826630 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.826774 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.826896 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.827007 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.827129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.827240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.827353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.827489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.827599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.827715 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.827835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.827946 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.828065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.828190 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.828309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] auth.external = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.828422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.828534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.828699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.828825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.829027 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.829173 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.829286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.829451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] auth.password = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.829560 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.829688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] auth.token = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.829808 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.829921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.830035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.830148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.830261 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.830386 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.830497 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.830656 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.830775 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.830905 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.831016 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.831184 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.831296 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.831417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.831540 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.831691 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] credential.caching = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.831808 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.831921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.832047 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.832158 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.832273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.832386 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.832499 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.832499 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.832727 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.832841 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.832954 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.833072 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.833186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.833311 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.833311 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.833518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.833630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.833744 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.833858 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.833858 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.834080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.834226 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.834226 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.834436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.834552 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.834552 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.834856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.834976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.834976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.835247 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.835369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.835369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.835602 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.835602 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.836436 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.836436 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.836664 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.836784 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.836784 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.837035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] federation.caching = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.837160 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.837280 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.837408 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.837408 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.837632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.837763 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.837763 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.837970 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.838081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.838081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.838296 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.838429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.838429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.838682 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.838811 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.838811 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.839036 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.839036 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.839264 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.839392 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.839511 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.839630 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.839750 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.839960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.839960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.840202 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.840315 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] identity.caching = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.840456 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.840559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.840684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.840793 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.840904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.841016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.841125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.841235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.841368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] auth.external = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.841487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.841610 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.841730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.841856 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.841986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.842115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.842115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] auth.password = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.842329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.842455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] auth.token = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.842573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.842798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.842936 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.843049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.843167 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.843285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.843403 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.843521 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.843655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.843769 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.843888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.843888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.844109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.844109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.844353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.844477 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] credential.caching = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.844591 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.844710 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.844826 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.844826 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.845064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.845185 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.845305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.845422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.845539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.845706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.845820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.845937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.845937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.846165 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.846281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.846411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.846524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.846653 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.846766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.846894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.847013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.847153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.847260 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.847363 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.847472 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.847600 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.847710 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.847823 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.847929 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.848034 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.848140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.848244 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.848355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.848469 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] federation.caching = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.848574 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.848682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.848787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.848899 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.849003 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.849115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.849224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.849329 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.849433 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.849537 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.849642 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.849757 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.849867 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.849971 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.850083 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.850188 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.850291 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.850403 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.850509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.850693 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.850797 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.850896 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.850996 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.851587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] identity.caching = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.851747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.851913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.852029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.852151 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.852270 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.852402 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.852516 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.852644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.852759 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.user = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.852878 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.852994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.853124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.853239 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.853358 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.853475 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.853598 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.853724 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.853849 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.853965 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.854083 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.854200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.854314 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.854423 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.854559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.854708 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.854826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.854943 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.855060 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.855179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.855327 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.855439 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.855439 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.855658 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.855775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.855905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.856031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.856147 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.856275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.856399 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.856513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.856628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.856750 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.856878 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.856994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.857114 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.857231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.857396 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.857509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.857637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.857751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.857875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.857993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.858123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.858237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.858355 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.858472 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.858617 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.858742 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.858888 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.859018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.859136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.859254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.859373 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.859490 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.859620 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.859735 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.859854 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.859972 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.860102 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.860223 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.860353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.860469 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.860588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.860705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.860822 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.860927 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.861050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.861160 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.861271 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.861400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.861518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.861639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] resource.caching = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.861772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.861898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.862018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.862139 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.862258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.862379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.862512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.862669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.862790 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.862908 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.863026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.863144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.863455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.863572 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.863692 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.863814 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.863931 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.864049 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.864180 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.864295 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] role.caching = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.864295 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] role.driver = sql {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.864513 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.user = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.864630 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.864746 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.864876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.864990 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.865109 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.865228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.865349 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.865465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.865596 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.865710 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.865826 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.865936 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.866060 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.866176 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.866306 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.866421 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.866537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.866751 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.866878 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.867509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.867651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.867769 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.867895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.868025 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.868145 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.868266 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.868402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.868518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.868518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.868878 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.868994 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.869118 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.869253 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.869376 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.869497 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.869618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.869739 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.869870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.869988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.870112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.870234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.870354 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.870477 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.870681 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.870810 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.870925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.871043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.871167 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.871167 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.871400 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.871400 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.871616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.871616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.871913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.872106 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.872264 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.872384 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.872499 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.872610 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.872729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.872851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.872981 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.873095 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.873213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.873330 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.873448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.873566 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] token.caching = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.873694 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.873811 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.873927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.874044 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.874161 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.874279 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.874407 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] resource.caching = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.874528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.874528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.874753 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.874872 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.875006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.875133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.875249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.875367 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.875485 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.875603 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.875603 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.875836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.875948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.875948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.876171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.876291 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.876410 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.876540 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.876655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.876773 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.876898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.877034 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.877034 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.877250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] role.caching = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.877382 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.connection = **** {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.877499 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] role.driver = sql {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.877619 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.877735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.877864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.877864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.878091 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.878205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.878326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.878448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.878635 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.878750 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.878892 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.879012 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.879137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.879254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.879371 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.879494 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.879494 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.879721 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.879839 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.879957 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.880075 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.880193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.880321 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.880436 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.880565 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.880688 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.880795 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.880893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.881000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.881096 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.881188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.881188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.881188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 01:04:18.881446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.881446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.881446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.881446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.881446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.881446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.881446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.881446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.881446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.882041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.882041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.882041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.882041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.882041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.882041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.882041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.882041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.882041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.882859 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.882859 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] token.caching = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.882859 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.882859 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.883795 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.884248 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.884248 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.884566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.884726 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.885071 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.885334 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.885578 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.885833 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.886058 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.886342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.886856 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.887141 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.887437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.887903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.889211 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.connection = **** {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.889211 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.889211 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.889545 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.889749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.890030 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.890358 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.890718 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.891009 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.891300 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.891558 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.891813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.892114 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.892372 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.892617 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.893023 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.893236 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.893485 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.893726 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:04:18.895489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 01:04:18.908858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:18.909243 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:18.909349 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:18.917985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:18.919998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:18.920233 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:18.920467 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:18.929181 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:18.947836 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:18.948064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:18.949079 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:18.949315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.013673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.015519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.068591 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.068917 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.069863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.070145 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.232789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.233085 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.233400 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.233703 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.234043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.234334 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.234815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.235194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.235560 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.235928 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.236295 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.236682 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.260300 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.260555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.260870 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.261039 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.261187 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.261400 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.261608 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.261785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.261998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.262219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.262419 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.262670 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.262888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.263159 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.282506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.284246 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.296488 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.296707 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.296932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.297184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.297427 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.297583 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.297800 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.300334 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.300664 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.300956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.305318 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.305318 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.305318 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.305318 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 01:04:19.322737 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.323015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 01:04:19.323453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.323647 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.323771 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 01:04:19.323891 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 01:04:19.324147 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.324301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.324512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 01:04:19.324621 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.324783 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.324936 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.325049 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.325317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.325407 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.325586 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.335556 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.335862 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.339351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.339518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.339615 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.339733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.339733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.339733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.343700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.344814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.346894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.347173 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.347580 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.348052 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.348142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.348491 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.348578 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.348872 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.349013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.349176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.349351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.349501 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.349728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.349897 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.350040 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.350180 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.350319 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.350611 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.350994 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.352004 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.352287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.352601 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.374961 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.376481 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.376741 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.376892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.378263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.378553 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.381594 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.381880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.382221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.383298 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.383596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.383889 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.389050 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.389374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.390519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.390887 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.394926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.395294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.395509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.395631 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.395965 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.396095 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.396222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.396394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.396718 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.396718 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.396968 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.397253 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.397507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.398823 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.399123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.399413 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.413928 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.414776 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.415796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.416097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.418863 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.420002 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.422242 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.422541 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.423136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.423451 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.426838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.427932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.430148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.431181 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.433675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.433986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.434964 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.435106 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.435106 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.435346 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.435467 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.435607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.435881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.436003 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.436130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.436130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.451842 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.451842 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.452202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.452322 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.452444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.452565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.452773 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.453077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.459429 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.460279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.461510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.463210 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.463445 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.463445 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.464595 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.464930 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.466060 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.466402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.466730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.467067 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.467512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.467965 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.468259 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.468574 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.468839 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.469131 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.479669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.480000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.480406 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.480686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.481075 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.481285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.481496 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.481711 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.481914 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.482118 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.482118 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.482459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.482691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.482906 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.497877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.498910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.500862 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.502095 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.503939 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.505373 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.505480 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.506893 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.506995 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.507176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.507807 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.508667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.509005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.509345 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.514331 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.515855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.516280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.517815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.518784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.519188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.519501 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.519785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.521030 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.521373 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.521712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.522066 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.528439 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.528735 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.529024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.530992 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.531349 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.531681 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.542725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.542725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.542725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.542725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.542725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.542725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.542725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.543678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.543678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.543678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.543678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.544216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 01:04:19.544347 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.544490 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.544651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.544804 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.544935 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.545062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.545062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.545062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.545062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.545062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.545062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.545864 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.545864 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.545864 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.545864 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.545864 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 01:04:19.577078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d25e10f9c0 pid: 81924 (default app) Sep 23 01:04:19.579615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d25e10f9c0 pid: 81923 (default app) Sep 23 01:04:19.580634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f60b37-0858-4dd2-abe6-da1ebe29d833 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:19.580926 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f60b37-0858-4dd2-abe6-da1ebe29d833 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:19.581195 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f60b37-0858-4dd2-abe6-da1ebe29d833 None None] PATH_INFO: `/v3` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:19.585370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1/1] 10.222.0.83 () {50 vars in 791 bytes} [Fri Sep 23 01:04:19 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:28.643883 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a732e9-7cb0-4232-829f-077a19701b9e None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:28.644455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a732e9-7cb0-4232-829f-077a19701b9e None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:28.644455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a732e9-7cb0-4232-829f-077a19701b9e None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:28.648856 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1/2] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:04:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:04:28.654373 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54fbe7-58df-4f1a-8aad-17809d3964c7 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:28.654895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54fbe7-58df-4f1a-8aad-17809d3964c7 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:28.654990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54fbe7-58df-4f1a-8aad-17809d3964c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:28.726948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: INFO dbcounter [None req-fe54fbe7-58df-4f1a-8aad-17809d3964c7 None None] Registered counter for database keystone Sep 23 01:04:28.749214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG oslo_db.sqlalchemy.engines [None req-fe54fbe7-58df-4f1a-8aad-17809d3964c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 01:04:28.755821 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writer thread running {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 01:04:28.943101 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG passlib.handlers.bcrypt [None req-fe54fbe7-58df-4f1a-8aad-17809d3964c7 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81924) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 23 01:04:28.943397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG passlib.handlers.bcrypt [None req-fe54fbe7-58df-4f1a-8aad-17809d3964c7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81924) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 23 01:04:29.009430 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-fe54fbe7-58df-4f1a-8aad-17809d3964c7 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:04:29.011317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-fe54fbe7-58df-4f1a-8aad-17809d3964c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:04:29.148998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 2/3] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:04:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 23 01:04:29.662948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a732e9-7cb0-4232-829f-077a19701b9e None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:29.739688 dv-cinder-849143-7-smb devstack@keystone.service[81923]: INFO dbcounter [None req-a9a732e9-7cb0-4232-829f-077a19701b9e None None] Registered counter for database keystone Sep 23 01:04:29.760698 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG oslo_db.sqlalchemy.engines [None req-a9a732e9-7cb0-4232-829f-077a19701b9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 01:04:29.767874 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writer thread running {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 01:04:29.892706 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a732e9-7cb0-4232-829f-077a19701b9e None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:29.897291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fc9cf-3b39-4984-923a-05cc3df9dc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:29.898466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fc9cf-3b39-4984-923a-05cc3df9dc81 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:29.898908 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fc9cf-3b39-4984-923a-05cc3df9dc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:29.899286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fc9cf-3b39-4984-923a-05cc3df9dc81 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:29.908699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9fc9cf-3b39-4984-923a-05cc3df9dc81 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:29.961417 dv-cinder-849143-7-smb devstack@keystone.service[81923]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bf9fc9cf-3b39-4984-923a-05cc3df9dc81 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 23 01:04:29.961642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9fc9cf-3b39-4984-923a-05cc3df9dc81 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:29.972300 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 2/4] 10.222.0.83 () {58 vars in 1324 bytes} [Fri Sep 23 01:04:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 01:04:29.979310 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54fbe7-58df-4f1a-8aad-17809d3964c7 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:29.997933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54fbe7-58df-4f1a-8aad-17809d3964c7 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:30.002362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ddf47-d3de-4416-80d6-fa3db3a1d4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:30.003521 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ddf47-d3de-4416-80d6-fa3db3a1d4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:30.003794 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ddf47-d3de-4416-80d6-fa3db3a1d4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:30.004063 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ddf47-d3de-4416-80d6-fa3db3a1d4c2 admin admin] PATH_INFO: `/v3/projects/bb2e67cab7234c2983ce58824e8c7d2f` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:30.005676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ddf47-d3de-4416-80d6-fa3db3a1d4c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=bb2e67cab7234c2983ce58824e8c7d2f)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:30.060809 dv-cinder-849143-7-smb devstack@keystone.service[81924]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e44ddf47-d3de-4416-80d6-fa3db3a1d4c2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 23 01:04:30.061152 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ddf47-d3de-4416-80d6-fa3db3a1d4c2 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:30.066149 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 3/5] 10.222.0.83 () {56 vars in 1207 bytes} [Fri Sep 23 01:04:29 2022] GET /identity/v3/projects/bb2e67cab7234c2983ce58824e8c7d2f => generated 344 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:32.300393 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050649d2-687c-4556-a9ce-e1eeab5ee695 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:32.300944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050649d2-687c-4556-a9ce-e1eeab5ee695 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:32.300944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050649d2-687c-4556-a9ce-e1eeab5ee695 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:32.305297 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 3/6] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:04:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:04:32.311787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6404bd-c600-40c0-af21-c36eb6f21f88 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:32.312244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6404bd-c600-40c0-af21-c36eb6f21f88 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:32.312323 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6404bd-c600-40c0-af21-c36eb6f21f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:32.332942 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-1e6404bd-c600-40c0-af21-c36eb6f21f88 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:04:32.334547 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-1e6404bd-c600-40c0-af21-c36eb6f21f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:04:32.343175 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 4/7] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:04:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 23 01:04:32.610217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050649d2-687c-4556-a9ce-e1eeab5ee695 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:32.623119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050649d2-687c-4556-a9ce-e1eeab5ee695 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:32.627326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52790672-20fa-4c9a-b2f4-07821764885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:32.627943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52790672-20fa-4c9a-b2f4-07821764885f admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:32.628222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52790672-20fa-4c9a-b2f4-07821764885f admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:32.628501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52790672-20fa-4c9a-b2f4-07821764885f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:32.637227 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52790672-20fa-4c9a-b2f4-07821764885f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:32.639044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52790672-20fa-4c9a-b2f4-07821764885f admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:32.648041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 4/8] 10.222.0.83 () {58 vars in 1324 bytes} [Fri Sep 23 01:04:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 01:04:32.653825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6404bd-c600-40c0-af21-c36eb6f21f88 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:32.663112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6404bd-c600-40c0-af21-c36eb6f21f88 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:32.668313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a11f1-4925-41b2-8900-c703c347c150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:32.668958 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a11f1-4925-41b2-8900-c703c347c150 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:32.669236 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a11f1-4925-41b2-8900-c703c347c150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:32.669504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a11f1-4925-41b2-8900-c703c347c150 admin admin] PATH_INFO: `/v3/users/41222441d92243a6917a027e72480f53` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:32.670847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a11f1-4925-41b2-8900-c703c347c150 admin admin] RBAC: Authorizing `identity:get_user(user_id=41222441d92243a6917a027e72480f53)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:32.672681 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a11f1-4925-41b2-8900-c703c347c150 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:32.674222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 5/9] 10.222.0.83 () {56 vars in 1198 bytes} [Fri Sep 23 01:04:32 2022] GET /identity/v3/users/41222441d92243a6917a027e72480f53 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:34.951568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af239d-4e77-48bf-a918-d63702a09c1e None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:34.952145 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af239d-4e77-48bf-a918-d63702a09c1e None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:34.952145 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af239d-4e77-48bf-a918-d63702a09c1e None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:34.953454 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 5/10] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:04:34.959455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b8bb4-c290-4d44-b6c1-9d4d3aa0b2a9 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:34.959951 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b8bb4-c290-4d44-b6c1-9d4d3aa0b2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:34.960137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b8bb4-c290-4d44-b6c1-9d4d3aa0b2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:34.980905 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-eb9b8bb4-c290-4d44-b6c1-9d4d3aa0b2a9 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:04:34.982117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-eb9b8bb4-c290-4d44-b6c1-9d4d3aa0b2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:04:35.002132 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c0639-72be-4d1a-952a-6e1f80832e96 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:35.002403 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c0639-72be-4d1a-952a-6e1f80832e96 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:35.002702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c0639-72be-4d1a-952a-6e1f80832e96 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:35.004035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 6/11] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:04:35.010230 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e991ef-807f-4ac2-95e8-e06f1aad1729 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:35.010510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e991ef-807f-4ac2-95e8-e06f1aad1729 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:35.010820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e991ef-807f-4ac2-95e8-e06f1aad1729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:35.052917 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG passlib.handlers.bcrypt [None req-a1e991ef-807f-4ac2-95e8-e06f1aad1729 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81923) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 23 01:04:35.053296 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG passlib.handlers.bcrypt [None req-a1e991ef-807f-4ac2-95e8-e06f1aad1729 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81923) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 23 01:04:35.075289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 6/12] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:04:35.103269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-a1e991ef-807f-4ac2-95e8-e06f1aad1729 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:04:35.104864 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a1e991ef-807f-4ac2-95e8-e06f1aad1729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:04:35.217611 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 7/13] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:04:35.349844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b8bb4-c290-4d44-b6c1-9d4d3aa0b2a9 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:35.386168 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:35.477614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b8bb4-c290-4d44-b6c1-9d4d3aa0b2a9 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:35.491928 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e991ef-807f-4ac2-95e8-e06f1aad1729 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:35.519700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30845e-064b-451f-9997-7f6fba2a4f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:35.520845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30845e-064b-451f-9997-7f6fba2a4f65 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:35.521349 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30845e-064b-451f-9997-7f6fba2a4f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:35.521751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30845e-064b-451f-9997-7f6fba2a4f65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:35.538243 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30845e-064b-451f-9997-7f6fba2a4f65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:04:35.547634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-4c30845e-064b-451f-9997-7f6fba2a4f65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:04:35.547634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:04:35.547634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:04:35.547634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:04:35.547634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:04:35.547634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:04:35.547634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:04:35.547634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:04:35.547634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:04:35.547634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:04:35.547634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:04:35.547634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:04:35.547634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:04:35.547634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:04:35.547634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:04:35.547634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:04:35.548712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:04:35.548712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:04:35.548712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:04:35.548712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:04:35.548712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:04:35.548712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:04:35.548712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:04:35.548712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:04:35.548712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:04:35.548712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:04:35.548712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:04:35.548712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:04:35.548712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:04:35.548712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:04:35.548712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:04:35.548712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:04:35.550203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:04:35.550203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:04:35.550203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:04:35.550203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:04:35.550203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:04:35.550203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:04:35.550203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:04:35.550203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:04:35.550203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:04:35.550203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:04:35.550203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:04:35.550203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:04:35.550203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 7/14] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:04:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:04:35.555560 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30845e-064b-451f-9997-7f6fba2a4f65 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:35.604514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e991ef-807f-4ac2-95e8-e06f1aad1729 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:35.607005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:35.643789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613d888-742d-4df7-8c75-6bffb746e2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:35.644669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613d888-742d-4df7-8c75-6bffb746e2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:35.645068 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613d888-742d-4df7-8c75-6bffb746e2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:35.645350 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613d888-742d-4df7-8c75-6bffb746e2c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:35.645458 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:35.665620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30845e-064b-451f-9997-7f6fba2a4f65 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:35.708723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cdc55-9d45-4654-aef1-32a7eb19727c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:35.709345 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cdc55-9d45-4654-aef1-32a7eb19727c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:35.709624 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cdc55-9d45-4654-aef1-32a7eb19727c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:35.709895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cdc55-9d45-4654-aef1-32a7eb19727c None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:35.711221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cdc55-9d45-4654-aef1-32a7eb19727c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:04:35.711526 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cdc55-9d45-4654-aef1-32a7eb19727c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:35.712931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cdc55-9d45-4654-aef1-32a7eb19727c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:35.718062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613d888-742d-4df7-8c75-6bffb746e2c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:35.719615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613d888-742d-4df7-8c75-6bffb746e2c5 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:35.725093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 8/15] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:04:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:04:35.731234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cdc55-9d45-4654-aef1-32a7eb19727c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:35.831407 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 8/16] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:04:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 01:04:35.838030 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613d888-742d-4df7-8c75-6bffb746e2c5 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:35.841342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:35.847207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cdc55-9d45-4654-aef1-32a7eb19727c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:35.890107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2286a-5f20-40ef-847e-c931ae5eff0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:35.891274 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2286a-5f20-40ef-847e-c931ae5eff0f None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:35.891767 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2286a-5f20-40ef-847e-c931ae5eff0f None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:35.892237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2286a-5f20-40ef-847e-c931ae5eff0f None admin] PATH_INFO: `/v3/users/41222441d92243a6917a027e72480f53` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:35.894539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2286a-5f20-40ef-847e-c931ae5eff0f None admin] RBAC: Authorizing `identity:get_user(user_id=41222441d92243a6917a027e72480f53)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:35.897464 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2286a-5f20-40ef-847e-c931ae5eff0f None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:35.901334 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 9/17] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:04:35 2022] GET /identity/v3/users/41222441d92243a6917a027e72480f53 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:04:35.907051 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2286a-5f20-40ef-847e-c931ae5eff0f None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:35.924833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:36.007031 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613d888-742d-4df7-8c75-6bffb746e2c5 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:36.031878 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2286a-5f20-40ef-847e-c931ae5eff0f None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:36.059607 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e6396-f450-4ed4-9624-61d1fa8230e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:36.060449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e6396-f450-4ed4-9624-61d1fa8230e3 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:36.060729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e6396-f450-4ed4-9624-61d1fa8230e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:36.061031 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e6396-f450-4ed4-9624-61d1fa8230e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:36.079231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2ce62-0ba8-4954-9992-c76bbbd33151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:36.079893 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2ce62-0ba8-4954-9992-c76bbbd33151 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:36.080167 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2ce62-0ba8-4954-9992-c76bbbd33151 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:36.080566 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2ce62-0ba8-4954-9992-c76bbbd33151 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:36.082644 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2ce62-0ba8-4954-9992-c76bbbd33151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:36.083460 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2ce62-0ba8-4954-9992-c76bbbd33151 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:36.090426 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 10/18] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:04:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:04:36.090555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e6396-f450-4ed4-9624-61d1fa8230e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:36.090555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e6396-f450-4ed4-9624-61d1fa8230e3 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:36.091573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2ce62-0ba8-4954-9992-c76bbbd33151 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:36.112913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-b92e6396-f450-4ed4-9624-61d1fa8230e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:04:36.112913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:04:36.112913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:04:36.112913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:04:36.112913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:04:36.112913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:04:36.112913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:04:36.112913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:04:36.112913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:04:36.112913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:04:36.112913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:04:36.112913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:04:36.112913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:04:36.112913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:04:36.112913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:04:36.112913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:04:36.114254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:04:36.114254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:04:36.114254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:04:36.114254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:04:36.114254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:04:36.114254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:04:36.114254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:04:36.114254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:04:36.114254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:04:36.114254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:04:36.114254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:04:36.114254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:04:36.114254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:04:36.114254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:04:36.114254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:04:36.114254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:04:36.114254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:04:36.115544 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:04:36.115544 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:04:36.115544 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:04:36.115544 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 9/19] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:04:36.122859 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e6396-f450-4ed4-9624-61d1fa8230e3 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:36.203483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:36.218227 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:36.231859 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2ce62-0ba8-4954-9992-c76bbbd33151 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:36.279433 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e6396-f450-4ed4-9624-61d1fa8230e3 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:36.290107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b902c0-f2b4-41cd-abc2-702d0ac7b9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:36.291224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b902c0-f2b4-41cd-abc2-702d0ac7b9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:36.291728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b902c0-f2b4-41cd-abc2-702d0ac7b9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:36.292232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b902c0-f2b4-41cd-abc2-702d0ac7b9f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:36.293628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b902c0-f2b4-41cd-abc2-702d0ac7b9f1 None admin] RBAC: Adding query filter params (role.id=d365054bc34046c5829cd1355f3a31ac, scope.domain.id=default, user.id=41222441d92243a6917a027e72480f53) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:04:36.294179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b902c0-f2b4-41cd-abc2-702d0ac7b9f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:36.297065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b902c0-f2b4-41cd-abc2-702d0ac7b9f1 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:36.310785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 11/20] 10.222.0.83 () {56 vars in 1322 bytes} [Fri Sep 23 01:04:36 2022] GET /identity/v3/role_assignments?user.id=41222441d92243a6917a027e72480f53&scope.domain.id=default&role.id=d365054bc34046c5829cd1355f3a31ac => generated 233 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:36.333714 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601547ef-81cb-432e-91f6-2c32be63a169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:36.334812 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601547ef-81cb-432e-91f6-2c32be63a169 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:36.335261 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601547ef-81cb-432e-91f6-2c32be63a169 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:36.335704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601547ef-81cb-432e-91f6-2c32be63a169 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:36.336870 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601547ef-81cb-432e-91f6-2c32be63a169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:04:36.337405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601547ef-81cb-432e-91f6-2c32be63a169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:36.340082 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601547ef-81cb-432e-91f6-2c32be63a169 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:36.386628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 10/21] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:39.654563 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558d73d-33a9-454a-8c78-72b9baf1abae None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:39.654563 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558d73d-33a9-454a-8c78-72b9baf1abae None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:39.654563 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558d73d-33a9-454a-8c78-72b9baf1abae None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:39.654563 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 12/22] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:04:39.661605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a5274-8d34-43ad-973b-d8010566ab7a None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:39.662100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a5274-8d34-43ad-973b-d8010566ab7a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:39.662571 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a5274-8d34-43ad-973b-d8010566ab7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:39.701341 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-320a5274-8d34-43ad-973b-d8010566ab7a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:04:39.703567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-320a5274-8d34-43ad-973b-d8010566ab7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:04:39.809659 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 11/23] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:04:40.127432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d696e6-381f-4140-b7b0-669c084ed0b8 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:40.127432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d696e6-381f-4140-b7b0-669c084ed0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:40.127432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d696e6-381f-4140-b7b0-669c084ed0b8 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:40.127432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 13/24] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:04:40.135798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1dd63-b8dd-49e6-9422-4d31277a4d1b None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:40.136736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1dd63-b8dd-49e6-9422-4d31277a4d1b None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:40.137537 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1dd63-b8dd-49e6-9422-4d31277a4d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:40.173785 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-29f1dd63-b8dd-49e6-9422-4d31277a4d1b None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:04:40.175713 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-29f1dd63-b8dd-49e6-9422-4d31277a4d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:04:40.256528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:40.293249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 12/25] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:04:40.313905 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d696e6-381f-4140-b7b0-669c084ed0b8 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:40.500599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d696e6-381f-4140-b7b0-669c084ed0b8 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:40.566351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c9136-34fe-46e1-9b24-0724fc669008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:40.567100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c9136-34fe-46e1-9b24-0724fc669008 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:40.567472 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c9136-34fe-46e1-9b24-0724fc669008 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:40.567783 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c9136-34fe-46e1-9b24-0724fc669008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:40.582631 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c9136-34fe-46e1-9b24-0724fc669008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:40.584255 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c9136-34fe-46e1-9b24-0724fc669008 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:40.592694 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:40.610820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-b90c9136-34fe-46e1-9b24-0724fc669008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:04:40.610820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:04:40.610820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:04:40.610820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:04:40.610820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:04:40.610820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:04:40.610820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:04:40.610820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:04:40.610820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:04:40.610820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:04:40.610820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:04:40.610820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:04:40.610820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:04:40.610820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:04:40.610820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:04:40.610820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:04:40.611755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:04:40.611755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:04:40.611755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:04:40.611755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:04:40.611755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:04:40.611755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:04:40.611755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:04:40.611755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:04:40.611755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:04:40.611755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:04:40.611755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:04:40.611755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:04:40.611755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:04:40.611755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:04:40.611755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:04:40.611755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:04:40.611755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:04:40.612705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:04:40.612705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:04:40.612705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:04:40.612705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 14/26] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:04:40.621387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1dd63-b8dd-49e6-9422-4d31277a4d1b None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:40.650748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51297e-1e9a-46b4-afe3-6f094026a614 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:40.651120 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51297e-1e9a-46b4-afe3-6f094026a614 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:40.651401 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51297e-1e9a-46b4-afe3-6f094026a614 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:40.653144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 15/27] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:04:40.661474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d040b71-56ac-41fb-886d-3cda00ded52c None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:40.662229 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d040b71-56ac-41fb-886d-3cda00ded52c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:40.662229 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d040b71-56ac-41fb-886d-3cda00ded52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:40.702051 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-5d040b71-56ac-41fb-886d-3cda00ded52c None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:04:40.703543 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-5d040b71-56ac-41fb-886d-3cda00ded52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:04:40.903289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 16/28] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:04:40.906376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1dd63-b8dd-49e6-9422-4d31277a4d1b None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:40.994122 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb612b-551e-4404-bd47-aff0e99dcfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:40.995245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb612b-551e-4404-bd47-aff0e99dcfe4 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:40.995603 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb612b-551e-4404-bd47-aff0e99dcfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:40.995897 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb612b-551e-4404-bd47-aff0e99dcfe4 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:40.996760 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb612b-551e-4404-bd47-aff0e99dcfe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:04:40.997059 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb612b-551e-4404-bd47-aff0e99dcfe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:40.998791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb612b-551e-4404-bd47-aff0e99dcfe4 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:41.015334 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 13/29] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:41.024690 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d040b71-56ac-41fb-886d-3cda00ded52c None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:41.042426 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2de4a7-e462-455b-999c-6936eccc973d None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:41.043083 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2de4a7-e462-455b-999c-6936eccc973d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:41.043503 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2de4a7-e462-455b-999c-6936eccc973d None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:41.045281 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 14/30] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:04:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:04:41.048056 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2de4a7-e462-455b-999c-6936eccc973d None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:41.143664 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:41.274179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d040b71-56ac-41fb-886d-3cda00ded52c None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:41.336343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2de4a7-e462-455b-999c-6936eccc973d None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:41.338394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:41.353821 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad6d92-789c-4972-8d2d-54e540395257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:41.354961 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad6d92-789c-4972-8d2d-54e540395257 None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:41.355398 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad6d92-789c-4972-8d2d-54e540395257 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:41.358083 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad6d92-789c-4972-8d2d-54e540395257 None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:41.358083 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad6d92-789c-4972-8d2d-54e540395257 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:41.359598 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad6d92-789c-4972-8d2d-54e540395257 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:41.408841 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a878f3-b3d9-4760-8ca2-5ad978e10cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:41.409802 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a878f3-b3d9-4760-8ca2-5ad978e10cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:41.410300 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a878f3-b3d9-4760-8ca2-5ad978e10cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:41.410826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a878f3-b3d9-4760-8ca2-5ad978e10cc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:41.434219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a878f3-b3d9-4760-8ca2-5ad978e10cc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:04:41.446967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-88a878f3-b3d9-4760-8ca2-5ad978e10cc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:04:41.446967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:04:41.446967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:04:41.446967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:04:41.446967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:04:41.446967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:04:41.446967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:04:41.446967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:04:41.446967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:04:41.446967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:04:41.446967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:04:41.446967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:04:41.446967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:04:41.446967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:04:41.446967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:04:41.446967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:04:41.448074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:04:41.448074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:04:41.448074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:04:41.448074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:04:41.448074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:04:41.448074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:04:41.448074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:04:41.448074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:04:41.448074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:04:41.448074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:04:41.448074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:04:41.448074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:04:41.448074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:04:41.448074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:04:41.448074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:04:41.448074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:04:41.448836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:04:41.448836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:04:41.448836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:04:41.448836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:04:41.448836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:04:41.448836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:04:41.448836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:04:41.448836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:04:41.448836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:04:41.448836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:04:41.448836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:04:41.448836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:04:41.449436 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 15/31] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:04:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:04:41.451359 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aedc8e-4697-42fd-960f-f005e7686f17 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:41.451643 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aedc8e-4697-42fd-960f-f005e7686f17 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:41.452064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aedc8e-4697-42fd-960f-f005e7686f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:41.486350 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-20aedc8e-4697-42fd-960f-f005e7686f17 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:04:41.488590 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-20aedc8e-4697-42fd-960f-f005e7686f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:04:41.630335 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 16/32] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:04:41.633242 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57aeb4-6279-411d-963f-fd1b5d84a591 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:41.633737 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57aeb4-6279-411d-963f-fd1b5d84a591 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:41.634217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57aeb4-6279-411d-963f-fd1b5d84a591 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:41.636809 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 17/33] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:04:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:04:41.638227 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57aeb4-6279-411d-963f-fd1b5d84a591 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:41.676302 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 17/34] 10.222.0.83 () {60 vars in 1141 bytes} [Fri Sep 23 01:04:41 2022] POST /identity/v3/projects => generated 301 bytes in 652 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:04:41.679071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad6d92-789c-4972-8d2d-54e540395257 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:41.692362 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:41.888965 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57aeb4-6279-411d-963f-fd1b5d84a591 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:41.974665 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa9753-4910-4162-92af-ac566a152be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:41.975480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa9753-4910-4162-92af-ac566a152be8 None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:41.975630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa9753-4910-4162-92af-ac566a152be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:41.976094 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa9753-4910-4162-92af-ac566a152be8 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:41.982634 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa9753-4910-4162-92af-ac566a152be8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:41.982634 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa9753-4910-4162-92af-ac566a152be8 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:42.031614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad6d92-789c-4972-8d2d-54e540395257 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:42.092183 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b5e40-cca6-4672-a112-3007bfd13bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:42.093391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b5e40-cca6-4672-a112-3007bfd13bdd None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:42.093391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b5e40-cca6-4672-a112-3007bfd13bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:42.093391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b5e40-cca6-4672-a112-3007bfd13bdd None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:42.094258 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b5e40-cca6-4672-a112-3007bfd13bdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:04:42.094697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b5e40-cca6-4672-a112-3007bfd13bdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:42.096402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b5e40-cca6-4672-a112-3007bfd13bdd None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:42.107878 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 18/35] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:04:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:42.109625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3f68f-113e-4a67-977e-5d205bc78f8d None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:42.110213 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3f68f-113e-4a67-977e-5d205bc78f8d None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:42.110497 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3f68f-113e-4a67-977e-5d205bc78f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:42.137386 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-cdb3f68f-113e-4a67-977e-5d205bc78f8d None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:04:42.139266 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-cdb3f68f-113e-4a67-977e-5d205bc78f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:04:42.189125 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:42.242294 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 19/36] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:04:42.243757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3f68f-113e-4a67-977e-5d205bc78f8d None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:42.261447 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 18/37] 10.222.0.83 () {60 vars in 1131 bytes} [Fri Sep 23 01:04:41 2022] POST /identity/v3/roles => generated 219 bytes in 624 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:04:42.262277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa9753-4910-4162-92af-ac566a152be8 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:42.406137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3f68f-113e-4a67-977e-5d205bc78f8d None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:42.472475 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffc086-ebc0-46ef-8224-e7e5f20d334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:42.473537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffc086-ebc0-46ef-8224-e7e5f20d334c None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:42.474171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffc086-ebc0-46ef-8224-e7e5f20d334c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:42.474713 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffc086-ebc0-46ef-8224-e7e5f20d334c None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:42.476463 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffc086-ebc0-46ef-8224-e7e5f20d334c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:42.479174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffc086-ebc0-46ef-8224-e7e5f20d334c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:42.482159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:42.513228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa9753-4910-4162-92af-ac566a152be8 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:42.577847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 20/38] 10.222.0.83 () {60 vars in 1131 bytes} [Fri Sep 23 01:04:42 2022] POST /identity/v3/roles => generated 225 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:04:42.578117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcff0f0-08f0-4b04-90e1-79cadf4afce0 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:42.578579 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcff0f0-08f0-4b04-90e1-79cadf4afce0 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:42.579130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcff0f0-08f0-4b04-90e1-79cadf4afce0 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:42.582091 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 21/39] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:04:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:04:42.590170 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f0810-9933-4397-92c2-841d29d683bf None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:42.590902 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f0810-9933-4397-92c2-841d29d683bf None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:42.591527 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f0810-9933-4397-92c2-841d29d683bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:42.598377 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b50ec1-0700-47c6-b1ec-6912487b381e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:42.599426 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b50ec1-0700-47c6-b1ec-6912487b381e None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:42.599918 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b50ec1-0700-47c6-b1ec-6912487b381e None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:42.600375 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b50ec1-0700-47c6-b1ec-6912487b381e None admin] PATH_INFO: `/v3/users/41222441d92243a6917a027e72480f53` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:42.603821 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b50ec1-0700-47c6-b1ec-6912487b381e None admin] RBAC: Authorizing `identity:get_user(user_id=41222441d92243a6917a027e72480f53)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:42.606525 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b50ec1-0700-47c6-b1ec-6912487b381e None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:42.609967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 19/40] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:04:42 2022] GET /identity/v3/users/41222441d92243a6917a027e72480f53 => generated 247 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:42.617938 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b50ec1-0700-47c6-b1ec-6912487b381e None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:42.620356 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-785f0810-9933-4397-92c2-841d29d683bf None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:04:42.621918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-785f0810-9933-4397-92c2-841d29d683bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:04:42.663205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:42.729094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 22/41] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:04:42.780180 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f0810-9933-4397-92c2-841d29d683bf None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:42.815406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b50ec1-0700-47c6-b1ec-6912487b381e None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:42.889531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9bb74-131b-42ba-b395-4185edeff0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:42.890752 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9bb74-131b-42ba-b395-4185edeff0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:42.891333 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9bb74-131b-42ba-b395-4185edeff0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:42.892785 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9bb74-131b-42ba-b395-4185edeff0b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:42.895106 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9bb74-131b-42ba-b395-4185edeff0b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:42.898010 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9bb74-131b-42ba-b395-4185edeff0b6 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:42.902109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 20/42] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:04:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:04:42.910179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9bb74-131b-42ba-b395-4185edeff0b6 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:42.955312 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:42.997654 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f0810-9933-4397-92c2-841d29d683bf None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:43.089498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9bb74-131b-42ba-b395-4185edeff0b6 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:43.135576 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236259df-a645-45b9-a4ce-4be9041dadaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:43.136270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236259df-a645-45b9-a4ce-4be9041dadaf None admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:43.136555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236259df-a645-45b9-a4ce-4be9041dadaf None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:43.136899 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236259df-a645-45b9-a4ce-4be9041dadaf None admin] PATH_INFO: `/v3/domains/default/users/41222441d92243a6917a027e72480f53/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:43.139168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236259df-a645-45b9-a4ce-4be9041dadaf None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=41222441d92243a6917a027e72480f53, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:43.140653 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236259df-a645-45b9-a4ce-4be9041dadaf None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:43.196242 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da6aa4-f4f4-4b4b-840a-6aafdab59543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:43.197302 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da6aa4-f4f4-4b4b-840a-6aafdab59543 None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:43.197809 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da6aa4-f4f4-4b4b-840a-6aafdab59543 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:43.198299 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da6aa4-f4f4-4b4b-840a-6aafdab59543 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:43.199745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da6aa4-f4f4-4b4b-840a-6aafdab59543 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:43.201291 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da6aa4-f4f4-4b4b-840a-6aafdab59543 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:43.239173 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 21/43] 10.222.0.83 () {58 vars in 1361 bytes} [Fri Sep 23 01:04:42 2022] PUT /identity/v3/domains/default/users/41222441d92243a6917a027e72480f53/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:04:43.240211 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236259df-a645-45b9-a4ce-4be9041dadaf None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:43.298219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 23/44] 10.222.0.83 () {60 vars in 1131 bytes} [Fri Sep 23 01:04:42 2022] POST /identity/v3/roles => generated 223 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:04:43.376806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:43.401164 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236259df-a645-45b9-a4ce-4be9041dadaf None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:43.465644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13274023-14b2-4892-8568-a93bbaadbca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:43.474694 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13274023-14b2-4892-8568-a93bbaadbca6 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:43.474694 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13274023-14b2-4892-8568-a93bbaadbca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:43.474694 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13274023-14b2-4892-8568-a93bbaadbca6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:43.474694 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13274023-14b2-4892-8568-a93bbaadbca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:43.477199 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13274023-14b2-4892-8568-a93bbaadbca6 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:43.482653 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 22/45] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:04:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:43.486668 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da6aa4-f4f4-4b4b-840a-6aafdab59543 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:43.513760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:43.655141 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da6aa4-f4f4-4b4b-840a-6aafdab59543 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:43.713591 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39517a07-f329-4ba9-b173-aac2835f4aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:43.714710 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39517a07-f329-4ba9-b173-aac2835f4aab None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:43.715204 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39517a07-f329-4ba9-b173-aac2835f4aab None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:43.715682 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39517a07-f329-4ba9-b173-aac2835f4aab None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:43.716909 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39517a07-f329-4ba9-b173-aac2835f4aab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:43.719683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39517a07-f329-4ba9-b173-aac2835f4aab None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:43.877194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 24/46] 10.222.0.83 () {60 vars in 1141 bytes} [Fri Sep 23 01:04:43 2022] POST /identity/v3/projects => generated 312 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:04:45.789873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c1dc0-157e-4992-8ac2-f8f07de42328 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:45.790462 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c1dc0-157e-4992-8ac2-f8f07de42328 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:45.790462 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c1dc0-157e-4992-8ac2-f8f07de42328 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:45.791903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 23/47] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:04:45.798303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010eeba-2fa6-4e00-a63d-2f404e021f98 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:45.798910 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010eeba-2fa6-4e00-a63d-2f404e021f98 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:45.799078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010eeba-2fa6-4e00-a63d-2f404e021f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:45.822016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-c010eeba-2fa6-4e00-a63d-2f404e021f98 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:04:45.823394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-c010eeba-2fa6-4e00-a63d-2f404e021f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:04:45.922024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 25/48] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:04:46.215362 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cdf93-8a60-415f-ba1f-b61a9117ccb6 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:46.215708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cdf93-8a60-415f-ba1f-b61a9117ccb6 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:46.216080 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cdf93-8a60-415f-ba1f-b61a9117ccb6 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:46.217631 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 24/49] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:04:46.225109 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2a0b7-524b-481a-9475-953bb945a49a None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:46.225411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2a0b7-524b-481a-9475-953bb945a49a None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:46.225718 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2a0b7-524b-481a-9475-953bb945a49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:46.232352 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:46.245878 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-ffe2a0b7-524b-481a-9475-953bb945a49a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:04:46.246102 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cdf93-8a60-415f-ba1f-b61a9117ccb6 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:46.247410 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ffe2a0b7-524b-481a-9475-953bb945a49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:04:46.365567 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 26/50] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:04:46.484154 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cdf93-8a60-415f-ba1f-b61a9117ccb6 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:46.530570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aae2e8-4778-4976-93a4-7a1530f62035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:46.531698 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aae2e8-4778-4976-93a4-7a1530f62035 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:46.532199 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aae2e8-4778-4976-93a4-7a1530f62035 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:46.532572 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aae2e8-4778-4976-93a4-7a1530f62035 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:46.551808 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aae2e8-4778-4976-93a4-7a1530f62035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:04:46.562863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-f8aae2e8-4778-4976-93a4-7a1530f62035 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:04:46.562863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:04:46.562863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:04:46.562863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:04:46.562863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:04:46.562863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:04:46.562863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:04:46.562863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:04:46.562863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:04:46.562863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:04:46.562863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:04:46.562863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:04:46.562863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:04:46.562863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:04:46.562863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:04:46.562863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:04:46.563904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:04:46.563904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:04:46.563904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:04:46.563904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:04:46.563904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:04:46.563904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:04:46.563904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:04:46.563904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:04:46.563904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:04:46.563904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:04:46.563904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:04:46.563904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:04:46.563904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:04:46.563904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:04:46.563904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:04:46.563904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:04:46.564755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:04:46.564755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:04:46.564755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:04:46.564755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:04:46.564755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:04:46.564755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:04:46.564755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:04:46.564755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:04:46.564755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:04:46.564755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:04:46.564755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:04:46.564755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:04:46.565357 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 25/51] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:04:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:04:46.575091 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2a0b7-524b-481a-9475-953bb945a49a None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:46.676450 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aae2e8-4778-4976-93a4-7a1530f62035 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:46.697873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:46.746535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2a0b7-524b-481a-9475-953bb945a49a None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:46.782842 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:46.788878 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497e511-26fe-47c7-93c2-2d0fb4d6814e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:46.789504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497e511-26fe-47c7-93c2-2d0fb4d6814e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:46.789780 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497e511-26fe-47c7-93c2-2d0fb4d6814e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:46.790059 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497e511-26fe-47c7-93c2-2d0fb4d6814e None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:46.790771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497e511-26fe-47c7-93c2-2d0fb4d6814e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:04:46.791067 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497e511-26fe-47c7-93c2-2d0fb4d6814e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:46.792545 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497e511-26fe-47c7-93c2-2d0fb4d6814e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:46.801269 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 27/52] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:04:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:46.808342 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497e511-26fe-47c7-93c2-2d0fb4d6814e None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:46.815686 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aae2e8-4778-4976-93a4-7a1530f62035 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:46.855080 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68015ccf-a59c-4829-874b-c80c13e4db45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:46.855724 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68015ccf-a59c-4829-874b-c80c13e4db45 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:46.856001 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68015ccf-a59c-4829-874b-c80c13e4db45 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:46.856274 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68015ccf-a59c-4829-874b-c80c13e4db45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:46.857541 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68015ccf-a59c-4829-874b-c80c13e4db45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:46.859056 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68015ccf-a59c-4829-874b-c80c13e4db45 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:46.860646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 26/53] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:04:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:46.867609 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68015ccf-a59c-4829-874b-c80c13e4db45 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:46.955215 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497e511-26fe-47c7-93c2-2d0fb4d6814e None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:46.985761 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:47.007391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef002392-6750-4f7a-8fd5-2a161a3f9c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:47.008113 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef002392-6750-4f7a-8fd5-2a161a3f9c2f None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:47.008399 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef002392-6750-4f7a-8fd5-2a161a3f9c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:47.008668 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef002392-6750-4f7a-8fd5-2a161a3f9c2f None admin] PATH_INFO: `/v3/users/41222441d92243a6917a027e72480f53` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:47.009932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef002392-6750-4f7a-8fd5-2a161a3f9c2f None admin] RBAC: Authorizing `identity:get_user(user_id=41222441d92243a6917a027e72480f53)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:47.011500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef002392-6750-4f7a-8fd5-2a161a3f9c2f None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:47.013286 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 28/54] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:04:46 2022] GET /identity/v3/users/41222441d92243a6917a027e72480f53 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:04:47.019244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef002392-6750-4f7a-8fd5-2a161a3f9c2f None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:47.021731 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68015ccf-a59c-4829-874b-c80c13e4db45 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:47.075055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74969ae-9a8d-46ee-a8aa-cbc32a4e0a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:47.075799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74969ae-9a8d-46ee-a8aa-cbc32a4e0a8c None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:47.076089 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74969ae-9a8d-46ee-a8aa-cbc32a4e0a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:47.076411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74969ae-9a8d-46ee-a8aa-cbc32a4e0a8c None admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:47.077266 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74969ae-9a8d-46ee-a8aa-cbc32a4e0a8c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:47.079081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74969ae-9a8d-46ee-a8aa-cbc32a4e0a8c None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:47.107223 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:47.160302 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef002392-6750-4f7a-8fd5-2a161a3f9c2f None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:47.203168 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961956dd-5c8c-44ef-911c-1dbfcdfc35ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:47.203915 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961956dd-5c8c-44ef-911c-1dbfcdfc35ff None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:47.204176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961956dd-5c8c-44ef-911c-1dbfcdfc35ff None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:47.204445 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961956dd-5c8c-44ef-911c-1dbfcdfc35ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:47.205612 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961956dd-5c8c-44ef-911c-1dbfcdfc35ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:47.207108 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961956dd-5c8c-44ef-911c-1dbfcdfc35ff None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:47.208708 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 29/55] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:04:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:04:47.216562 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961956dd-5c8c-44ef-911c-1dbfcdfc35ff None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:47.239926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 27/56] 10.222.0.83 () {60 vars in 1140 bytes} [Fri Sep 23 01:04:46 2022] POST /identity/v3/projects => generated 298 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:04:47.469420 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961956dd-5c8c-44ef-911c-1dbfcdfc35ff None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:47.469420 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:47.469420 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f4614-d738-4c71-baa6-b434f7fd2e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:47.469420 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f4614-d738-4c71-baa6-b434f7fd2e14 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:47.470164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f4614-d738-4c71-baa6-b434f7fd2e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:47.470164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f4614-d738-4c71-baa6-b434f7fd2e14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:47.470164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f4614-d738-4c71-baa6-b434f7fd2e14 None admin] RBAC: Adding query filter params (role.id=d365054bc34046c5829cd1355f3a31ac, scope.domain.id=default, user.id=41222441d92243a6917a027e72480f53) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:04:47.470164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f4614-d738-4c71-baa6-b434f7fd2e14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:47.470164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f4614-d738-4c71-baa6-b434f7fd2e14 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:47.470164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 30/57] 10.222.0.83 () {56 vars in 1322 bytes} [Fri Sep 23 01:04:47 2022] GET /identity/v3/role_assignments?user.id=41222441d92243a6917a027e72480f53&scope.domain.id=default&role.id=d365054bc34046c5829cd1355f3a31ac => generated 530 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:04:49.543777 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa9167-5c55-4dd8-8c20-dc6c89615c43 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:49.544383 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa9167-5c55-4dd8-8c20-dc6c89615c43 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:49.544383 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa9167-5c55-4dd8-8c20-dc6c89615c43 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:49.545658 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 28/58] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:04:49.551326 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc3b0e-c1e9-487f-8566-38b312524cfd None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:49.551808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc3b0e-c1e9-487f-8566-38b312524cfd None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:49.551956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc3b0e-c1e9-487f-8566-38b312524cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:49.571001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-8cbc3b0e-c1e9-487f-8566-38b312524cfd None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:04:49.572321 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-8cbc3b0e-c1e9-487f-8566-38b312524cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:04:49.642492 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 31/59] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:04:49.921067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa9167-5c55-4dd8-8c20-dc6c89615c43 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:50.034052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa9167-5c55-4dd8-8c20-dc6c89615c43 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:50.066679 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:50.073652 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8fb47-e4b5-42f2-b938-84b723f757cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:50.074340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8fb47-e4b5-42f2-b938-84b723f757cc None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:50.074648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8fb47-e4b5-42f2-b938-84b723f757cc None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:50.074930 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8fb47-e4b5-42f2-b938-84b723f757cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:50.076102 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8fb47-e4b5-42f2-b938-84b723f757cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:50.077724 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8fb47-e4b5-42f2-b938-84b723f757cc None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:50.079782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 29/60] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:04:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:04:50.086710 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc3b0e-c1e9-487f-8566-38b312524cfd None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:50.190892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc3b0e-c1e9-487f-8566-38b312524cfd None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:50.216549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:50.227990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71602a-0177-4fef-874b-4b8060d8bf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:50.228615 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71602a-0177-4fef-874b-4b8060d8bf7c None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:50.228891 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71602a-0177-4fef-874b-4b8060d8bf7c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:50.229162 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71602a-0177-4fef-874b-4b8060d8bf7c None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:50.229833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71602a-0177-4fef-874b-4b8060d8bf7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:50.231519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71602a-0177-4fef-874b-4b8060d8bf7c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:50.395693 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 32/61] 10.222.0.83 () {60 vars in 1132 bytes} [Fri Sep 23 01:04:50 2022] POST /identity/v3/users => generated 275 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:04:54.098099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e5609-09c7-48ec-ae9f-61f972c7052a None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:54.098099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e5609-09c7-48ec-ae9f-61f972c7052a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:54.098099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e5609-09c7-48ec-ae9f-61f972c7052a None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:54.098099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 30/62] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:04:54.104286 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf01bac-4456-44a2-a7af-e1150618afa7 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:54.105302 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf01bac-4456-44a2-a7af-e1150618afa7 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:54.105823 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf01bac-4456-44a2-a7af-e1150618afa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:54.130448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-5cf01bac-4456-44a2-a7af-e1150618afa7 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:04:54.132629 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-5cf01bac-4456-44a2-a7af-e1150618afa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:04:54.237240 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 33/63] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:04:54.320002 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7d376-7c95-43e7-b67b-b8dc4addae9b None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:54.320902 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7d376-7c95-43e7-b67b-b8dc4addae9b None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:54.321395 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7d376-7c95-43e7-b67b-b8dc4addae9b None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:54.323063 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 31/64] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:04:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:04:54.328817 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8cb3e-6cd1-4ed3-b487-fd25050d98fd None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:54.329397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8cb3e-6cd1-4ed3-b487-fd25050d98fd None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:54.329874 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8cb3e-6cd1-4ed3-b487-fd25050d98fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:54.356207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-f3c8cb3e-6cd1-4ed3-b487-fd25050d98fd None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:04:54.357846 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f3c8cb3e-6cd1-4ed3-b487-fd25050d98fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:04:54.466663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 34/65] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:04:54.550817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7d376-7c95-43e7-b67b-b8dc4addae9b None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:54.564364 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee3b15-ca55-4b6c-b07b-c323d69e07fa None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:54.565035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee3b15-ca55-4b6c-b07b-c323d69e07fa None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:54.565512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee3b15-ca55-4b6c-b07b-c323d69e07fa None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:54.567146 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 35/66] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:04:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:04:54.573808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b126ac-bba9-47d9-bcd2-9bf27b284ea0 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:54.574497 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b126ac-bba9-47d9-bcd2-9bf27b284ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:54.575030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b126ac-bba9-47d9-bcd2-9bf27b284ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:54.611387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-57b126ac-bba9-47d9-bcd2-9bf27b284ea0 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:04:54.612938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-57b126ac-bba9-47d9-bcd2-9bf27b284ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:04:54.689940 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:54.759503 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 36/67] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:04:54.761545 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3203a8-0174-4778-9afb-a70a2299906f None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:54.762072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3203a8-0174-4778-9afb-a70a2299906f None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:54.762653 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3203a8-0174-4778-9afb-a70a2299906f None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:54.764200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 37/68] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:04:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:04:54.767321 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7d376-7c95-43e7-b67b-b8dc4addae9b None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:54.770848 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a29ac4-3aca-4203-8bc4-d47c7ee4a25f None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:54.771409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a29ac4-3aca-4203-8bc4-d47c7ee4a25f None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:54.771891 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a29ac4-3aca-4203-8bc4-d47c7ee4a25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:54.793490 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-f8a29ac4-3aca-4203-8bc4-d47c7ee4a25f None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:04:54.795109 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f8a29ac4-3aca-4203-8bc4-d47c7ee4a25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:04:54.814794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9999e6-2ad7-4f99-a559-df84e3737878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:54.816328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9999e6-2ad7-4f99-a559-df84e3737878 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:54.816859 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9999e6-2ad7-4f99-a559-df84e3737878 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:54.817574 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9999e6-2ad7-4f99-a559-df84e3737878 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:54.832840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9999e6-2ad7-4f99-a559-df84e3737878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:04:54.840153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-7c9999e6-2ad7-4f99-a559-df84e3737878 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:04:54.840153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:04:54.840153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:04:54.840153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:04:54.840153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:04:54.840153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:04:54.840153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:04:54.840153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:04:54.840153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:04:54.840153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:04:54.840153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:04:54.840153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:04:54.840153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:04:54.840153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:04:54.840153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:04:54.840153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:04:54.841172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:04:54.841172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:04:54.841172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:04:54.841172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:04:54.841172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:04:54.841172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:04:54.841172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:04:54.841172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:04:54.841172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:04:54.841172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:04:54.841172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:04:54.841172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:04:54.841172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:04:54.841172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:04:54.841172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:04:54.841172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:04:54.842163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:04:54.842163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:04:54.842163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:04:54.842163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:04:54.842163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:04:54.842163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:04:54.842163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:04:54.842163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:04:54.842163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:04:54.842163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:04:54.842163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:04:54.842163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:04:54.845103 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 32/69] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:04:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:04:54.846169 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9999e6-2ad7-4f99-a559-df84e3737878 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:54.898783 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 38/70] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:04:54.900477 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a29ac4-3aca-4203-8bc4-d47c7ee4a25f None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:54.927016 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:54.980641 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9999e6-2ad7-4f99-a559-df84e3737878 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:55.027274 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b533be-c322-44dd-b61e-61a3f1eb9816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:55.029448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b533be-c322-44dd-b61e-61a3f1eb9816 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:55.030228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b533be-c322-44dd-b61e-61a3f1eb9816 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:55.030972 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b533be-c322-44dd-b61e-61a3f1eb9816 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:55.049406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b533be-c322-44dd-b61e-61a3f1eb9816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:04:55.059294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-83b533be-c322-44dd-b61e-61a3f1eb9816 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:04:55.059294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:04:55.059294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:04:55.059294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:04:55.059294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:04:55.059294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:04:55.059294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:04:55.059294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:04:55.059294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:04:55.059294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:04:55.059294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:04:55.059294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:04:55.059294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:04:55.059294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:04:55.059294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:04:55.059294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:04:55.060185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:04:55.060185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:04:55.060185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:04:55.060185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:04:55.060185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:04:55.060185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:04:55.060185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:04:55.060185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:04:55.060185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:04:55.060185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:04:55.060185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:04:55.060185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:04:55.060185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:04:55.060185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:04:55.060185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:04:55.060185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:04:55.060980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:04:55.060980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:04:55.060980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:04:55.060980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:04:55.060980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:04:55.060980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:04:55.060980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:04:55.060980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:04:55.060980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:04:55.060980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:04:55.060980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:04:55.060980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:04:55.065856 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 33/71] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:04:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:04:55.074625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b533be-c322-44dd-b61e-61a3f1eb9816 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:55.101390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:55.106296 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a29ac4-3aca-4203-8bc4-d47c7ee4a25f None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:55.167261 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4064a8-b5c5-4330-87d7-4ae9518c374b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:55.168127 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4064a8-b5c5-4330-87d7-4ae9518c374b None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:55.168513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4064a8-b5c5-4330-87d7-4ae9518c374b None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:55.168888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4064a8-b5c5-4330-87d7-4ae9518c374b None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:55.169700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4064a8-b5c5-4330-87d7-4ae9518c374b None admin] RBAC: Adding query filter params (name=member) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:04:55.170129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4064a8-b5c5-4330-87d7-4ae9518c374b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:55.171915 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4064a8-b5c5-4330-87d7-4ae9518c374b None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:55.183361 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 39/72] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:04:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:55.184423 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4064a8-b5c5-4330-87d7-4ae9518c374b None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:55.243162 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b533be-c322-44dd-b61e-61a3f1eb9816 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:55.265921 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:55.288736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ac985-9166-492c-a1f1-2e350b3d4068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:55.289421 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ac985-9166-492c-a1f1-2e350b3d4068 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:55.289698 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ac985-9166-492c-a1f1-2e350b3d4068 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:55.289971 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ac985-9166-492c-a1f1-2e350b3d4068 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:55.306464 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ac985-9166-492c-a1f1-2e350b3d4068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:04:55.312365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-685ac985-9166-492c-a1f1-2e350b3d4068 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:04:55.312365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:04:55.312365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:04:55.312365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:04:55.312365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:04:55.312365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:04:55.312365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:04:55.312365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:04:55.312365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:04:55.312365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:04:55.312365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:04:55.312365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:04:55.312365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:04:55.312365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:04:55.312365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:04:55.312365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:04:55.313531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:04:55.313531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:04:55.313531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:04:55.313531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:04:55.313531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:04:55.313531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:04:55.313531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:04:55.313531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:04:55.313531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:04:55.313531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:04:55.313531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:04:55.313531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:04:55.313531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:04:55.313531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:04:55.313531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:04:55.313531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:04:55.314442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:04:55.314442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:04:55.314442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:04:55.314442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:04:55.314442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:04:55.314442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:04:55.314442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:04:55.314442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:04:55.314442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:04:55.314442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:04:55.314442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:04:55.314442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:04:55.315850 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 34/73] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:04:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:04:55.317193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ac985-9166-492c-a1f1-2e350b3d4068 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:55.339153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4064a8-b5c5-4330-87d7-4ae9518c374b None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:55.381618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470450a-1742-4543-9f49-536608166612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:55.382421 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470450a-1742-4543-9f49-536608166612 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:55.382734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470450a-1742-4543-9f49-536608166612 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:55.383005 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470450a-1742-4543-9f49-536608166612 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:55.383685 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470450a-1742-4543-9f49-536608166612 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:04:55.383988 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470450a-1742-4543-9f49-536608166612 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:55.385388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470450a-1742-4543-9f49-536608166612 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:55.398052 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 40/74] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:04:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:55.399368 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489a2a6-4c31-40c5-b6a0-a567c731ac33 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:55.399670 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489a2a6-4c31-40c5-b6a0-a567c731ac33 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:55.399928 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489a2a6-4c31-40c5-b6a0-a567c731ac33 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:55.401198 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 41/75] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:04:55.403292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489a2a6-4c31-40c5-b6a0-a567c731ac33 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:55.433845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:55.484920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ac985-9166-492c-a1f1-2e350b3d4068 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:55.539945 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdbeac-e011-49b8-8d3b-a9036aeac848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:55.540653 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdbeac-e011-49b8-8d3b-a9036aeac848 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:55.541002 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdbeac-e011-49b8-8d3b-a9036aeac848 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:55.541232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdbeac-e011-49b8-8d3b-a9036aeac848 None admin] PATH_INFO: `/v3/users/713912ac902347b893e9f394818adf52` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:55.558062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489a2a6-4c31-40c5-b6a0-a567c731ac33 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:55.561042 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdbeac-e011-49b8-8d3b-a9036aeac848 None admin] RBAC: Authorizing `identity:get_user(user_id=713912ac902347b893e9f394818adf52)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:55.562723 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdbeac-e011-49b8-8d3b-a9036aeac848 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:55.564673 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 35/76] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:04:55 2022] GET /identity/v3/users/713912ac902347b893e9f394818adf52 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:55.565469 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdbeac-e011-49b8-8d3b-a9036aeac848 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:55.608897 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:55.616858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88f140-38e7-4868-ac93-9738cf23cd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:55.617961 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88f140-38e7-4868-ac93-9738cf23cd8a None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:55.622767 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88f140-38e7-4868-ac93-9738cf23cd8a None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:55.622767 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88f140-38e7-4868-ac93-9738cf23cd8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:55.639355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88f140-38e7-4868-ac93-9738cf23cd8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:04:55.649062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-9a88f140-38e7-4868-ac93-9738cf23cd8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:04:55.649062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:04:55.649062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:04:55.649062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:04:55.649062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:04:55.649062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:04:55.649062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:04:55.649062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:04:55.649062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:04:55.649062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:04:55.649062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:04:55.649062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:04:55.649062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:04:55.649062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:04:55.649062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:04:55.649062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:04:55.650038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:04:55.650038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:04:55.650038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:04:55.650038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:04:55.650038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:04:55.650038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:04:55.650038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:04:55.650038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:04:55.650038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:04:55.650038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:04:55.650038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:04:55.650038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:04:55.650038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:04:55.650038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:04:55.650038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:04:55.650038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:04:55.651351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:04:55.651351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:04:55.651351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:04:55.651351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:04:55.651351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:04:55.651351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:04:55.651351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:04:55.651351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:04:55.651351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:04:55.651351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:04:55.651351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:04:55.651351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:04:55.651351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 42/77] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:04:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:04:55.652698 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88f140-38e7-4868-ac93-9738cf23cd8a None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:55.701350 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdbeac-e011-49b8-8d3b-a9036aeac848 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:55.756282 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e39ea4-0b41-4143-996d-4ce4a680e649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:55.757640 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e39ea4-0b41-4143-996d-4ce4a680e649 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:55.758043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e39ea4-0b41-4143-996d-4ce4a680e649 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:55.758447 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e39ea4-0b41-4143-996d-4ce4a680e649 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:55.759313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e39ea4-0b41-4143-996d-4ce4a680e649 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:04:55.759741 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e39ea4-0b41-4143-996d-4ce4a680e649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:55.761441 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e39ea4-0b41-4143-996d-4ce4a680e649 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:55.775905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 36/78] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:04:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:55.777320 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f656365-cc9d-4a4f-913b-744468524a99 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:55.777835 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f656365-cc9d-4a4f-913b-744468524a99 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:55.778025 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f656365-cc9d-4a4f-913b-744468524a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:55.794501 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:55.799465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-7f656365-cc9d-4a4f-913b-744468524a99 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:04:55.801076 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-7f656365-cc9d-4a4f-913b-744468524a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:04:55.815052 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88f140-38e7-4868-ac93-9738cf23cd8a None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:55.858457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb060d6-b57e-4119-a9d4-0eb6344443d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:55.859376 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb060d6-b57e-4119-a9d4-0eb6344443d3 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:55.859826 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb060d6-b57e-4119-a9d4-0eb6344443d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:55.860051 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb060d6-b57e-4119-a9d4-0eb6344443d3 None admin] PATH_INFO: `/v3/users/713912ac902347b893e9f394818adf52` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:55.861448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb060d6-b57e-4119-a9d4-0eb6344443d3 None admin] RBAC: Authorizing `identity:get_user(user_id=713912ac902347b893e9f394818adf52)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:55.863340 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb060d6-b57e-4119-a9d4-0eb6344443d3 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:55.865039 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 43/79] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:04:55 2022] GET /identity/v3/users/713912ac902347b893e9f394818adf52 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:55.873381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb060d6-b57e-4119-a9d4-0eb6344443d3 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:55.912540 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 37/80] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:04:55.921348 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f656365-cc9d-4a4f-913b-744468524a99 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:55.952847 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:56.026845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb060d6-b57e-4119-a9d4-0eb6344443d3 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:56.072526 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cabdc-b417-4d27-bbc3-35972d6bbf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:56.073160 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cabdc-b417-4d27-bbc3-35972d6bbf42 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:56.073602 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cabdc-b417-4d27-bbc3-35972d6bbf42 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:56.073956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cabdc-b417-4d27-bbc3-35972d6bbf42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:56.094794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f656365-cc9d-4a4f-913b-744468524a99 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:56.103241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:56.160662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc4815-2370-48bc-8afc-162422829b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:56.161552 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc4815-2370-48bc-8afc-162422829b7f None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:56.162040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc4815-2370-48bc-8afc-162422829b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:56.162512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc4815-2370-48bc-8afc-162422829b7f None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:56.163858 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc4815-2370-48bc-8afc-162422829b7f None admin] RBAC: Adding query filter params (name=member) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:04:56.164381 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc4815-2370-48bc-8afc-162422829b7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:56.166799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc4815-2370-48bc-8afc-162422829b7f None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:56.181726 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 38/81] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:04:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:56.183152 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc4815-2370-48bc-8afc-162422829b7f None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:56.207790 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cabdc-b417-4d27-bbc3-35972d6bbf42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:56.210959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cabdc-b417-4d27-bbc3-35972d6bbf42 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:56.326099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:56.342536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc4815-2370-48bc-8afc-162422829b7f None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:56.372223 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 44/82] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:04:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:04:56.375165 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cabdc-b417-4d27-bbc3-35972d6bbf42 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:56.403834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67532f0d-9560-493e-9ef0-3a047029859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:56.404869 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67532f0d-9560-493e-9ef0-3a047029859b None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:56.405419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67532f0d-9560-493e-9ef0-3a047029859b None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:56.405794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67532f0d-9560-493e-9ef0-3a047029859b None admin] PATH_INFO: `/v3/users/41222441d92243a6917a027e72480f53` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:56.407824 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67532f0d-9560-493e-9ef0-3a047029859b None admin] RBAC: Authorizing `identity:get_user(user_id=41222441d92243a6917a027e72480f53)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:56.410403 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67532f0d-9560-493e-9ef0-3a047029859b None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:56.413885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 39/83] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:04:56 2022] GET /identity/v3/users/41222441d92243a6917a027e72480f53 => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:56.415269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67532f0d-9560-493e-9ef0-3a047029859b None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:56.470691 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:56.533379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cabdc-b417-4d27-bbc3-35972d6bbf42 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:56.569578 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67532f0d-9560-493e-9ef0-3a047029859b None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:56.573640 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98590c1-410c-4c43-ba58-47b58aa4512b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:56.574619 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98590c1-410c-4c43-ba58-47b58aa4512b None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:56.575051 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98590c1-410c-4c43-ba58-47b58aa4512b None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:56.575393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98590c1-410c-4c43-ba58-47b58aa4512b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:56.620444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daaaad-6f9b-42d4-b0d1-5e290ed5b023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:56.621177 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daaaad-6f9b-42d4-b0d1-5e290ed5b023 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:56.621522 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daaaad-6f9b-42d4-b0d1-5e290ed5b023 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:56.621861 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daaaad-6f9b-42d4-b0d1-5e290ed5b023 None admin] PATH_INFO: `/v3/users/713912ac902347b893e9f394818adf52` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:56.623432 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7daaaad-6f9b-42d4-b0d1-5e290ed5b023 None admin] RBAC: Authorizing `identity:get_user(user_id=713912ac902347b893e9f394818adf52)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:56.625007 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7daaaad-6f9b-42d4-b0d1-5e290ed5b023 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:56.626801 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 40/84] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:04:56 2022] GET /identity/v3/users/713912ac902347b893e9f394818adf52 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:56.629269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daaaad-6f9b-42d4-b0d1-5e290ed5b023 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:56.660126 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98590c1-410c-4c43-ba58-47b58aa4512b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:56.662173 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98590c1-410c-4c43-ba58-47b58aa4512b None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:56.665227 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:56.737843 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:56.782278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daaaad-6f9b-42d4-b0d1-5e290ed5b023 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:56.799270 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 45/85] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:04:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:04:56.800373 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98590c1-410c-4c43-ba58-47b58aa4512b None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:56.840978 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe3526-78b7-4f03-a081-9b2ef26e7da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:56.841975 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe3526-78b7-4f03-a081-9b2ef26e7da3 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:56.842427 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe3526-78b7-4f03-a081-9b2ef26e7da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:56.842817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe3526-78b7-4f03-a081-9b2ef26e7da3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:56.844108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe3526-78b7-4f03-a081-9b2ef26e7da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:56.845670 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe3526-78b7-4f03-a081-9b2ef26e7da3 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:56.847428 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 41/86] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:04:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:56.851449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe3526-78b7-4f03-a081-9b2ef26e7da3 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:56.934527 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98590c1-410c-4c43-ba58-47b58aa4512b None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:56.988054 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:56.990663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a59258-ab96-4569-a14b-03b3d878a7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:56.992444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a59258-ab96-4569-a14b-03b3d878a7ab None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:56.992787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a59258-ab96-4569-a14b-03b3d878a7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:56.993129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a59258-ab96-4569-a14b-03b3d878a7ab None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:56.994537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a59258-ab96-4569-a14b-03b3d878a7ab None admin] RBAC: Authorizing `identity:get_project(project_id=612f86bc1b6c4d8ab8393c2393a01341)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:56.996571 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a59258-ab96-4569-a14b-03b3d878a7ab None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:56.997064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe3526-78b7-4f03-a081-9b2ef26e7da3 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:56.998780 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 46/87] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:04:56 2022] GET /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:56.998780 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a59258-ab96-4569-a14b-03b3d878a7ab None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:57.028636 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:57.063965 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac5089-b591-4547-bd43-8a37f119d178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:57.065022 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac5089-b591-4547-bd43-8a37f119d178 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:57.065480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac5089-b591-4547-bd43-8a37f119d178 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:57.065954 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac5089-b591-4547-bd43-8a37f119d178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:57.138536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a59258-ab96-4569-a14b-03b3d878a7ab None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:57.164931 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac5089-b591-4547-bd43-8a37f119d178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:57.166563 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac5089-b591-4547-bd43-8a37f119d178 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:57.191221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178dfe4-4db2-4f83-96ba-141c10c96fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:57.192196 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178dfe4-4db2-4f83-96ba-141c10c96fde None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:57.192691 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178dfe4-4db2-4f83-96ba-141c10c96fde None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:57.193175 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178dfe4-4db2-4f83-96ba-141c10c96fde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:57.311334 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178dfe4-4db2-4f83-96ba-141c10c96fde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:57.320332 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:57.320809 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178dfe4-4db2-4f83-96ba-141c10c96fde None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:57.332824 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 42/88] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:04:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:04:57.334916 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac5089-b591-4547-bd43-8a37f119d178 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:57.349853 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:57.481598 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 47/89] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:04:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:04:57.481830 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac5089-b591-4547-bd43-8a37f119d178 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:57.482669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178dfe4-4db2-4f83-96ba-141c10c96fde None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:57.545333 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60697c-3a19-45b1-ab27-78ea5f2aa4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:57.546160 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60697c-3a19-45b1-ab27-78ea5f2aa4de None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:57.546550 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60697c-3a19-45b1-ab27-78ea5f2aa4de None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:57.546973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60697c-3a19-45b1-ab27-78ea5f2aa4de None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:57.548343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60697c-3a19-45b1-ab27-78ea5f2aa4de None admin] RBAC: Authorizing `identity:get_project(project_id=612f86bc1b6c4d8ab8393c2393a01341)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:57.549954 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60697c-3a19-45b1-ab27-78ea5f2aa4de None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:57.551694 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 43/90] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:04:57 2022] GET /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:57.552851 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60697c-3a19-45b1-ab27-78ea5f2aa4de None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:57.627770 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178dfe4-4db2-4f83-96ba-141c10c96fde None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:57.639199 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:57.656351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:57.671677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46edee-f07e-4486-8774-c98795152860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:57.672615 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46edee-f07e-4486-8774-c98795152860 None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:57.672901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46edee-f07e-4486-8774-c98795152860 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:57.673180 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46edee-f07e-4486-8774-c98795152860 None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:57.673959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46edee-f07e-4486-8774-c98795152860 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:57.675607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46edee-f07e-4486-8774-c98795152860 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:57.693066 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60697c-3a19-45b1-ab27-78ea5f2aa4de None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:57.735976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687232c7-fd5b-4d03-89d7-b69e1863d609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:57.736634 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687232c7-fd5b-4d03-89d7-b69e1863d609 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:57.737001 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687232c7-fd5b-4d03-89d7-b69e1863d609 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:57.737371 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687232c7-fd5b-4d03-89d7-b69e1863d609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:57.738229 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687232c7-fd5b-4d03-89d7-b69e1863d609 None admin] RBAC: Adding query filter params (role.id=986891361f4f4893a1cb2d0e0b523bff, scope.project.id=612f86bc1b6c4d8ab8393c2393a01341, user.id=713912ac902347b893e9f394818adf52) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:04:57.738663 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687232c7-fd5b-4d03-89d7-b69e1863d609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:57.740347 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687232c7-fd5b-4d03-89d7-b69e1863d609 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:57.749020 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 44/91] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:04:57 2022] GET /identity/v3/role_assignments?user.id=713912ac902347b893e9f394818adf52&scope.project.id=612f86bc1b6c4d8ab8393c2393a01341&role.id=986891361f4f4893a1cb2d0e0b523bff => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:57.753486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687232c7-fd5b-4d03-89d7-b69e1863d609 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:57.792100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 48/92] 10.222.0.83 () {60 vars in 1132 bytes} [Fri Sep 23 01:04:57 2022] POST /identity/v3/users => generated 289 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:04:57.793825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46edee-f07e-4486-8774-c98795152860 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:57.961687 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687232c7-fd5b-4d03-89d7-b69e1863d609 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:58.001825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46edee-f07e-4486-8774-c98795152860 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:58.009356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:58.040179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21021e4b-76f2-4054-b2ab-a6bb4ce94de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:58.041228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21021e4b-76f2-4054-b2ab-a6bb4ce94de3 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:58.041706 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21021e4b-76f2-4054-b2ab-a6bb4ce94de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:58.042265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21021e4b-76f2-4054-b2ab-a6bb4ce94de3 None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:58.045787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21021e4b-76f2-4054-b2ab-a6bb4ce94de3 None admin] RBAC: Authorizing `identity:get_project(project_id=612f86bc1b6c4d8ab8393c2393a01341)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:58.048962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21021e4b-76f2-4054-b2ab-a6bb4ce94de3 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:58.052414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 45/93] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:04:57 2022] GET /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341 => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:58.053899 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21021e4b-76f2-4054-b2ab-a6bb4ce94de3 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:58.073199 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9f45f-9f6e-445b-8346-9ce63a9f2003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:58.075273 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9f45f-9f6e-445b-8346-9ce63a9f2003 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:58.075715 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9f45f-9f6e-445b-8346-9ce63a9f2003 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:58.076158 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9f45f-9f6e-445b-8346-9ce63a9f2003 None admin] PATH_INFO: `/v3/projects/27f784c700f043b4b38ba51d84245655` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:58.077657 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9f45f-9f6e-445b-8346-9ce63a9f2003 None admin] RBAC: Authorizing `identity:get_project(project_id=27f784c700f043b4b38ba51d84245655)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:58.082785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9f45f-9f6e-445b-8346-9ce63a9f2003 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:58.085394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 49/94] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:04:57 2022] GET /identity/v3/projects/27f784c700f043b4b38ba51d84245655 => generated 312 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:58.086673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9f45f-9f6e-445b-8346-9ce63a9f2003 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:58.179127 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:58.218899 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21021e4b-76f2-4054-b2ab-a6bb4ce94de3 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:58.286579 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403b775-b2f0-478e-9313-a264209d7f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:58.287589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b775-b2f0-478e-9313-a264209d7f54 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:58.288099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b775-b2f0-478e-9313-a264209d7f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:58.288572 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b775-b2f0-478e-9313-a264209d7f54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:58.289887 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403b775-b2f0-478e-9313-a264209d7f54 None admin] RBAC: Adding query filter params (role.id=a9e6249ed8cd44ce9fac74a4c8155978, scope.project.id=612f86bc1b6c4d8ab8393c2393a01341, user.id=713912ac902347b893e9f394818adf52) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:04:58.290413 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403b775-b2f0-478e-9313-a264209d7f54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:58.293285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403b775-b2f0-478e-9313-a264209d7f54 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:58.300329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9f45f-9f6e-445b-8346-9ce63a9f2003 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:58.304605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 46/95] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:04:58 2022] GET /identity/v3/role_assignments?user.id=713912ac902347b893e9f394818adf52&scope.project.id=612f86bc1b6c4d8ab8393c2393a01341&role.id=a9e6249ed8cd44ce9fac74a4c8155978 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:58.306516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403b775-b2f0-478e-9313-a264209d7f54 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:04:58.368935 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38351f-434c-4b59-b361-6d1de578c415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:58.369848 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38351f-434c-4b59-b361-6d1de578c415 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:58.370133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38351f-434c-4b59-b361-6d1de578c415 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:58.370415 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38351f-434c-4b59-b361-6d1de578c415 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:58.371230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38351f-434c-4b59-b361-6d1de578c415 None admin] RBAC: Adding query filter params (role.id=d365054bc34046c5829cd1355f3a31ac, scope.project.id=612f86bc1b6c4d8ab8393c2393a01341, user.id=41222441d92243a6917a027e72480f53) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:04:58.371544 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38351f-434c-4b59-b361-6d1de578c415 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:58.373094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38351f-434c-4b59-b361-6d1de578c415 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:58.383895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 50/96] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:04:58 2022] GET /identity/v3/role_assignments?user.id=41222441d92243a6917a027e72480f53&scope.project.id=612f86bc1b6c4d8ab8393c2393a01341&role.id=d365054bc34046c5829cd1355f3a31ac => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:04:58.442736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:04:58.530929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403b775-b2f0-478e-9313-a264209d7f54 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:04:58.604966 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85b834-fbc6-494d-af12-ad93b27491aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:04:58.605921 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85b834-fbc6-494d-af12-ad93b27491aa None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:04:58.606393 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85b834-fbc6-494d-af12-ad93b27491aa None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:04:58.606884 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85b834-fbc6-494d-af12-ad93b27491aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:04:58.608225 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85b834-fbc6-494d-af12-ad93b27491aa None admin] RBAC: Adding query filter params (role.id=986891361f4f4893a1cb2d0e0b523bff, scope.project.id=27f784c700f043b4b38ba51d84245655, user.id=713912ac902347b893e9f394818adf52) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:04:58.608753 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85b834-fbc6-494d-af12-ad93b27491aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:04:58.611467 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85b834-fbc6-494d-af12-ad93b27491aa None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:04:58.622425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 47/97] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:04:58 2022] GET /identity/v3/role_assignments?user.id=713912ac902347b893e9f394818adf52&scope.project.id=27f784c700f043b4b38ba51d84245655&role.id=986891361f4f4893a1cb2d0e0b523bff => generated 259 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:01.770028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b7213-4ae0-4c5a-ae3a-9b100a2e5c5f None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:01.770852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b7213-4ae0-4c5a-ae3a-9b100a2e5c5f None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:01.770852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b7213-4ae0-4c5a-ae3a-9b100a2e5c5f None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:01.773599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 51/98] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:01.779749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ceef6-2148-40b1-9bc9-3c7e952593aa None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:01.780568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ceef6-2148-40b1-9bc9-3c7e952593aa None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:01.780568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ceef6-2148-40b1-9bc9-3c7e952593aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:01.811999 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-735ceef6-2148-40b1-9bc9-3c7e952593aa None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:01.813671 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-735ceef6-2148-40b1-9bc9-3c7e952593aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:01.952409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 48/99] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:05:02.635301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bad8b-f109-4554-adcf-6c58c64ed8b4 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:02.635783 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bad8b-f109-4554-adcf-6c58c64ed8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:02.635954 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bad8b-f109-4554-adcf-6c58c64ed8b4 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:02.637763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 52/100] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:05:02.646959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa5db1-3210-4516-8679-fedea0c5ad84 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:02.647842 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa5db1-3210-4516-8679-fedea0c5ad84 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:02.648083 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa5db1-3210-4516-8679-fedea0c5ad84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:02.679642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-dbaa5db1-3210-4516-8679-fedea0c5ad84 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:02.680977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-dbaa5db1-3210-4516-8679-fedea0c5ad84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:02.734292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bad8b-f109-4554-adcf-6c58c64ed8b4 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:02.782475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:02.831035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 49/101] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:03.046220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fd31c-4007-4aab-9e54-0c55918ff44d None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:03.046964 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fd31c-4007-4aab-9e54-0c55918ff44d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:03.047205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bad8b-f109-4554-adcf-6c58c64ed8b4 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:03.048530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fd31c-4007-4aab-9e54-0c55918ff44d None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:03.056072 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 50/102] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:03 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:03.063208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:03.064618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66edc13-7cb7-47f4-8c02-44e1c9112d76 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:03.068757 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66edc13-7cb7-47f4-8c02-44e1c9112d76 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:03.068757 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66edc13-7cb7-47f4-8c02-44e1c9112d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:03.116977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-e66edc13-7cb7-47f4-8c02-44e1c9112d76 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:03.118228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e66edc13-7cb7-47f4-8c02-44e1c9112d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:03.125145 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697b874-d92c-42ab-9365-1aba56872e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:03.126430 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697b874-d92c-42ab-9365-1aba56872e17 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:03.126822 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697b874-d92c-42ab-9365-1aba56872e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:03.127101 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697b874-d92c-42ab-9365-1aba56872e17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:03.153372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697b874-d92c-42ab-9365-1aba56872e17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:03.160517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-2697b874-d92c-42ab-9365-1aba56872e17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:03.160517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:03.160517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:03.160517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:03.160517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:03.160517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:03.160517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:03.160517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:03.160517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:03.160517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:03.160517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:03.160517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:03.160517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:03.160517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:03.160517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:03.160517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:03.162088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:03.162088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:03.162088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:03.162088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:03.162088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:03.162088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:03.162088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:03.162088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:03.162088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:03.162088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:03.162088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:03.162088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:03.162088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:03.162088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:03.162088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:03.162088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:03.164222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:03.164222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:03.164222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:03.164222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:03.164222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:03.164222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:03.164222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:03.164222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:03.164222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:03.164222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:03.164222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:03.164222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:03.167140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 53/103] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:03.172797 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697b874-d92c-42ab-9365-1aba56872e17 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:03.337535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 51/104] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:03.339932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e331521-b962-4f11-b722-7fa2ad27c071 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:03.340430 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e331521-b962-4f11-b722-7fa2ad27c071 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:03.340917 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e331521-b962-4f11-b722-7fa2ad27c071 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:03.343562 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 52/105] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:03.345819 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db589914-61a4-4f9c-8d0c-c3fb5d4f36ea None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:03.346322 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db589914-61a4-4f9c-8d0c-c3fb5d4f36ea None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:03.346904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db589914-61a4-4f9c-8d0c-c3fb5d4f36ea None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:03.349412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 53/106] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:03.360583 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc8743-7d28-4895-ace7-37b0de18b3d2 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:03.361061 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc8743-7d28-4895-ace7-37b0de18b3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:03.361549 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc8743-7d28-4895-ace7-37b0de18b3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:03.394309 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-58cc8743-7d28-4895-ace7-37b0de18b3d2 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:03.396337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-58cc8743-7d28-4895-ace7-37b0de18b3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:03.442426 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697b874-d92c-42ab-9365-1aba56872e17 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:03.522927 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080827b1-2d90-4240-9f77-0bdadcf43243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:03.524494 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080827b1-2d90-4240-9f77-0bdadcf43243 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:03.525209 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080827b1-2d90-4240-9f77-0bdadcf43243 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:03.525940 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080827b1-2d90-4240-9f77-0bdadcf43243 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:03.527412 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080827b1-2d90-4240-9f77-0bdadcf43243 None admin] RBAC: Adding query filter params (name=member) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:03.528185 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080827b1-2d90-4240-9f77-0bdadcf43243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:03.530525 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080827b1-2d90-4240-9f77-0bdadcf43243 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:03.532150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 54/107] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:03.535209 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3e996-99e9-4803-8678-62970bb76aeb None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:03.535209 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3e996-99e9-4803-8678-62970bb76aeb None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:03.535415 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3e996-99e9-4803-8678-62970bb76aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:03.543719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 54/108] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:03.545434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369cddf-3be3-4ee8-abe7-ddfb14f9b1a5 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:03.545945 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369cddf-3be3-4ee8-abe7-ddfb14f9b1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:03.546434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369cddf-3be3-4ee8-abe7-ddfb14f9b1a5 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:03.548072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 55/109] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:03.549142 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369cddf-3be3-4ee8-abe7-ddfb14f9b1a5 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:03.569309 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-91d3e996-99e9-4803-8678-62970bb76aeb None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:03.572479 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-91d3e996-99e9-4803-8678-62970bb76aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:03.601853 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:03.660290 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:03.700485 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 55/110] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:03.701990 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3e996-99e9-4803-8678-62970bb76aeb None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:03.722259 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369cddf-3be3-4ee8-abe7-ddfb14f9b1a5 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:03.768679 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f962721-d990-42cf-b61e-bcc2ea4a3bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:03.769722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f962721-d990-42cf-b61e-bcc2ea4a3bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:03.770130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f962721-d990-42cf-b61e-bcc2ea4a3bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:03.770536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f962721-d990-42cf-b61e-bcc2ea4a3bc6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:03.799576 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f962721-d990-42cf-b61e-bcc2ea4a3bc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:03.818651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-0f962721-d990-42cf-b61e-bcc2ea4a3bc6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 01:05:03.818651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:03.818651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:03.818651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:03.818651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:03.818651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:03.818651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:03.818651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:03.818651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:03.818651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:03.818651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:03.818651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:03.818651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:03.818651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:03.818651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:03.818651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:03.820706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:03.820706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:03.820706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:03.820706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:03.820706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:03.820706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:03.820706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:03.820706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:03.820706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:03.820706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:03.820706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:03.820706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:03.820706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:03.820706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:03.820706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:03.820706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:03.821513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:03.821513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:03.821513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:03.821513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:03.821513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:03.821513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:03.821513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:03.821513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:03.821513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:03.821513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:03.821513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 01:05:03.821513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:03.821513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 56/111] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:03.822771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcac1eb-ada9-4b3a-8656-b0f66226950e None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:03.823254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcac1eb-ada9-4b3a-8656-b0f66226950e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:03.823742 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcac1eb-ada9-4b3a-8656-b0f66226950e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:03.871704 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-bbcac1eb-ada9-4b3a-8656-b0f66226950e None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:03.873719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-bbcac1eb-ada9-4b3a-8656-b0f66226950e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:03.931209 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3e996-99e9-4803-8678-62970bb76aeb None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:03.979008 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cb050-f221-483a-85b2-c676ba34d2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:03.979600 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cb050-f221-483a-85b2-c676ba34d2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:03.979921 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cb050-f221-483a-85b2-c676ba34d2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:03.980479 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cb050-f221-483a-85b2-c676ba34d2d8 None admin] PATH_INFO: `/v3/users/713912ac902347b893e9f394818adf52` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:03.981762 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cb050-f221-483a-85b2-c676ba34d2d8 None admin] RBAC: Authorizing `identity:get_user(user_id=713912ac902347b893e9f394818adf52)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:03.983292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cb050-f221-483a-85b2-c676ba34d2d8 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:03.989674 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 56/112] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:03 2022] GET /identity/v3/users/713912ac902347b893e9f394818adf52 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:03.989674 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cb050-f221-483a-85b2-c676ba34d2d8 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:04.043628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 57/113] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:04.043628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcac1eb-ada9-4b3a-8656-b0f66226950e None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:04.047867 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:04.088830 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:04.161674 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cb050-f221-483a-85b2-c676ba34d2d8 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:04.217149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab656f85-21d3-4139-a83f-186d753ce5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:04.218119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab656f85-21d3-4139-a83f-186d753ce5ce None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:04.218614 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab656f85-21d3-4139-a83f-186d753ce5ce None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:04.219152 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab656f85-21d3-4139-a83f-186d753ce5ce None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:04.220094 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab656f85-21d3-4139-a83f-186d753ce5ce None admin] RBAC: Adding query filter params (name=reader) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:04.220735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab656f85-21d3-4139-a83f-186d753ce5ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:04.223146 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab656f85-21d3-4139-a83f-186d753ce5ce None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:04.235529 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 57/114] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:04.236260 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab656f85-21d3-4139-a83f-186d753ce5ce None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:04.242653 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcac1eb-ada9-4b3a-8656-b0f66226950e None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:04.288297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7e938-8a19-48bd-86ec-87b3a6c8319d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:04.289117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7e938-8a19-48bd-86ec-87b3a6c8319d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:04.289614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7e938-8a19-48bd-86ec-87b3a6c8319d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:04.290279 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7e938-8a19-48bd-86ec-87b3a6c8319d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:04.306849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7e938-8a19-48bd-86ec-87b3a6c8319d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:04.318221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-b6a7e938-8a19-48bd-86ec-87b3a6c8319d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:05:04.318221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:04.318221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:04.318221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:04.318221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:04.318221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:04.318221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:04.318221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:04.318221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:04.318221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:04.318221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:04.318221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:04.318221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:04.318221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:04.318221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:04.318221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:04.319877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:04.319877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:04.319877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:04.319877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:04.319877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:04.319877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:04.319877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:04.319877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:04.319877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:04.319877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:04.319877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:04.319877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:04.319877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:04.319877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:04.319877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:04.319877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:04.320938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:04.320938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:04.320938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:04.320938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:04.320938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:04.320938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:04.320938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:04.320938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:04.320938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:04.320938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:04.320938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:05:04.320938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:04.321517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 58/115] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:05:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:04.322539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7e938-8a19-48bd-86ec-87b3a6c8319d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:04.388927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab656f85-21d3-4139-a83f-186d753ce5ce None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:04.391020 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:04.429375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:04.436498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c45f6-1b56-4dcb-9852-05aa8ee9a55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:04.437245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c45f6-1b56-4dcb-9852-05aa8ee9a55a None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:04.437567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c45f6-1b56-4dcb-9852-05aa8ee9a55a None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:04.437843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c45f6-1b56-4dcb-9852-05aa8ee9a55a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:04.451309 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c45f6-1b56-4dcb-9852-05aa8ee9a55a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:04.453131 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7e938-8a19-48bd-86ec-87b3a6c8319d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:04.456890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-6f7c45f6-1b56-4dcb-9852-05aa8ee9a55a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:05:04.456890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:04.456890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:04.456890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:04.456890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:04.456890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:04.456890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:04.456890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:04.456890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:04.456890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:04.456890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:04.456890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:04.456890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:04.456890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:04.456890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:04.456890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:04.459806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:04.459806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:04.459806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:04.459806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:04.459806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:04.459806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:04.459806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:04.459806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:04.459806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:04.459806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:04.459806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:04.459806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:04.459806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:04.459806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:04.459806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:04.459806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:04.461319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:04.461319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:04.461319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:04.461319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:04.461319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:04.461319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:04.461319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:04.461319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:04.461319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:04.461319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:04.461319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:05:04.461319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:05:04.461319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 58/116] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:05:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:04.461319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c45f6-1b56-4dcb-9852-05aa8ee9a55a None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:04.507582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396fe57-7ad1-4ad5-8d3f-d341b163500d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:04.508333 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396fe57-7ad1-4ad5-8d3f-d341b163500d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:04.508665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396fe57-7ad1-4ad5-8d3f-d341b163500d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:04.509038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396fe57-7ad1-4ad5-8d3f-d341b163500d None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:04.510366 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396fe57-7ad1-4ad5-8d3f-d341b163500d None admin] RBAC: Authorizing `identity:get_project(project_id=612f86bc1b6c4d8ab8393c2393a01341)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:04.511967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396fe57-7ad1-4ad5-8d3f-d341b163500d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:04.513830 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 59/117] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:04 2022] GET /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:04.515448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396fe57-7ad1-4ad5-8d3f-d341b163500d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:04.614487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c45f6-1b56-4dcb-9852-05aa8ee9a55a None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:04.655300 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396fe57-7ad1-4ad5-8d3f-d341b163500d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:04.657998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b394b-ede0-4f4f-b3eb-fd516865cf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:04.658776 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b394b-ede0-4f4f-b3eb-fd516865cf57 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:04.659063 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b394b-ede0-4f4f-b3eb-fd516865cf57 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:04.659430 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b394b-ede0-4f4f-b3eb-fd516865cf57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:04.660720 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b394b-ede0-4f4f-b3eb-fd516865cf57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:04.662196 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b394b-ede0-4f4f-b3eb-fd516865cf57 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:04.663902 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 59/118] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:05:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:04.664704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b394b-ede0-4f4f-b3eb-fd516865cf57 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:04.696230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea5b4d-cfe1-4689-a647-c82075951d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:04.696881 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea5b4d-cfe1-4689-a647-c82075951d48 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:04.697163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea5b4d-cfe1-4689-a647-c82075951d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:04.697436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea5b4d-cfe1-4689-a647-c82075951d48 None admin] PATH_INFO: `/v3/users/934e8ec20a134ae480f6677f8c64a73d` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:04.706366 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:04.713531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea5b4d-cfe1-4689-a647-c82075951d48 None admin] RBAC: Authorizing `identity:get_user(user_id=934e8ec20a134ae480f6677f8c64a73d)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:04.715076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea5b4d-cfe1-4689-a647-c82075951d48 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:04.716989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 60/119] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:04 2022] GET /identity/v3/users/934e8ec20a134ae480f6677f8c64a73d => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:04.719416 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea5b4d-cfe1-4689-a647-c82075951d48 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:04.733129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:04.797081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b394b-ede0-4f4f-b3eb-fd516865cf57 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:04.837587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636cde0-5b4a-4ee7-8c5d-a99407520f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:04.838207 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636cde0-5b4a-4ee7-8c5d-a99407520f6a None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:04.838478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636cde0-5b4a-4ee7-8c5d-a99407520f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:04.838773 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636cde0-5b4a-4ee7-8c5d-a99407520f6a None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:04.839492 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636cde0-5b4a-4ee7-8c5d-a99407520f6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:04.839790 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636cde0-5b4a-4ee7-8c5d-a99407520f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:04.841181 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636cde0-5b4a-4ee7-8c5d-a99407520f6a None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:04.845859 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea5b4d-cfe1-4689-a647-c82075951d48 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:04.850879 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 60/120] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:04.851796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636cde0-5b4a-4ee7-8c5d-a99407520f6a None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:04.894166 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7da728-2d7f-4c95-8f0f-b8920facf73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:04.894970 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7da728-2d7f-4c95-8f0f-b8920facf73e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:04.895350 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7da728-2d7f-4c95-8f0f-b8920facf73e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:04.895684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7da728-2d7f-4c95-8f0f-b8920facf73e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:04.912084 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7da728-2d7f-4c95-8f0f-b8920facf73e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:04.920810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-8d7da728-2d7f-4c95-8f0f-b8920facf73e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:04.920810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:04.920810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:04.920810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:04.920810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:04.920810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:04.920810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:04.920810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:04.920810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:04.920810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:04.920810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:04.920810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:04.920810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:04.920810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:04.920810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:04.920810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:04.922117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:04.922117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:04.922117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:04.922117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:04.922117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:04.922117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:04.922117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:04.922117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:04.922117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:04.922117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:04.922117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:04.922117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:04.922117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:04.922117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:04.922117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:04.922117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:04.923531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:04.923531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:04.923531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:04.923531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:04.923531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:04.923531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:04.923531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:04.923531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:04.923531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:04.923531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:04.923531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:04.923531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:04.923531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 61/121] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:04.925568 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7da728-2d7f-4c95-8f0f-b8920facf73e None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:04.978149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:04.991342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636cde0-5b4a-4ee7-8c5d-a99407520f6a None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:05.017945 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:05.035992 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d5bf0-e771-4ccd-b847-2c90c7592735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:05.036955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d5bf0-e771-4ccd-b847-2c90c7592735 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:05.037927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d5bf0-e771-4ccd-b847-2c90c7592735 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:05.038381 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d5bf0-e771-4ccd-b847-2c90c7592735 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:05.039515 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d5bf0-e771-4ccd-b847-2c90c7592735 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:05.040007 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d5bf0-e771-4ccd-b847-2c90c7592735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:05.042355 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d5bf0-e771-4ccd-b847-2c90c7592735 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:05.055174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 61/122] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:05:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:05.056018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d5bf0-e771-4ccd-b847-2c90c7592735 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:05.066527 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7da728-2d7f-4c95-8f0f-b8920facf73e None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:05.115322 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76497c7d-077b-435b-8786-b051a56c1f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:05.116796 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76497c7d-077b-435b-8786-b051a56c1f07 None admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:05.117118 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76497c7d-077b-435b-8786-b051a56c1f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:05.117449 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76497c7d-077b-435b-8786-b051a56c1f07 None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341/users/713912ac902347b893e9f394818adf52/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:05.119775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76497c7d-077b-435b-8786-b051a56c1f07 None admin] RBAC: Authorizing `identity:create_grant(project_id=612f86bc1b6c4d8ab8393c2393a01341, user_id=713912ac902347b893e9f394818adf52, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:05.121424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76497c7d-077b-435b-8786-b051a56c1f07 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:05.198341 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d5bf0-e771-4ccd-b847-2c90c7592735 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:05.217250 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 62/123] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:05:04 2022] PUT /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341/users/713912ac902347b893e9f394818adf52/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:05:05.218549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76497c7d-077b-435b-8786-b051a56c1f07 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:05.252165 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f2312-19aa-40ea-95a5-16a202dec995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:05.253314 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f2312-19aa-40ea-95a5-16a202dec995 None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:05.253754 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f2312-19aa-40ea-95a5-16a202dec995 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:05.254243 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f2312-19aa-40ea-95a5-16a202dec995 None admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:05.256301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f2312-19aa-40ea-95a5-16a202dec995 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:05.258894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f2312-19aa-40ea-95a5-16a202dec995 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:05.352572 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76497c7d-077b-435b-8786-b051a56c1f07 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:05.390572 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 62/124] 10.222.0.83 () {60 vars in 1141 bytes} [Fri Sep 23 01:05:05 2022] POST /identity/v3/projects => generated 302 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:05:05.392642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f2312-19aa-40ea-95a5-16a202dec995 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:05.395620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:05.412417 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:05.427959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc245a9e-7f72-45a7-9066-b1bb9bb30ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:05.429516 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc245a9e-7f72-45a7-9066-b1bb9bb30ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:05.430383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc245a9e-7f72-45a7-9066-b1bb9bb30ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:05.431186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc245a9e-7f72-45a7-9066-b1bb9bb30ef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:05.581022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc245a9e-7f72-45a7-9066-b1bb9bb30ef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:05.586167 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc245a9e-7f72-45a7-9066-b1bb9bb30ef0 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:05.594903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f2312-19aa-40ea-95a5-16a202dec995 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:05.664148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7c66e-9e5b-4c66-940d-9e9639c28733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:05.664925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7c66e-9e5b-4c66-940d-9e9639c28733 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:05.665420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7c66e-9e5b-4c66-940d-9e9639c28733 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:05.665704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7c66e-9e5b-4c66-940d-9e9639c28733 None admin] PATH_INFO: `/v3/users/41222441d92243a6917a027e72480f53` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:05.667926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7c66e-9e5b-4c66-940d-9e9639c28733 None admin] RBAC: Authorizing `identity:get_user(user_id=41222441d92243a6917a027e72480f53)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:05.669818 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7c66e-9e5b-4c66-940d-9e9639c28733 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:05.672730 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 63/125] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:05 2022] GET /identity/v3/users/41222441d92243a6917a027e72480f53 => generated 247 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:05.674278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7c66e-9e5b-4c66-940d-9e9639c28733 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:05.779893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:05.795753 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 63/126] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:05:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:05:05.798107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc245a9e-7f72-45a7-9066-b1bb9bb30ef0 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:05.812713 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7c66e-9e5b-4c66-940d-9e9639c28733 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:05.853898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:05.863676 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab6ec7-8327-481b-8ba1-8ed0d2850050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:05.864563 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab6ec7-8327-481b-8ba1-8ed0d2850050 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:05.865048 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab6ec7-8327-481b-8ba1-8ed0d2850050 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:05.873712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab6ec7-8327-481b-8ba1-8ed0d2850050 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:05.873712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab6ec7-8327-481b-8ba1-8ed0d2850050 None admin] RBAC: Adding query filter params (name=member) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:05.873712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab6ec7-8327-481b-8ba1-8ed0d2850050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:05.873712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab6ec7-8327-481b-8ba1-8ed0d2850050 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:05.891479 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 64/127] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:05.893051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab6ec7-8327-481b-8ba1-8ed0d2850050 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:06.008979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc245a9e-7f72-45a7-9066-b1bb9bb30ef0 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:06.047754 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab6ec7-8327-481b-8ba1-8ed0d2850050 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:06.072853 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b113614-41f2-4757-9359-8bc5d2e5eb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:06.073954 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b113614-41f2-4757-9359-8bc5d2e5eb0d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:06.074644 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b113614-41f2-4757-9359-8bc5d2e5eb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:06.075147 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b113614-41f2-4757-9359-8bc5d2e5eb0d None admin] PATH_INFO: `/v3/users/713912ac902347b893e9f394818adf52` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:06.077408 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b113614-41f2-4757-9359-8bc5d2e5eb0d None admin] RBAC: Authorizing `identity:get_user(user_id=713912ac902347b893e9f394818adf52)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:06.079536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b113614-41f2-4757-9359-8bc5d2e5eb0d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:06.083380 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 64/128] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:05 2022] GET /identity/v3/users/713912ac902347b893e9f394818adf52 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:06.085637 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b113614-41f2-4757-9359-8bc5d2e5eb0d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:06.113263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c69fc-059b-4c5d-a02c-e93f32203b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:06.113990 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c69fc-059b-4c5d-a02c-e93f32203b11 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:06.114769 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c69fc-059b-4c5d-a02c-e93f32203b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:06.115097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c69fc-059b-4c5d-a02c-e93f32203b11 None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:06.116896 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c69fc-059b-4c5d-a02c-e93f32203b11 None admin] RBAC: Authorizing `identity:get_project(project_id=612f86bc1b6c4d8ab8393c2393a01341)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:06.119179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c69fc-059b-4c5d-a02c-e93f32203b11 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:06.121471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 65/129] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:05 2022] GET /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:06.125057 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c69fc-059b-4c5d-a02c-e93f32203b11 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:06.128617 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:06.236516 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:06.253444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b113614-41f2-4757-9359-8bc5d2e5eb0d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:06.277368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c69fc-059b-4c5d-a02c-e93f32203b11 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:06.306552 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b12ad8-8979-4625-9e11-e8432ca3faf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:06.307232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b12ad8-8979-4625-9e11-e8432ca3faf0 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:06.307513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b12ad8-8979-4625-9e11-e8432ca3faf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:06.307787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b12ad8-8979-4625-9e11-e8432ca3faf0 None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:06.308988 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b12ad8-8979-4625-9e11-e8432ca3faf0 None admin] RBAC: Authorizing `identity:get_project(project_id=612f86bc1b6c4d8ab8393c2393a01341)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:06.310731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b12ad8-8979-4625-9e11-e8432ca3faf0 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:06.312623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 65/130] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:06 2022] GET /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:06.313771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b12ad8-8979-4625-9e11-e8432ca3faf0 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:06.323649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74792dbd-d9d6-4290-904f-2e3754d1a280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:06.324615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74792dbd-d9d6-4290-904f-2e3754d1a280 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:06.325075 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74792dbd-d9d6-4290-904f-2e3754d1a280 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:06.325612 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74792dbd-d9d6-4290-904f-2e3754d1a280 None admin] PATH_INFO: `/v3/users/713912ac902347b893e9f394818adf52` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:06.327135 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74792dbd-d9d6-4290-904f-2e3754d1a280 None admin] RBAC: Authorizing `identity:get_user(user_id=713912ac902347b893e9f394818adf52)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:06.329036 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74792dbd-d9d6-4290-904f-2e3754d1a280 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:06.331645 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 66/131] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:06 2022] GET /identity/v3/users/713912ac902347b893e9f394818adf52 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:06.337917 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74792dbd-d9d6-4290-904f-2e3754d1a280 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:06.459207 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:06.470571 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74792dbd-d9d6-4290-904f-2e3754d1a280 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:06.474769 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b12ad8-8979-4625-9e11-e8432ca3faf0 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:06.531965 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c82ba-b403-44a8-9f30-04fcbb197aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:06.532519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c82ba-b403-44a8-9f30-04fcbb197aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:06.532798 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c82ba-b403-44a8-9f30-04fcbb197aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:06.533067 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c82ba-b403-44a8-9f30-04fcbb197aa9 None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:06.534233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c82ba-b403-44a8-9f30-04fcbb197aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=612f86bc1b6c4d8ab8393c2393a01341)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:06.535810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c82ba-b403-44a8-9f30-04fcbb197aa9 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:06.538812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 66/132] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:06 2022] GET /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:06.539383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c82ba-b403-44a8-9f30-04fcbb197aa9 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:06.543426 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288c654-f2c5-45f9-9b11-b028f3e55b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:06.545018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288c654-f2c5-45f9-9b11-b028f3e55b28 None admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:06.545769 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288c654-f2c5-45f9-9b11-b028f3e55b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:06.546539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288c654-f2c5-45f9-9b11-b028f3e55b28 None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341/users/41222441d92243a6917a027e72480f53/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:06.550478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288c654-f2c5-45f9-9b11-b028f3e55b28 None admin] RBAC: Authorizing `identity:create_grant(project_id=612f86bc1b6c4d8ab8393c2393a01341, user_id=41222441d92243a6917a027e72480f53, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:06.553939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288c654-f2c5-45f9-9b11-b028f3e55b28 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:06.578399 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:06.672059 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 67/133] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:05:06 2022] PUT /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341/users/41222441d92243a6917a027e72480f53/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:05:06.674990 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288c654-f2c5-45f9-9b11-b028f3e55b28 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:06.688182 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c82ba-b403-44a8-9f30-04fcbb197aa9 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:06.823481 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f7c5c-6e42-4876-8f5c-b30e15f2871c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:06.825056 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f7c5c-6e42-4876-8f5c-b30e15f2871c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:06.825924 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f7c5c-6e42-4876-8f5c-b30e15f2871c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:06.826544 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f7c5c-6e42-4876-8f5c-b30e15f2871c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:06.828434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f7c5c-6e42-4876-8f5c-b30e15f2871c None admin] RBAC: Adding query filter params (role.id=4459bad5351b44b3b48d09c46d197855, scope.project.id=612f86bc1b6c4d8ab8393c2393a01341, user.id=934e8ec20a134ae480f6677f8c64a73d) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:06.829168 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f7c5c-6e42-4876-8f5c-b30e15f2871c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:06.832351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f7c5c-6e42-4876-8f5c-b30e15f2871c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:06.845131 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 67/134] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:05:06 2022] GET /identity/v3/role_assignments?user.id=934e8ec20a134ae480f6677f8c64a73d&scope.project.id=612f86bc1b6c4d8ab8393c2393a01341&role.id=4459bad5351b44b3b48d09c46d197855 => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:06.846892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f7c5c-6e42-4876-8f5c-b30e15f2871c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:07.061151 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:07.075414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f7c5c-6e42-4876-8f5c-b30e15f2871c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:07.089817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288c654-f2c5-45f9-9b11-b028f3e55b28 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:07.208381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316abca-04f6-4e76-af77-5cf174ea1d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:07.209084 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316abca-04f6-4e76-af77-5cf174ea1d1c None admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:07.210031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316abca-04f6-4e76-af77-5cf174ea1d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:07.210500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316abca-04f6-4e76-af77-5cf174ea1d1c None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341/users/713912ac902347b893e9f394818adf52/roles/a9e6249ed8cd44ce9fac74a4c8155978` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:07.217023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316abca-04f6-4e76-af77-5cf174ea1d1c None admin] RBAC: Authorizing `identity:create_grant(project_id=612f86bc1b6c4d8ab8393c2393a01341, user_id=713912ac902347b893e9f394818adf52, role_id=a9e6249ed8cd44ce9fac74a4c8155978)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:07.218579 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316abca-04f6-4e76-af77-5cf174ea1d1c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:07.223230 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:07.239692 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee4702-500c-468d-8c7d-f6e7abd9ccdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:07.241361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee4702-500c-468d-8c7d-f6e7abd9ccdf None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:07.242126 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee4702-500c-468d-8c7d-f6e7abd9ccdf None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:07.242903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee4702-500c-468d-8c7d-f6e7abd9ccdf None admin] PATH_INFO: `/v3/projects/27f784c700f043b4b38ba51d84245655` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:07.248130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee4702-500c-468d-8c7d-f6e7abd9ccdf None admin] RBAC: Authorizing `identity:get_project(project_id=27f784c700f043b4b38ba51d84245655)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:07.251448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee4702-500c-468d-8c7d-f6e7abd9ccdf None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:07.255185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 68/135] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:06 2022] GET /identity/v3/projects/27f784c700f043b4b38ba51d84245655 => generated 312 bytes in 582 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:07.266383 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee4702-500c-468d-8c7d-f6e7abd9ccdf None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:07.326245 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 68/136] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:05:06 2022] PUT /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341/users/713912ac902347b893e9f394818adf52/roles/a9e6249ed8cd44ce9fac74a4c8155978 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:05:07.494094 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee4702-500c-468d-8c7d-f6e7abd9ccdf None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:07.565448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afbe1e1-1ee7-4095-8feb-571b2e1caa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:07.567374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbe1e1-1ee7-4095-8feb-571b2e1caa63 None admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:07.568275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbe1e1-1ee7-4095-8feb-571b2e1caa63 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:07.569235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbe1e1-1ee7-4095-8feb-571b2e1caa63 None admin] PATH_INFO: `/v3/projects/27f784c700f043b4b38ba51d84245655/users/713912ac902347b893e9f394818adf52/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:07.573921 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afbe1e1-1ee7-4095-8feb-571b2e1caa63 None admin] RBAC: Authorizing `identity:create_grant(project_id=27f784c700f043b4b38ba51d84245655, user_id=713912ac902347b893e9f394818adf52, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:07.577390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afbe1e1-1ee7-4095-8feb-571b2e1caa63 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:07.667124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 69/137] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:05:07 2022] PUT /identity/v3/projects/27f784c700f043b4b38ba51d84245655/users/713912ac902347b893e9f394818adf52/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:05:08.571621 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa38a07-395a-4019-84be-d91b03b076bf None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:08.573218 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa38a07-395a-4019-84be-d91b03b076bf None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:08.574060 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa38a07-395a-4019-84be-d91b03b076bf None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:08.576939 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 69/138] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:08.585259 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184b7a7-1adb-4319-a4b0-c1002f0bd3c8 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:08.586785 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184b7a7-1adb-4319-a4b0-c1002f0bd3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:08.587353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184b7a7-1adb-4319-a4b0-c1002f0bd3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:08.620120 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-7184b7a7-1adb-4319-a4b0-c1002f0bd3c8 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:08.621836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-7184b7a7-1adb-4319-a4b0-c1002f0bd3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:08.708620 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:08.729027 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 70/139] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:09.341302 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa38a07-395a-4019-84be-d91b03b076bf None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:09.545172 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa38a07-395a-4019-84be-d91b03b076bf None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:09.564979 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd8fb0-835e-473a-a578-c051721e5401 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:09.565446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd8fb0-835e-473a-a578-c051721e5401 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:09.565919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd8fb0-835e-473a-a578-c051721e5401 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:09.572935 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 71/140] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:09 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:09.579595 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbfdc1-33e0-4b77-be03-e9e3f92fb73f None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:09.580083 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbfdc1-33e0-4b77-be03-e9e3f92fb73f None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:09.580593 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbfdc1-33e0-4b77-be03-e9e3f92fb73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:09.614514 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cad8f9-97a9-4ea8-b390-367c8875b78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:09.615432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cad8f9-97a9-4ea8-b390-367c8875b78e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:09.616392 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cad8f9-97a9-4ea8-b390-367c8875b78e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:09.616807 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cad8f9-97a9-4ea8-b390-367c8875b78e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:09.644471 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cad8f9-97a9-4ea8-b390-367c8875b78e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:09.644655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-0ccbfdc1-33e0-4b77-be03-e9e3f92fb73f None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:09.646814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-0ccbfdc1-33e0-4b77-be03-e9e3f92fb73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:09.661865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-27cad8f9-97a9-4ea8-b390-367c8875b78e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:09.661865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:09.661865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:09.661865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:09.661865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:09.661865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:09.661865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:09.661865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:09.661865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:09.661865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:09.661865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:09.661865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:09.661865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:09.661865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:09.661865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:09.661865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:09.662851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:09.662851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:09.662851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:09.662851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:09.662851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:09.662851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:09.662851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:09.662851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:09.662851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:09.662851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:09.662851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:09.662851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:09.662851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:09.662851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:09.662851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:09.662851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:09.663607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:09.663607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:09.663607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:09.663607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:09.663607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:09.663607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:09.663607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:09.663607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:09.663607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:09.663607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:09.663607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:09.663607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:09.664183 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 70/141] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:09.670144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cad8f9-97a9-4ea8-b390-367c8875b78e None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:09.710687 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:09.897740 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 72/142] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:09.935071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cad8f9-97a9-4ea8-b390-367c8875b78e None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:10.001114 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23022f-77e9-49b5-80cc-a1836942022c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:10.001807 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23022f-77e9-49b5-80cc-a1836942022c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:10.002084 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23022f-77e9-49b5-80cc-a1836942022c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:10.002348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23022f-77e9-49b5-80cc-a1836942022c None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:10.003065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23022f-77e9-49b5-80cc-a1836942022c None admin] RBAC: Adding query filter params (name=member) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:10.007255 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23022f-77e9-49b5-80cc-a1836942022c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:10.008812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23022f-77e9-49b5-80cc-a1836942022c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:10.023886 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 71/143] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:10.029592 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbfdc1-33e0-4b77-be03-e9e3f92fb73f None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:10.207084 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbfdc1-33e0-4b77-be03-e9e3f92fb73f None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:10.240834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:10.266275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b81b89-18bf-4168-872b-a261db8fc721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:10.266994 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b81b89-18bf-4168-872b-a261db8fc721 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:10.267272 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b81b89-18bf-4168-872b-a261db8fc721 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:10.267569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b81b89-18bf-4168-872b-a261db8fc721 None admin] PATH_INFO: `/v3/users/713912ac902347b893e9f394818adf52` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:10.268985 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b81b89-18bf-4168-872b-a261db8fc721 None admin] RBAC: Authorizing `identity:get_user(user_id=713912ac902347b893e9f394818adf52)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:10.270743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b81b89-18bf-4168-872b-a261db8fc721 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:10.273075 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 73/144] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:10 2022] GET /identity/v3/users/713912ac902347b893e9f394818adf52 => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:10.279052 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23022f-77e9-49b5-80cc-a1836942022c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:10.371078 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b81b89-18bf-4168-872b-a261db8fc721 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:10.430982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:10.489957 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23022f-77e9-49b5-80cc-a1836942022c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:10.593054 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b81b89-18bf-4168-872b-a261db8fc721 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:10.625228 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f92f3f-e9a5-438e-a31a-e64ff8490f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:10.630852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f92f3f-e9a5-438e-a31a-e64ff8490f48 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:10.632154 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f92f3f-e9a5-438e-a31a-e64ff8490f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:10.632579 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f92f3f-e9a5-438e-a31a-e64ff8490f48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:10.714227 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c1083-b1c0-4b73-94da-bdf99ef5fc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:10.716860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c1083-b1c0-4b73-94da-bdf99ef5fc4e None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:10.717666 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c1083-b1c0-4b73-94da-bdf99ef5fc4e None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:10.718411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c1083-b1c0-4b73-94da-bdf99ef5fc4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:10.721039 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c1083-b1c0-4b73-94da-bdf99ef5fc4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:10.732424 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c1083-b1c0-4b73-94da-bdf99ef5fc4e None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:10.736368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 74/145] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:05:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:10.743933 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c1083-b1c0-4b73-94da-bdf99ef5fc4e None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:10.827948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f92f3f-e9a5-438e-a31a-e64ff8490f48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:10.829609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f92f3f-e9a5-438e-a31a-e64ff8490f48 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:10.987066 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:11.094689 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:11.174179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c1083-b1c0-4b73-94da-bdf99ef5fc4e None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:11.175004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 72/146] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:05:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 897 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 01:05:11.186320 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f92f3f-e9a5-438e-a31a-e64ff8490f48 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:11.269000 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4d1e4-f57f-4e56-98b9-bd54e5a58c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:11.270045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4d1e4-f57f-4e56-98b9-bd54e5a58c99 None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:11.270705 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4d1e4-f57f-4e56-98b9-bd54e5a58c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:11.271208 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4d1e4-f57f-4e56-98b9-bd54e5a58c99 None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:11.272595 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4d1e4-f57f-4e56-98b9-bd54e5a58c99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:11.275234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4d1e4-f57f-4e56-98b9-bd54e5a58c99 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:11.460772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f92f3f-e9a5-438e-a31a-e64ff8490f48 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:11.467276 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 75/147] 10.222.0.83 () {60 vars in 1132 bytes} [Fri Sep 23 01:05:10 2022] POST /identity/v3/users => generated 283 bytes in 725 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:05:11.470220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb8af-bdf8-4007-8a80-e91300a651c0 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:11.475551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb8af-bdf8-4007-8a80-e91300a651c0 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:11.476403 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb8af-bdf8-4007-8a80-e91300a651c0 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:11.486622 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 76/148] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:11 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:11.489386 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5bd2c-121f-402d-b0a8-8fd1d3e2f01a None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:11.490195 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5bd2c-121f-402d-b0a8-8fd1d3e2f01a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:11.491524 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5bd2c-121f-402d-b0a8-8fd1d3e2f01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:11.530345 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-00c5bd2c-121f-402d-b0a8-8fd1d3e2f01a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:11.532722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aad4af-c3a9-41c7-be19-6751b0f0e291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:11.535615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-00c5bd2c-121f-402d-b0a8-8fd1d3e2f01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:11.536904 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aad4af-c3a9-41c7-be19-6751b0f0e291 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:11.538892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aad4af-c3a9-41c7-be19-6751b0f0e291 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:11.539391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aad4af-c3a9-41c7-be19-6751b0f0e291 None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:11.545354 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aad4af-c3a9-41c7-be19-6751b0f0e291 None admin] RBAC: Authorizing `identity:get_project(project_id=612f86bc1b6c4d8ab8393c2393a01341)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:11.548593 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aad4af-c3a9-41c7-be19-6751b0f0e291 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:11.558481 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 73/149] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:11 2022] GET /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341 => generated 298 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:11.563942 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1d61d-cd50-4c2f-ae7c-895a5d476938 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:11.564492 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1d61d-cd50-4c2f-ae7c-895a5d476938 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:11.564975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1d61d-cd50-4c2f-ae7c-895a5d476938 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:11.570186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 74/150] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:11 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:11.577443 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1d61d-cd50-4c2f-ae7c-895a5d476938 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:11.698561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:11.743220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 77/151] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:11.746720 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfce5db-e31e-4028-8628-2ab0d8a85f48 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:11.747736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfce5db-e31e-4028-8628-2ab0d8a85f48 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:11.748476 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfce5db-e31e-4028-8628-2ab0d8a85f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:11.799793 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-6bfce5db-e31e-4028-8628-2ab0d8a85f48 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:11.802433 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6bfce5db-e31e-4028-8628-2ab0d8a85f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:11.839309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1d61d-cd50-4c2f-ae7c-895a5d476938 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:11.900277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:11.942809 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5d4e7-cb5b-4bda-a124-ae3145f26a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:11.943936 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5d4e7-cb5b-4bda-a124-ae3145f26a68 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:11.944453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5d4e7-cb5b-4bda-a124-ae3145f26a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:11.945115 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5d4e7-cb5b-4bda-a124-ae3145f26a68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:11.946534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5d4e7-cb5b-4bda-a124-ae3145f26a68 None admin] RBAC: Adding query filter params (role.id=986891361f4f4893a1cb2d0e0b523bff, scope.project.id=612f86bc1b6c4d8ab8393c2393a01341, user.id=713912ac902347b893e9f394818adf52) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:11.948408 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5d4e7-cb5b-4bda-a124-ae3145f26a68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:11.951577 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5d4e7-cb5b-4bda-a124-ae3145f26a68 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:11.962369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 78/152] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:11.965914 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 75/153] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:05:11 2022] GET /identity/v3/role_assignments?user.id=713912ac902347b893e9f394818adf52&scope.project.id=612f86bc1b6c4d8ab8393c2393a01341&role.id=986891361f4f4893a1cb2d0e0b523bff => generated 608 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:11.970443 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f2816-286a-4c21-b283-50e5a58cb7a8 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:11.970443 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f2816-286a-4c21-b283-50e5a58cb7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:11.970443 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f2816-286a-4c21-b283-50e5a58cb7a8 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:11.973826 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 76/154] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:11.981655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6742-17e5-4465-ac2c-0508dd18631a None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:11.982306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6742-17e5-4465-ac2c-0508dd18631a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:11.982907 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6742-17e5-4465-ac2c-0508dd18631a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:12.013989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-93dd6742-17e5-4465-ac2c-0508dd18631a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:12.015833 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-93dd6742-17e5-4465-ac2c-0508dd18631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:12.158646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 79/155] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:12.320107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f2816-286a-4c21-b283-50e5a58cb7a8 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:12.527282 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd6742-17e5-4465-ac2c-0508dd18631a None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:12.576641 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f2816-286a-4c21-b283-50e5a58cb7a8 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:12.597717 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:12.670297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203c852-e18f-4fe1-948f-c5e1db491980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:12.671286 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203c852-e18f-4fe1-948f-c5e1db491980 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:12.671691 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203c852-e18f-4fe1-948f-c5e1db491980 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:12.672098 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203c852-e18f-4fe1-948f-c5e1db491980 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:12.705782 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203c852-e18f-4fe1-948f-c5e1db491980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:12.713995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-6203c852-e18f-4fe1-948f-c5e1db491980 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:05:12.713995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:12.713995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:12.713995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:12.713995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:12.713995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:12.713995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:12.713995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:12.713995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:12.713995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:12.713995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:12.713995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:12.713995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:12.713995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:12.713995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:12.713995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:12.715672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:12.715672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:12.715672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:12.715672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:12.715672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:12.715672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:12.715672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:12.715672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:12.715672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:12.715672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:12.715672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:12.715672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:12.715672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:12.715672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:12.715672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:12.715672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:12.716982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:12.716982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:12.716982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:12.716982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:12.716982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:12.716982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:12.716982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:12.716982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:12.716982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:12.716982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:12.716982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:05:12.716982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:12.722951 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 77/156] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:05:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:12.724526 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203c852-e18f-4fe1-948f-c5e1db491980 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:12.773831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd6742-17e5-4465-ac2c-0508dd18631a None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:12.779113 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:12.837317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73bfdc-f675-4ccb-ab64-10cb77a48f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:12.838695 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73bfdc-f675-4ccb-ab64-10cb77a48f6a None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:12.839443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73bfdc-f675-4ccb-ab64-10cb77a48f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:12.839843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73bfdc-f675-4ccb-ab64-10cb77a48f6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:12.856930 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73bfdc-f675-4ccb-ab64-10cb77a48f6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:12.869465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-1e73bfdc-f675-4ccb-ab64-10cb77a48f6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:05:12.869465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:12.869465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:12.869465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:12.869465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:12.869465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:12.869465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:12.869465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:12.869465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:12.869465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:12.869465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:12.869465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:12.869465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:12.869465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:12.869465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:12.869465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:12.871088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:12.871088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:12.871088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:12.871088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:12.871088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:12.871088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:12.871088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:12.871088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:12.871088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:12.871088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:12.871088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:12.871088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:12.871088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:12.871088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:12.871088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:12.871088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:12.872419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:12.872419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:12.872419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:12.872419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:12.872419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:12.872419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:12.872419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:12.872419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:12.872419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:12.872419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:12.872419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:05:12.872419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:05:12.879572 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 80/157] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:05:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:12.881915 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73bfdc-f675-4ccb-ab64-10cb77a48f6a None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:12.896494 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203c852-e18f-4fe1-948f-c5e1db491980 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:12.973626 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4518ea1-f68e-4dbb-9f84-70dfc039b4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:12.974389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4518ea1-f68e-4dbb-9f84-70dfc039b4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:12.974782 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4518ea1-f68e-4dbb-9f84-70dfc039b4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:12.975096 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4518ea1-f68e-4dbb-9f84-70dfc039b4d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:12.996379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4518ea1-f68e-4dbb-9f84-70dfc039b4d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:13.002088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-c4518ea1-f68e-4dbb-9f84-70dfc039b4d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 01:05:13.002088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:13.002088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:13.002088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:13.002088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:13.002088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:13.002088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:13.002088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:13.002088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:13.002088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:13.002088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:13.002088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:13.002088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:13.002088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:13.002088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:13.002088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:13.003870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:13.003870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:13.003870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:13.003870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:13.003870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:13.003870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:13.003870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:13.003870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:13.003870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:13.003870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:13.003870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:13.003870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:13.003870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:13.003870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:13.003870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:13.003870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:13.005447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:13.005447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:13.005447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:13.005447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:13.005447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:13.005447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:13.005447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:13.005447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:13.005447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:13.005447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:13.005447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 01:05:13.005447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:13.009579 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 78/158] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:13.009919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4518ea1-f68e-4dbb-9f84-70dfc039b4d0 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:13.054352 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:13.089876 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73bfdc-f675-4ccb-ab64-10cb77a48f6a None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:13.176546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cb9c1-50d9-43c9-b4d5-5f55e35a4b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:13.177525 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cb9c1-50d9-43c9-b4d5-5f55e35a4b46 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:13.178012 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cb9c1-50d9-43c9-b4d5-5f55e35a4b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:13.178969 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cb9c1-50d9-43c9-b4d5-5f55e35a4b46 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:13.180093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cb9c1-50d9-43c9-b4d5-5f55e35a4b46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:13.180568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cb9c1-50d9-43c9-b4d5-5f55e35a4b46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:13.181744 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4518ea1-f68e-4dbb-9f84-70dfc039b4d0 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:13.183927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cb9c1-50d9-43c9-b4d5-5f55e35a4b46 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:13.203015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 81/159] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:05:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:13.203015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe31b09-c722-469c-9370-08984bf6538b None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:13.203015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe31b09-c722-469c-9370-08984bf6538b None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:13.203492 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe31b09-c722-469c-9370-08984bf6538b None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:13.205616 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 82/160] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:13.206879 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe31b09-c722-469c-9370-08984bf6538b None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:13.277292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:13.279010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba93252-fdbb-4a52-8f9e-a6b977b971f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:13.279743 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba93252-fdbb-4a52-8f9e-a6b977b971f0 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:13.280141 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba93252-fdbb-4a52-8f9e-a6b977b971f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:13.280418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba93252-fdbb-4a52-8f9e-a6b977b971f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:13.281113 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba93252-fdbb-4a52-8f9e-a6b977b971f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:13.281439 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba93252-fdbb-4a52-8f9e-a6b977b971f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:13.283005 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba93252-fdbb-4a52-8f9e-a6b977b971f0 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:13.319502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 79/161] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:13.321256 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba93252-fdbb-4a52-8f9e-a6b977b971f0 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:13.435457 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe31b09-c722-469c-9370-08984bf6538b None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:13.543037 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:13.547927 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba93252-fdbb-4a52-8f9e-a6b977b971f0 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:13.563483 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc25582-fa87-4e56-9a52-f94651ffc2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:13.564169 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc25582-fa87-4e56-9a52-f94651ffc2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:13.564458 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc25582-fa87-4e56-9a52-f94651ffc2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:13.564726 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc25582-fa87-4e56-9a52-f94651ffc2f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:13.565759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc25582-fa87-4e56-9a52-f94651ffc2f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:13.566071 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc25582-fa87-4e56-9a52-f94651ffc2f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:13.567892 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc25582-fa87-4e56-9a52-f94651ffc2f2 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:13.592893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 83/162] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:13.594206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309d143-905a-4fd9-87e1-dc17c302cef7 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:13.594510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309d143-905a-4fd9-87e1-dc17c302cef7 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:13.594805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309d143-905a-4fd9-87e1-dc17c302cef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:13.636844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69448081-52b1-4827-b54c-a1edc4de9f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:13.637597 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69448081-52b1-4827-b54c-a1edc4de9f84 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:13.638030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69448081-52b1-4827-b54c-a1edc4de9f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:13.638310 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69448081-52b1-4827-b54c-a1edc4de9f84 None admin] PATH_INFO: `/v3/users/713912ac902347b893e9f394818adf52` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:13.640069 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-c309d143-905a-4fd9-87e1-dc17c302cef7 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:13.642581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-c309d143-905a-4fd9-87e1-dc17c302cef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:13.643032 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69448081-52b1-4827-b54c-a1edc4de9f84 None admin] RBAC: Authorizing `identity:get_user(user_id=713912ac902347b893e9f394818adf52)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:13.644744 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69448081-52b1-4827-b54c-a1edc4de9f84 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:13.647483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 80/163] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:13 2022] GET /identity/v3/users/713912ac902347b893e9f394818adf52 => generated 275 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:13.653009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69448081-52b1-4827-b54c-a1edc4de9f84 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:13.789303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 84/164] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:13.798274 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309d143-905a-4fd9-87e1-dc17c302cef7 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:13.857688 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:13.997288 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69448081-52b1-4827-b54c-a1edc4de9f84 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:14.097510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309d143-905a-4fd9-87e1-dc17c302cef7 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:14.105823 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e0e82-00c4-4272-87b2-ac748039c8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:14.107491 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e0e82-00c4-4272-87b2-ac748039c8df None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:14.108273 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e0e82-00c4-4272-87b2-ac748039c8df None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:14.109042 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e0e82-00c4-4272-87b2-ac748039c8df None admin] PATH_INFO: `/v3/users/41222441d92243a6917a027e72480f53` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:14.111767 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e0e82-00c4-4272-87b2-ac748039c8df None admin] RBAC: Authorizing `identity:get_user(user_id=41222441d92243a6917a027e72480f53)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:14.116734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e0e82-00c4-4272-87b2-ac748039c8df None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:14.121593 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 81/165] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:13 2022] GET /identity/v3/users/41222441d92243a6917a027e72480f53 => generated 247 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:14.123910 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e0e82-00c4-4272-87b2-ac748039c8df None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:14.197833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:14.199485 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794377da-d1a3-4f64-b93f-30c71d62f14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:14.200177 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794377da-d1a3-4f64-b93f-30c71d62f14b None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:14.200458 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794377da-d1a3-4f64-b93f-30c71d62f14b None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:14.200749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794377da-d1a3-4f64-b93f-30c71d62f14b None admin] PATH_INFO: `/v3/users/934e8ec20a134ae480f6677f8c64a73d` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:14.202572 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794377da-d1a3-4f64-b93f-30c71d62f14b None admin] RBAC: Authorizing `identity:get_user(user_id=934e8ec20a134ae480f6677f8c64a73d)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:14.204295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794377da-d1a3-4f64-b93f-30c71d62f14b None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:14.205953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 85/166] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:13 2022] GET /identity/v3/users/934e8ec20a134ae480f6677f8c64a73d => generated 289 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:14.206812 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794377da-d1a3-4f64-b93f-30c71d62f14b None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:14.494754 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:14.502001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e0e82-00c4-4272-87b2-ac748039c8df None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:14.530548 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794377da-d1a3-4f64-b93f-30c71d62f14b None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:14.589081 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816edac-cbba-4df9-bb25-4d785e2d24d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:14.589772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816edac-cbba-4df9-bb25-4d785e2d24d2 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:14.590052 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816edac-cbba-4df9-bb25-4d785e2d24d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:14.590317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816edac-cbba-4df9-bb25-4d785e2d24d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:14.598004 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4391eb9-50b6-48d8-bf5d-20f02996615c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:14.598761 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4391eb9-50b6-48d8-bf5d-20f02996615c None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:14.600388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4391eb9-50b6-48d8-bf5d-20f02996615c None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:14.600661 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4391eb9-50b6-48d8-bf5d-20f02996615c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:14.783812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816edac-cbba-4df9-bb25-4d785e2d24d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:14.785324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816edac-cbba-4df9-bb25-4d785e2d24d2 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:14.788197 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4391eb9-50b6-48d8-bf5d-20f02996615c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:14.791328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4391eb9-50b6-48d8-bf5d-20f02996615c None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:14.871045 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:14.969443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:15.012720 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 86/167] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 806 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:05:15.014923 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4391eb9-50b6-48d8-bf5d-20f02996615c None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:15.183281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 82/168] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1060 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:05:15.184356 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816edac-cbba-4df9-bb25-4d785e2d24d2 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:15.236491 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4391eb9-50b6-48d8-bf5d-20f02996615c None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:15.282720 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a98e1a-e23d-431d-87aa-c9119c408574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:15.283433 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a98e1a-e23d-431d-87aa-c9119c408574 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:15.283788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a98e1a-e23d-431d-87aa-c9119c408574 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:15.284542 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a98e1a-e23d-431d-87aa-c9119c408574 None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:15.285911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a98e1a-e23d-431d-87aa-c9119c408574 None admin] RBAC: Authorizing `identity:get_project(project_id=612f86bc1b6c4d8ab8393c2393a01341)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:15.288035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a98e1a-e23d-431d-87aa-c9119c408574 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:15.290192 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 87/169] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:15 2022] GET /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:15.291065 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a98e1a-e23d-431d-87aa-c9119c408574 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:15.363877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:15.423893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a98e1a-e23d-431d-87aa-c9119c408574 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:15.520879 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce51d8a-1e5f-463a-ade1-ff8450f6ffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:15.522682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce51d8a-1e5f-463a-ade1-ff8450f6ffd2 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:15.523189 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce51d8a-1e5f-463a-ade1-ff8450f6ffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:15.523672 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce51d8a-1e5f-463a-ade1-ff8450f6ffd2 None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:15.532073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce51d8a-1e5f-463a-ade1-ff8450f6ffd2 None admin] RBAC: Authorizing `identity:get_project(project_id=612f86bc1b6c4d8ab8393c2393a01341)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:15.535115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce51d8a-1e5f-463a-ade1-ff8450f6ffd2 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:15.538799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 88/170] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:15 2022] GET /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:15.548361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce51d8a-1e5f-463a-ade1-ff8450f6ffd2 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:15.551839 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816edac-cbba-4df9-bb25-4d785e2d24d2 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:15.612260 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:15.632573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ff152-1b87-43a0-9b00-cad0bcac643c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:15.634036 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ff152-1b87-43a0-9b00-cad0bcac643c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:15.637400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ff152-1b87-43a0-9b00-cad0bcac643c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:15.637400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ff152-1b87-43a0-9b00-cad0bcac643c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:15.659984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ff152-1b87-43a0-9b00-cad0bcac643c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:15.673604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-382ff152-1b87-43a0-9b00-cad0bcac643c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:15.673604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:15.673604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:15.673604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:15.673604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:15.673604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:15.673604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:15.673604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:15.673604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:15.673604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:15.673604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:15.673604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:15.673604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:15.673604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:15.673604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:15.673604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:15.675435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:15.675435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:15.675435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:15.675435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:15.675435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:15.675435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:15.675435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:15.675435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:15.675435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:15.675435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:15.675435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:15.675435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:15.675435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:15.675435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:15.675435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:15.675435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:15.677018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:15.677018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:15.677018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:15.677018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:15.677018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:15.677018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:15.677018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:15.677018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:15.677018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:15.677018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:15.677018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:15.677018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:15.677018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 83/171] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 492 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:15.680208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ff152-1b87-43a0-9b00-cad0bcac643c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:15.846018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce51d8a-1e5f-463a-ade1-ff8450f6ffd2 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:15.898747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:15.928662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa2f72-adfd-4921-9a79-e3d530c3de64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:15.929781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa2f72-adfd-4921-9a79-e3d530c3de64 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:15.932763 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa2f72-adfd-4921-9a79-e3d530c3de64 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:15.933290 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa2f72-adfd-4921-9a79-e3d530c3de64 None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:15.936115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa2f72-adfd-4921-9a79-e3d530c3de64 None admin] RBAC: Authorizing `identity:get_project(project_id=612f86bc1b6c4d8ab8393c2393a01341)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:15.943546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa2f72-adfd-4921-9a79-e3d530c3de64 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:15.947600 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 89/172] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:15 2022] GET /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341 => generated 298 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:15.948824 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa2f72-adfd-4921-9a79-e3d530c3de64 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:16.086929 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ff152-1b87-43a0-9b00-cad0bcac643c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:16.155676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37972aa3-a2b2-44e7-9bf0-1f054cf2acc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:16.157199 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972aa3-a2b2-44e7-9bf0-1f054cf2acc5 None admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:16.157911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972aa3-a2b2-44e7-9bf0-1f054cf2acc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:16.158631 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972aa3-a2b2-44e7-9bf0-1f054cf2acc5 None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341/users/934e8ec20a134ae480f6677f8c64a73d/roles/4459bad5351b44b3b48d09c46d197855` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:16.163160 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37972aa3-a2b2-44e7-9bf0-1f054cf2acc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=612f86bc1b6c4d8ab8393c2393a01341, user_id=934e8ec20a134ae480f6677f8c64a73d, role_id=4459bad5351b44b3b48d09c46d197855)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:16.166297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37972aa3-a2b2-44e7-9bf0-1f054cf2acc5 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:16.200625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa2f72-adfd-4921-9a79-e3d530c3de64 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:16.249876 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fc7c1-010f-401e-a118-8adbadbfa58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:16.250568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fc7c1-010f-401e-a118-8adbadbfa58e None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:16.251000 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fc7c1-010f-401e-a118-8adbadbfa58e None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:16.251279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fc7c1-010f-401e-a118-8adbadbfa58e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:16.252070 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fc7c1-010f-401e-a118-8adbadbfa58e None admin] RBAC: Adding query filter params (role.id=d365054bc34046c5829cd1355f3a31ac, scope.project.id=612f86bc1b6c4d8ab8393c2393a01341, user.id=41222441d92243a6917a027e72480f53) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:16.252380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fc7c1-010f-401e-a118-8adbadbfa58e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:16.254942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fc7c1-010f-401e-a118-8adbadbfa58e None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:16.270983 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 90/173] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:05:15 2022] GET /identity/v3/role_assignments?user.id=41222441d92243a6917a027e72480f53&scope.project.id=612f86bc1b6c4d8ab8393c2393a01341&role.id=d365054bc34046c5829cd1355f3a31ac => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:16.270983 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fc7c1-010f-401e-a118-8adbadbfa58e None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:16.314825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 84/174] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:05:15 2022] PUT /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341/users/934e8ec20a134ae480f6677f8c64a73d/roles/4459bad5351b44b3b48d09c46d197855 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:05:16.316096 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37972aa3-a2b2-44e7-9bf0-1f054cf2acc5 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:16.411452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:16.470307 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:16.572619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fc7c1-010f-401e-a118-8adbadbfa58e None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:16.666122 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37972aa3-a2b2-44e7-9bf0-1f054cf2acc5 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:16.672242 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1e59d-26cc-4292-9ace-44d68aa6f6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:16.673419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1e59d-26cc-4292-9ace-44d68aa6f6a6 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:16.673994 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1e59d-26cc-4292-9ace-44d68aa6f6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:16.676051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1e59d-26cc-4292-9ace-44d68aa6f6a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:16.677462 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1e59d-26cc-4292-9ace-44d68aa6f6a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:16.678144 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1e59d-26cc-4292-9ace-44d68aa6f6a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:16.680870 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1e59d-26cc-4292-9ace-44d68aa6f6a6 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:16.698691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 91/175] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:16.701750 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2dab0-ed4a-4d3a-8b3e-bdde769e3b3e None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:16.702344 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2dab0-ed4a-4d3a-8b3e-bdde769e3b3e None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:16.706620 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2dab0-ed4a-4d3a-8b3e-bdde769e3b3e None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:16.706620 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 92/176] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:16.712644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2dab0-ed4a-4d3a-8b3e-bdde769e3b3e None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:16.790506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526ce15-5780-41ad-bba7-f7c183efa0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:16.791932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526ce15-5780-41ad-bba7-f7c183efa0da None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:16.792678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526ce15-5780-41ad-bba7-f7c183efa0da None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:16.793445 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526ce15-5780-41ad-bba7-f7c183efa0da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:16.795023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526ce15-5780-41ad-bba7-f7c183efa0da None admin] RBAC: Adding query filter params (role.id=a9e6249ed8cd44ce9fac74a4c8155978, scope.project.id=612f86bc1b6c4d8ab8393c2393a01341, user.id=713912ac902347b893e9f394818adf52) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:16.797571 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526ce15-5780-41ad-bba7-f7c183efa0da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:16.800596 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526ce15-5780-41ad-bba7-f7c183efa0da None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:16.813425 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 85/177] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:05:16 2022] GET /identity/v3/role_assignments?user.id=713912ac902347b893e9f394818adf52&scope.project.id=612f86bc1b6c4d8ab8393c2393a01341&role.id=a9e6249ed8cd44ce9fac74a4c8155978 => generated 608 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:16.818091 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae26c78-5277-4b4a-8e42-d568671e38e7 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:16.819071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae26c78-5277-4b4a-8e42-d568671e38e7 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:16.819861 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae26c78-5277-4b4a-8e42-d568671e38e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:16.859714 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-6ae26c78-5277-4b4a-8e42-d568671e38e7 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:16.862277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-6ae26c78-5277-4b4a-8e42-d568671e38e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:16.948247 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2dab0-ed4a-4d3a-8b3e-bdde769e3b3e None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:16.975137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:17.019435 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27e74b-d329-40ef-93e0-1c33fb9b25bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:17.020906 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27e74b-d329-40ef-93e0-1c33fb9b25bd None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:17.021406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27e74b-d329-40ef-93e0-1c33fb9b25bd None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:17.021896 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27e74b-d329-40ef-93e0-1c33fb9b25bd None admin] PATH_INFO: `/v3/users/713912ac902347b893e9f394818adf52` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:17.024534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27e74b-d329-40ef-93e0-1c33fb9b25bd None admin] RBAC: Authorizing `identity:get_user(user_id=713912ac902347b893e9f394818adf52)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:17.025967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 86/178] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:17.027377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ae4a4-0ed3-4c58-bab1-42a896c0dfc0 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:17.027506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27e74b-d329-40ef-93e0-1c33fb9b25bd None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:17.027684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ae4a4-0ed3-4c58-bab1-42a896c0dfc0 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:17.027928 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ae4a4-0ed3-4c58-bab1-42a896c0dfc0 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:17.029329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 87/179] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:17.030629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 93/180] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:16 2022] GET /identity/v3/users/713912ac902347b893e9f394818adf52 => generated 275 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:17.036382 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717d6ee-4e6e-4fce-865f-74c191abace7 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:17.036686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717d6ee-4e6e-4fce-865f-74c191abace7 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:17.037000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717d6ee-4e6e-4fce-865f-74c191abace7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:17.037728 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27e74b-d329-40ef-93e0-1c33fb9b25bd None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:17.066039 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-2717d6ee-4e6e-4fce-865f-74c191abace7 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:17.067419 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-2717d6ee-4e6e-4fce-865f-74c191abace7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:17.145679 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:17.226851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 88/181] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:17.229413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72554446-b77f-476f-abd3-7ac95c511422 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:17.231030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72554446-b77f-476f-abd3-7ac95c511422 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:17.233225 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72554446-b77f-476f-abd3-7ac95c511422 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:17.237626 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 89/182] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:17.247049 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46429ea-a618-43c0-a0e6-909b20283cb5 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:17.247531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46429ea-a618-43c0-a0e6-909b20283cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:17.247968 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46429ea-a618-43c0-a0e6-909b20283cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:17.263199 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27e74b-d329-40ef-93e0-1c33fb9b25bd None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:17.312206 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-d46429ea-a618-43c0-a0e6-909b20283cb5 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:17.313695 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d46429ea-a618-43c0-a0e6-909b20283cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:17.351877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eec30-b1bb-4de5-8ed8-29a1b354dca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:17.353578 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eec30-b1bb-4de5-8ed8-29a1b354dca0 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:17.354046 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eec30-b1bb-4de5-8ed8-29a1b354dca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:17.354531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eec30-b1bb-4de5-8ed8-29a1b354dca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:17.435528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 90/183] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:17.437050 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46429ea-a618-43c0-a0e6-909b20283cb5 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:17.452076 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:17.481182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80eec30-b1bb-4de5-8ed8-29a1b354dca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:17.483727 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80eec30-b1bb-4de5-8ed8-29a1b354dca0 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:17.644250 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:17.650889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46429ea-a618-43c0-a0e6-909b20283cb5 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:17.767958 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e04f2b-e53a-4873-ab3e-8fd7c55f8e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:17.769243 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e04f2b-e53a-4873-ab3e-8fd7c55f8e28 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:17.769728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e04f2b-e53a-4873-ab3e-8fd7c55f8e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:17.770205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e04f2b-e53a-4873-ab3e-8fd7c55f8e28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:17.779172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 94/184] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:05:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 737 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:05:17.779172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eec30-b1bb-4de5-8ed8-29a1b354dca0 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:17.796390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e04f2b-e53a-4873-ab3e-8fd7c55f8e28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:17.806697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-e9e04f2b-e53a-4873-ab3e-8fd7c55f8e28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:05:17.806697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:17.806697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:17.806697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:17.806697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:17.806697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:17.806697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:17.806697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:17.806697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:17.806697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:17.806697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:17.806697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:17.806697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:17.806697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:17.806697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:17.806697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:17.808448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:17.808448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:17.808448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:17.808448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:17.808448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:17.808448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:17.808448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:17.808448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:17.808448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:17.808448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:17.808448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:17.808448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:17.808448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:17.808448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:17.808448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:17.808448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:17.810002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:17.810002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:17.810002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:17.810002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:17.810002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:17.810002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:17.810002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:17.810002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:17.810002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:17.810002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:17.810002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:05:17.810002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:17.810002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 91/185] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:05:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:17.811285 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e04f2b-e53a-4873-ab3e-8fd7c55f8e28 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:17.955149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:17.991963 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eec30-b1bb-4de5-8ed8-29a1b354dca0 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:18.008466 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e04f2b-e53a-4873-ab3e-8fd7c55f8e28 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:18.043852 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b303c19-8b88-43dd-b9bc-85641746f833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:18.044875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b303c19-8b88-43dd-b9bc-85641746f833 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:18.045292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b303c19-8b88-43dd-b9bc-85641746f833 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:18.045702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b303c19-8b88-43dd-b9bc-85641746f833 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:18.061833 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b303c19-8b88-43dd-b9bc-85641746f833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:18.072629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-8b303c19-8b88-43dd-b9bc-85641746f833 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:05:18.072629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:18.072629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:18.072629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:18.072629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:18.072629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:18.072629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:18.072629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:18.072629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:18.072629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:18.072629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:18.072629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:18.072629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:18.072629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:18.072629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:18.072629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:18.074782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:18.074782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:18.074782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:18.074782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:18.074782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:18.074782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:18.074782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:18.074782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:18.074782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:18.074782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:18.074782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:18.074782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:18.074782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:18.074782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:18.074782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:18.074782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:18.076952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:18.076952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:18.076952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:18.076952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:18.076952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:18.076952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:18.076952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:18.076952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:18.076952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:18.076952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:18.076952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:05:18.076952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:05:18.076952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 95/186] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:05:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:18.080591 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b303c19-8b88-43dd-b9bc-85641746f833 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:18.086193 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf9642-b9af-4dbe-8759-790fbc2b551d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:18.087128 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf9642-b9af-4dbe-8759-790fbc2b551d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:18.088606 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf9642-b9af-4dbe-8759-790fbc2b551d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:18.088606 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf9642-b9af-4dbe-8759-790fbc2b551d None admin] PATH_INFO: `/v3/projects/27f784c700f043b4b38ba51d84245655` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:18.090386 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf9642-b9af-4dbe-8759-790fbc2b551d None admin] RBAC: Authorizing `identity:get_project(project_id=27f784c700f043b4b38ba51d84245655)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:18.093273 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf9642-b9af-4dbe-8759-790fbc2b551d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:18.104900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 92/187] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:17 2022] GET /identity/v3/projects/27f784c700f043b4b38ba51d84245655 => generated 312 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:18.104900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf9642-b9af-4dbe-8759-790fbc2b551d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:18.161108 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:18.246117 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b303c19-8b88-43dd-b9bc-85641746f833 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:18.300069 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf9642-b9af-4dbe-8759-790fbc2b551d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:18.314575 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc1e76-e771-4ed6-87ad-d7ce9fc0db69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:18.315571 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc1e76-e771-4ed6-87ad-d7ce9fc0db69 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:18.316022 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc1e76-e771-4ed6-87ad-d7ce9fc0db69 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:18.316471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc1e76-e771-4ed6-87ad-d7ce9fc0db69 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:18.317628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc1e76-e771-4ed6-87ad-d7ce9fc0db69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:18.318124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc1e76-e771-4ed6-87ad-d7ce9fc0db69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:18.320945 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc1e76-e771-4ed6-87ad-d7ce9fc0db69 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:18.336120 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 96/188] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:18.338988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc1e76-e771-4ed6-87ad-d7ce9fc0db69 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:18.347067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:18.358864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4754a-2907-446e-8bd5-1740cbd36d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:18.359743 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4754a-2907-446e-8bd5-1740cbd36d88 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:18.360180 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4754a-2907-446e-8bd5-1740cbd36d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:18.360605 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4754a-2907-446e-8bd5-1740cbd36d88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:18.362046 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4754a-2907-446e-8bd5-1740cbd36d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:18.364140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4754a-2907-446e-8bd5-1740cbd36d88 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:18.367082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 93/189] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:05:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:18.368018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4754a-2907-446e-8bd5-1740cbd36d88 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:18.527318 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:18.536743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc1e76-e771-4ed6-87ad-d7ce9fc0db69 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:18.537717 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4754a-2907-446e-8bd5-1740cbd36d88 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:18.584338 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fe69d-c30a-459a-a519-cfa245032c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:18.585307 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fe69d-c30a-459a-a519-cfa245032c26 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:18.585800 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fe69d-c30a-459a-a519-cfa245032c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:18.586377 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fe69d-c30a-459a-a519-cfa245032c26 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:18.587591 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fe69d-c30a-459a-a519-cfa245032c26 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:18.588161 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fe69d-c30a-459a-a519-cfa245032c26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:18.590505 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fe69d-c30a-459a-a519-cfa245032c26 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:18.601063 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ffc7c-97bb-4edb-84b3-6e345023fe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:18.602131 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ffc7c-97bb-4edb-84b3-6e345023fe7e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:18.602662 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ffc7c-97bb-4edb-84b3-6e345023fe7e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:18.603156 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ffc7c-97bb-4edb-84b3-6e345023fe7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:18.604565 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ffc7c-97bb-4edb-84b3-6e345023fe7e None admin] RBAC: Adding query filter params (role.id=986891361f4f4893a1cb2d0e0b523bff, scope.project.id=27f784c700f043b4b38ba51d84245655, user.id=713912ac902347b893e9f394818adf52) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:18.605127 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ffc7c-97bb-4edb-84b3-6e345023fe7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:18.607992 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ffc7c-97bb-4edb-84b3-6e345023fe7e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:18.609711 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 97/190] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:05:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:18.611594 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fe69d-c30a-459a-a519-cfa245032c26 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:18.623550 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 94/191] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:05:18 2022] GET /identity/v3/role_assignments?user.id=713912ac902347b893e9f394818adf52&scope.project.id=27f784c700f043b4b38ba51d84245655&role.id=986891361f4f4893a1cb2d0e0b523bff => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:18.625348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ffc7c-97bb-4edb-84b3-6e345023fe7e None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:18.775002 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:18.843903 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ffc7c-97bb-4edb-84b3-6e345023fe7e None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:18.879434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fe69d-c30a-459a-a519-cfa245032c26 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:18.933973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0e321-2096-494f-99d9-a97c8bfa851e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:18.935722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0e321-2096-494f-99d9-a97c8bfa851e None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:18.936201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0e321-2096-494f-99d9-a97c8bfa851e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:18.936684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0e321-2096-494f-99d9-a97c8bfa851e None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:18.938131 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0e321-2096-494f-99d9-a97c8bfa851e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:18.942872 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0e321-2096-494f-99d9-a97c8bfa851e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:18.960953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec175cfd-c429-4754-93d5-7f9fea9d59c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:18.962161 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec175cfd-c429-4754-93d5-7f9fea9d59c7 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:18.962686 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec175cfd-c429-4754-93d5-7f9fea9d59c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:18.963171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec175cfd-c429-4754-93d5-7f9fea9d59c7 None admin] PATH_INFO: `/v3/users/50ba6cdf8d4446b6a743f28a9660fcce` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:18.994423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec175cfd-c429-4754-93d5-7f9fea9d59c7 None admin] RBAC: Authorizing `identity:get_user(user_id=50ba6cdf8d4446b6a743f28a9660fcce)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:18.997419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec175cfd-c429-4754-93d5-7f9fea9d59c7 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:19.000806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 98/192] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:18 2022] GET /identity/v3/users/50ba6cdf8d4446b6a743f28a9660fcce => generated 283 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:19.004164 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec175cfd-c429-4754-93d5-7f9fea9d59c7 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:19.066330 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 95/193] 10.222.0.83 () {60 vars in 1132 bytes} [Fri Sep 23 01:05:18 2022] POST /identity/v3/users => generated 297 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:05:19.071928 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0e321-2096-494f-99d9-a97c8bfa851e None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:19.127599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:19.259401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec175cfd-c429-4754-93d5-7f9fea9d59c7 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:19.294839 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:19.314393 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e4518-1275-4ec7-9eea-688a40f78371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:19.315127 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e4518-1275-4ec7-9eea-688a40f78371 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:19.315425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e4518-1275-4ec7-9eea-688a40f78371 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:19.315675 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e4518-1275-4ec7-9eea-688a40f78371 None admin] PATH_INFO: `/v3/users/50ba6cdf8d4446b6a743f28a9660fcce` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:19.317140 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e4518-1275-4ec7-9eea-688a40f78371 None admin] RBAC: Authorizing `identity:get_user(user_id=50ba6cdf8d4446b6a743f28a9660fcce)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:19.319521 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e4518-1275-4ec7-9eea-688a40f78371 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:19.320814 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0e321-2096-494f-99d9-a97c8bfa851e None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:19.329143 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 99/194] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:19 2022] GET /identity/v3/users/50ba6cdf8d4446b6a743f28a9660fcce => generated 283 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:19.331250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e4518-1275-4ec7-9eea-688a40f78371 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:19.392293 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0e582-2528-4e89-894a-e249a7dcbe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:19.392853 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0e582-2528-4e89-894a-e249a7dcbe01 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:19.394873 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0e582-2528-4e89-894a-e249a7dcbe01 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:19.395276 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0e582-2528-4e89-894a-e249a7dcbe01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:19.562388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e4518-1275-4ec7-9eea-688a40f78371 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:19.569590 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0e582-2528-4e89-894a-e249a7dcbe01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:19.571719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0e582-2528-4e89-894a-e249a7dcbe01 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:19.605725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:19.661179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd86d5-b6e3-45db-aa1c-e4bd1aae2a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:19.662940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd86d5-b6e3-45db-aa1c-e4bd1aae2a2e None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:19.663801 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd86d5-b6e3-45db-aa1c-e4bd1aae2a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:19.664564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd86d5-b6e3-45db-aa1c-e4bd1aae2a2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:19.780294 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 96/195] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:05:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:05:19.792112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0e582-2528-4e89-894a-e249a7dcbe01 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:19.802184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:19.829651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd86d5-b6e3-45db-aa1c-e4bd1aae2a2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:19.832804 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd86d5-b6e3-45db-aa1c-e4bd1aae2a2e None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:19.986730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0e582-2528-4e89-894a-e249a7dcbe01 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:20.012797 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:20.046615 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f69e9-1724-4e44-856c-b2ed0fa685b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:20.050281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f69e9-1724-4e44-856c-b2ed0fa685b4 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:20.050814 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f69e9-1724-4e44-856c-b2ed0fa685b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:20.051319 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f69e9-1724-4e44-856c-b2ed0fa685b4 None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:20.057176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f69e9-1724-4e44-856c-b2ed0fa685b4 None admin] RBAC: Authorizing `identity:get_project(project_id=6d9e32fd96ae4748a30237bde6c1463f)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:20.060087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f69e9-1724-4e44-856c-b2ed0fa685b4 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:20.063628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 97/196] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:19 2022] GET /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:20.072991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f69e9-1724-4e44-856c-b2ed0fa685b4 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:20.148297 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 100/197] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:05:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 817 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 01:05:20.152277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241be6f8-7459-4352-b3be-12f2c52097b9 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:20.152768 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241be6f8-7459-4352-b3be-12f2c52097b9 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:20.153225 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241be6f8-7459-4352-b3be-12f2c52097b9 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:20.156509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 101/198] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:20.157779 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241be6f8-7459-4352-b3be-12f2c52097b9 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:20.323699 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f69e9-1724-4e44-856c-b2ed0fa685b4 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:20.332196 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:20.345633 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241be6f8-7459-4352-b3be-12f2c52097b9 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:20.398338 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf95f2f-feaa-4a5a-96f7-ad9b6efbd4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:20.399421 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf95f2f-feaa-4a5a-96f7-ad9b6efbd4fc None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:20.399768 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf95f2f-feaa-4a5a-96f7-ad9b6efbd4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:20.400148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf95f2f-feaa-4a5a-96f7-ad9b6efbd4fc None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:20.401694 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf95f2f-feaa-4a5a-96f7-ad9b6efbd4fc None admin] RBAC: Authorizing `identity:get_project(project_id=6d9e32fd96ae4748a30237bde6c1463f)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:20.403583 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf95f2f-feaa-4a5a-96f7-ad9b6efbd4fc None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:20.405910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 102/199] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:20 2022] GET /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:20.407403 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770b977-edae-482d-9363-9b0b98e31414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:20.408705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770b977-edae-482d-9363-9b0b98e31414 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:20.409400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770b977-edae-482d-9363-9b0b98e31414 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:20.410076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770b977-edae-482d-9363-9b0b98e31414 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:20.411726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770b977-edae-482d-9363-9b0b98e31414 None admin] RBAC: Adding query filter params (role.id=d365054bc34046c5829cd1355f3a31ac, scope.project.id=6d9e32fd96ae4748a30237bde6c1463f, user.id=50ba6cdf8d4446b6a743f28a9660fcce) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:20.413123 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770b977-edae-482d-9363-9b0b98e31414 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:20.413302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaba600-7dfa-4480-82cb-b60b8e010890 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:20.413463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaba600-7dfa-4480-82cb-b60b8e010890 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:20.413697 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaba600-7dfa-4480-82cb-b60b8e010890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:20.416803 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770b977-edae-482d-9363-9b0b98e31414 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:20.434357 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 98/200] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:05:20 2022] GET /identity/v3/role_assignments?user.id=50ba6cdf8d4446b6a743f28a9660fcce&scope.project.id=6d9e32fd96ae4748a30237bde6c1463f&role.id=d365054bc34046c5829cd1355f3a31ac => generated 259 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:20.435058 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770b977-edae-482d-9363-9b0b98e31414 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:20.442128 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-dcaba600-7dfa-4480-82cb-b60b8e010890 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:20.444846 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-dcaba600-7dfa-4480-82cb-b60b8e010890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:20.510494 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:20.583443 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770b977-edae-482d-9363-9b0b98e31414 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:20.599849 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 103/201] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:20.679940 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a8842-a10c-4933-b657-d308f1377c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:20.681365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a8842-a10c-4933-b657-d308f1377c31 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:20.682064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a8842-a10c-4933-b657-d308f1377c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:20.682854 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a8842-a10c-4933-b657-d308f1377c31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:20.684449 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a8842-a10c-4933-b657-d308f1377c31 None admin] RBAC: Adding query filter params (role.id=a9e6249ed8cd44ce9fac74a4c8155978, scope.project.id=6d9e32fd96ae4748a30237bde6c1463f, user.id=50ba6cdf8d4446b6a743f28a9660fcce) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:20.685238 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a8842-a10c-4933-b657-d308f1377c31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:20.688264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a8842-a10c-4933-b657-d308f1377c31 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:20.704118 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 99/202] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:05:20 2022] GET /identity/v3/role_assignments?user.id=50ba6cdf8d4446b6a743f28a9660fcce&scope.project.id=6d9e32fd96ae4748a30237bde6c1463f&role.id=a9e6249ed8cd44ce9fac74a4c8155978 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:21.154515 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaba600-7dfa-4480-82cb-b60b8e010890 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:21.430551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:21.471497 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaba600-7dfa-4480-82cb-b60b8e010890 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:21.552170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cba95-a4f9-46f9-a6fc-f9c8fbcf7ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:21.553143 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cba95-a4f9-46f9-a6fc-f9c8fbcf7ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:21.553483 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cba95-a4f9-46f9-a6fc-f9c8fbcf7ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:21.562893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cba95-a4f9-46f9-a6fc-f9c8fbcf7ce7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:21.593740 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730cba95-a4f9-46f9-a6fc-f9c8fbcf7ce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:21.603556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-730cba95-a4f9-46f9-a6fc-f9c8fbcf7ce7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 01:05:21.603556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:21.603556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:21.603556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:21.603556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:21.603556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:21.603556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:21.603556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:21.603556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:21.603556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:21.603556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:21.603556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:21.603556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:21.603556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:21.603556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:21.603556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:21.605184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:21.605184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:21.605184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:21.605184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:21.605184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:21.605184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:21.605184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:21.605184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:21.605184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:21.605184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:21.605184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:21.605184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:21.605184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:21.605184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:21.605184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:21.605184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:21.606691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:21.606691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:21.606691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:21.606691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:21.606691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:21.606691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:21.606691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:21.606691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:21.606691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:21.606691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:21.606691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 01:05:21.606691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:05:21.606691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 104/203] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:05:21.611991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a8842-a10c-4933-b657-d308f1377c31 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:21.820462 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a8842-a10c-4933-b657-d308f1377c31 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:21.838297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:21.864596 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133abfff-72bb-4cf1-ba4e-fac8920392ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:21.865894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133abfff-72bb-4cf1-ba4e-fac8920392ab None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:21.866178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133abfff-72bb-4cf1-ba4e-fac8920392ab None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:21.866451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133abfff-72bb-4cf1-ba4e-fac8920392ab None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:21.867203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133abfff-72bb-4cf1-ba4e-fac8920392ab None admin] RBAC: Adding query filter params (name=reader) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:21.867507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133abfff-72bb-4cf1-ba4e-fac8920392ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:21.869234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133abfff-72bb-4cf1-ba4e-fac8920392ab None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:21.880107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 100/204] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:21.892645 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cba95-a4f9-46f9-a6fc-f9c8fbcf7ce7 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:22.070984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cba95-a4f9-46f9-a6fc-f9c8fbcf7ce7 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:22.143000 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1884f4f-4740-48c9-abd8-948e2b12c8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:22.144057 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1884f4f-4740-48c9-abd8-948e2b12c8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:22.144503 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1884f4f-4740-48c9-abd8-948e2b12c8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:22.144930 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1884f4f-4740-48c9-abd8-948e2b12c8f7 None admin] PATH_INFO: `/v3/users/934e8ec20a134ae480f6677f8c64a73d` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:22.148349 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1884f4f-4740-48c9-abd8-948e2b12c8f7 None admin] RBAC: Authorizing `identity:get_user(user_id=934e8ec20a134ae480f6677f8c64a73d)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:22.149981 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1884f4f-4740-48c9-abd8-948e2b12c8f7 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:22.151942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 105/205] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:21 2022] GET /identity/v3/users/934e8ec20a134ae480f6677f8c64a73d => generated 289 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:22.159531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133abfff-72bb-4cf1-ba4e-fac8920392ab None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:22.336213 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133abfff-72bb-4cf1-ba4e-fac8920392ab None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:22.406825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786426b-4511-4d1f-b9a8-ccb43aea767c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:22.407909 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786426b-4511-4d1f-b9a8-ccb43aea767c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:22.408479 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786426b-4511-4d1f-b9a8-ccb43aea767c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:22.408779 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786426b-4511-4d1f-b9a8-ccb43aea767c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:22.485698 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:22.521976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786426b-4511-4d1f-b9a8-ccb43aea767c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:22.524084 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786426b-4511-4d1f-b9a8-ccb43aea767c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:22.679062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 101/206] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:05:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 01:05:22.685308 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1884f4f-4740-48c9-abd8-948e2b12c8f7 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:22.710910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:22.823457 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1884f4f-4740-48c9-abd8-948e2b12c8f7 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:22.874745 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c153b0-3b13-499f-8a01-2f008a9235a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:22.875799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c153b0-3b13-499f-8a01-2f008a9235a0 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:22.876292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c153b0-3b13-499f-8a01-2f008a9235a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:22.876757 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c153b0-3b13-499f-8a01-2f008a9235a0 None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:22.878309 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c153b0-3b13-499f-8a01-2f008a9235a0 None admin] RBAC: Authorizing `identity:get_project(project_id=612f86bc1b6c4d8ab8393c2393a01341)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:22.880162 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c153b0-3b13-499f-8a01-2f008a9235a0 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:22.883300 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 106/207] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:22 2022] GET /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:22.895569 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786426b-4511-4d1f-b9a8-ccb43aea767c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:22.989534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1baeaf-ddc2-4120-b900-a56cbb150387 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:22.989728 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1baeaf-ddc2-4120-b900-a56cbb150387 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:22.990141 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1baeaf-ddc2-4120-b900-a56cbb150387 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:22.992115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 107/208] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:23.007890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c844351-5614-452b-a145-eb0798253909 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:23.008258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c844351-5614-452b-a145-eb0798253909 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:23.008503 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c844351-5614-452b-a145-eb0798253909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:23.045113 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-9c844351-5614-452b-a145-eb0798253909 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:23.047052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-9c844351-5614-452b-a145-eb0798253909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:23.059726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:23.150285 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786426b-4511-4d1f-b9a8-ccb43aea767c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:23.222932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 108/209] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:23.256807 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc4524-980c-4312-ba3d-5b98b6fd8c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:23.257871 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc4524-980c-4312-ba3d-5b98b6fd8c92 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:23.258374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc4524-980c-4312-ba3d-5b98b6fd8c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:23.258916 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc4524-980c-4312-ba3d-5b98b6fd8c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:23.260347 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc4524-980c-4312-ba3d-5b98b6fd8c92 None admin] RBAC: Adding query filter params (role.id=4459bad5351b44b3b48d09c46d197855, scope.project.id=612f86bc1b6c4d8ab8393c2393a01341, user.id=934e8ec20a134ae480f6677f8c64a73d) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:23.260926 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc4524-980c-4312-ba3d-5b98b6fd8c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:23.272483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc4524-980c-4312-ba3d-5b98b6fd8c92 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:23.291454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 102/210] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:05:22 2022] GET /identity/v3/role_assignments?user.id=934e8ec20a134ae480f6677f8c64a73d&scope.project.id=612f86bc1b6c4d8ab8393c2393a01341&role.id=4459bad5351b44b3b48d09c46d197855 => generated 608 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:23.331136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00e058-76db-4451-b43b-8b420d8808f4 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:23.331413 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00e058-76db-4451-b43b-8b420d8808f4 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:23.331751 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00e058-76db-4451-b43b-8b420d8808f4 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:23.333269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 109/211] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:23.341539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff33ae-1910-4988-8f54-a8045853d674 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:23.342026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff33ae-1910-4988-8f54-a8045853d674 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:23.342522 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff33ae-1910-4988-8f54-a8045853d674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:23.392687 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-70ff33ae-1910-4988-8f54-a8045853d674 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:23.395062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-70ff33ae-1910-4988-8f54-a8045853d674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:23.529824 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00e058-76db-4451-b43b-8b420d8808f4 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:23.554994 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:23.583010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 103/212] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:05:23.676675 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00e058-76db-4451-b43b-8b420d8808f4 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:23.749001 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3fcba-a593-4c6e-83e4-70615e1726df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:23.751111 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3fcba-a593-4c6e-83e4-70615e1726df None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:23.751819 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3fcba-a593-4c6e-83e4-70615e1726df None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:23.752515 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3fcba-a593-4c6e-83e4-70615e1726df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:23.774770 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3fcba-a593-4c6e-83e4-70615e1726df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:23.788073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-39f3fcba-a593-4c6e-83e4-70615e1726df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:23.788073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:23.788073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:23.788073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:23.788073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:23.788073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:23.788073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:23.788073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:23.788073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:23.788073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:23.788073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:23.788073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:23.788073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:23.788073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:23.788073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:23.788073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:23.789767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:23.789767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:23.789767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:23.789767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:23.789767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:23.789767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:23.789767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:23.789767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:23.789767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:23.789767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:23.789767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:23.789767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:23.789767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:23.789767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:23.789767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:23.789767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:23.791351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:23.791351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:23.791351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:23.791351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:23.791351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:23.791351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:23.791351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:23.791351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:23.791351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:23.791351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:23.791351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:23.791351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:05:23.796182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 110/213] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:05:23.802513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff33ae-1910-4988-8f54-a8045853d674 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:23.929151 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:24.004931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff33ae-1910-4988-8f54-a8045853d674 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:24.012290 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3fcba-a593-4c6e-83e4-70615e1726df None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:24.062262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb06784-11b6-4680-a17b-dfd3ae2dd1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:24.063133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb06784-11b6-4680-a17b-dfd3ae2dd1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:24.063452 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb06784-11b6-4680-a17b-dfd3ae2dd1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:24.065254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb06784-11b6-4680-a17b-dfd3ae2dd1e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:24.065898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb06784-11b6-4680-a17b-dfd3ae2dd1e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:24.066203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb06784-11b6-4680-a17b-dfd3ae2dd1e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:24.067704 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb06784-11b6-4680-a17b-dfd3ae2dd1e3 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:24.078642 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 104/214] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:24.090105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb06784-11b6-4680-a17b-dfd3ae2dd1e3 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:24.147227 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:24.175253 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3fcba-a593-4c6e-83e4-70615e1726df None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:24.220913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c474d9-833e-41f2-8446-a7e1fadffa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:24.221754 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c474d9-833e-41f2-8446-a7e1fadffa64 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:24.222140 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c474d9-833e-41f2-8446-a7e1fadffa64 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:24.223065 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c474d9-833e-41f2-8446-a7e1fadffa64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:24.225207 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c474d9-833e-41f2-8446-a7e1fadffa64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:24.227354 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c474d9-833e-41f2-8446-a7e1fadffa64 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:24.229646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 111/215] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:05:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:24.236706 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c474d9-833e-41f2-8446-a7e1fadffa64 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:24.306658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb06784-11b6-4680-a17b-dfd3ae2dd1e3 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:24.367685 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:24.378626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c474d9-833e-41f2-8446-a7e1fadffa64 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:24.380133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d864505-549a-491b-b386-6a0d0d74df8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:24.380978 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d864505-549a-491b-b386-6a0d0d74df8f None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:24.381581 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d864505-549a-491b-b386-6a0d0d74df8f None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:24.382178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d864505-549a-491b-b386-6a0d0d74df8f None admin] PATH_INFO: `/v3/users/7fc2eae458ee4cb5b7e95afd90186f99` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:24.409386 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d864505-549a-491b-b386-6a0d0d74df8f None admin] RBAC: Authorizing `identity:get_user(user_id=7fc2eae458ee4cb5b7e95afd90186f99)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:24.412851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d864505-549a-491b-b386-6a0d0d74df8f None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:24.422748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 105/216] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:24 2022] GET /identity/v3/users/7fc2eae458ee4cb5b7e95afd90186f99 => generated 297 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:24.426797 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d864505-549a-491b-b386-6a0d0d74df8f None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:24.426976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5f831-eb79-48d2-ad77-57cc39fa5788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:24.428283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5f831-eb79-48d2-ad77-57cc39fa5788 None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:24.428619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5f831-eb79-48d2-ad77-57cc39fa5788 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:24.428926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5f831-eb79-48d2-ad77-57cc39fa5788 None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:24.429648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5f831-eb79-48d2-ad77-57cc39fa5788 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:24.431230 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5f831-eb79-48d2-ad77-57cc39fa5788 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:24.546008 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:24.552187 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 112/217] 10.222.0.83 () {60 vars in 1132 bytes} [Fri Sep 23 01:05:24 2022] POST /identity/v3/users => generated 297 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:05:24.657659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d864505-549a-491b-b386-6a0d0d74df8f None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:24.732845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176fa2f-9949-4a6e-9d22-48046dcca345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:24.733906 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176fa2f-9949-4a6e-9d22-48046dcca345 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:24.734379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176fa2f-9949-4a6e-9d22-48046dcca345 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:24.734892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176fa2f-9949-4a6e-9d22-48046dcca345 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:24.835232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:24.857439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c013a3-7fc5-4664-aae9-6afa6cb03fb4 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:24.858187 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c013a3-7fc5-4664-aae9-6afa6cb03fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:24.858187 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c013a3-7fc5-4664-aae9-6afa6cb03fb4 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:24.859927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 113/218] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:24.865590 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176fa2f-9949-4a6e-9d22-48046dcca345 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:24.865590 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176fa2f-9949-4a6e-9d22-48046dcca345 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:24.870312 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cabe88-b55d-4848-854d-f4b9babd1073 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:24.870521 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cabe88-b55d-4848-854d-f4b9babd1073 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:24.871820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cabe88-b55d-4848-854d-f4b9babd1073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:24.901770 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-46cabe88-b55d-4848-854d-f4b9babd1073 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:24.902829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-46cabe88-b55d-4848-854d-f4b9babd1073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:25.022277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 106/219] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:05:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 01:05:25.023741 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577842ca-0c84-4e0e-a904-59cd0698e4e8 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:25.024160 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577842ca-0c84-4e0e-a904-59cd0698e4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:25.024448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577842ca-0c84-4e0e-a904-59cd0698e4e8 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:25.025956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 107/220] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:25.032207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43ef86-a71e-4e21-9ca4-75d675bb6fe8 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:25.032468 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43ef86-a71e-4e21-9ca4-75d675bb6fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:25.032791 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43ef86-a71e-4e21-9ca4-75d675bb6fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:25.033424 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 114/221] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:05:25.035110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cabe88-b55d-4848-854d-f4b9babd1073 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:25.056493 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-5e43ef86-a71e-4e21-9ca4-75d675bb6fe8 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:25.057760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-5e43ef86-a71e-4e21-9ca4-75d675bb6fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:25.154458 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 108/222] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:05:25.253549 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cabe88-b55d-4848-854d-f4b9babd1073 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:25.312102 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:25.323757 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e4133-198f-4a20-9256-080f7d7caee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:25.324897 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e4133-198f-4a20-9256-080f7d7caee6 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:25.325328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e4133-198f-4a20-9256-080f7d7caee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:25.326041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e4133-198f-4a20-9256-080f7d7caee6 None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:25.328099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e4133-198f-4a20-9256-080f7d7caee6 None admin] RBAC: Authorizing `identity:get_project(project_id=6d9e32fd96ae4748a30237bde6c1463f)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:25.330748 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e4133-198f-4a20-9256-080f7d7caee6 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:25.334151 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 115/223] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:25 2022] GET /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:25.343868 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43ef86-a71e-4e21-9ca4-75d675bb6fe8 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:25.400769 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:25.596398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e4133-198f-4a20-9256-080f7d7caee6 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:25.613354 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43ef86-a71e-4e21-9ca4-75d675bb6fe8 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:25.699131 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ec985-7e02-48b9-a124-f6c6972d740e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:25.700157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ec985-7e02-48b9-a124-f6c6972d740e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:25.700637 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ec985-7e02-48b9-a124-f6c6972d740e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:25.701111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ec985-7e02-48b9-a124-f6c6972d740e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:25.702467 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ec985-7e02-48b9-a124-f6c6972d740e None admin] RBAC: Adding query filter params (role.id=986891361f4f4893a1cb2d0e0b523bff, scope.project.id=6d9e32fd96ae4748a30237bde6c1463f, user.id=7fc2eae458ee4cb5b7e95afd90186f99) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:25.703018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ec985-7e02-48b9-a124-f6c6972d740e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:25.705978 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ec985-7e02-48b9-a124-f6c6972d740e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:25.717124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 109/224] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:05:25 2022] GET /identity/v3/role_assignments?user.id=7fc2eae458ee4cb5b7e95afd90186f99&scope.project.id=6d9e32fd96ae4748a30237bde6c1463f&role.id=986891361f4f4893a1cb2d0e0b523bff => generated 259 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:25.722866 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ec985-7e02-48b9-a124-f6c6972d740e None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:25.835283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e4133-198f-4a20-9256-080f7d7caee6 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:25.945262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fac61-974b-434e-bfb2-b26ebb4686b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:25.946663 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fac61-974b-434e-bfb2-b26ebb4686b9 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:25.947541 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fac61-974b-434e-bfb2-b26ebb4686b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:25.948169 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fac61-974b-434e-bfb2-b26ebb4686b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:25.970073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fac61-974b-434e-bfb2-b26ebb4686b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:25.982625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-088fac61-974b-434e-bfb2-b26ebb4686b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:05:25.982625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:25.982625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:25.982625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:25.982625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:25.982625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:25.982625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:25.982625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:25.982625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:25.982625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:25.982625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:25.982625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:25.982625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:25.982625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:25.982625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:25.982625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:25.984316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:25.984316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:25.984316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:25.984316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:25.984316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:25.984316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:25.984316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:25.984316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:25.984316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:25.984316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:25.984316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:25.984316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:25.984316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:25.984316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:25.984316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:25.984316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:25.985743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:25.985743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:25.985743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:25.985743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:25.985743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:25.985743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:25.985743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:25.985743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:25.985743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:25.985743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:25.985743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:05:25.985743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:05:25.985743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 116/225] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:05:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:05:25.994235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fac61-974b-434e-bfb2-b26ebb4686b9 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:25.997458 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:26.028662 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ec985-7e02-48b9-a124-f6c6972d740e None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:26.098710 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d020fc-313e-4b18-b7a8-4f5dd120762c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:26.099992 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d020fc-313e-4b18-b7a8-4f5dd120762c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:26.100310 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d020fc-313e-4b18-b7a8-4f5dd120762c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:26.100601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d020fc-313e-4b18-b7a8-4f5dd120762c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:26.121402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d020fc-313e-4b18-b7a8-4f5dd120762c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:26.123137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:26.129677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-02d020fc-313e-4b18-b7a8-4f5dd120762c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:05:26.129677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:26.129677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:26.129677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:26.129677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:26.129677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:26.129677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:26.129677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:26.129677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:26.129677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:26.129677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:26.129677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:26.129677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:26.129677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:26.129677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:26.129677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:26.133097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:26.133097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:26.133097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:26.133097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:26.133097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:26.133097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:26.133097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:26.133097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:26.133097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:26.133097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:26.133097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:26.133097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:26.133097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:26.133097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:26.133097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:26.133097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:26.135925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:26.135925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:26.135925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:26.135925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:26.135925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:26.135925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:26.135925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:26.135925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:26.135925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:26.135925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:26.135925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:05:26.135925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:26.135925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 110/226] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:05:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:26.144594 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d020fc-313e-4b18-b7a8-4f5dd120762c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:26.261111 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fac61-974b-434e-bfb2-b26ebb4686b9 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:26.340338 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd684edc-de93-43b4-b83c-4b76ecc3db2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:26.341404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd684edc-de93-43b4-b83c-4b76ecc3db2d None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:26.341908 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd684edc-de93-43b4-b83c-4b76ecc3db2d None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:26.342406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd684edc-de93-43b4-b83c-4b76ecc3db2d None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:26.343718 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd684edc-de93-43b4-b83c-4b76ecc3db2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:26.344266 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd684edc-de93-43b4-b83c-4b76ecc3db2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:26.345845 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd684edc-de93-43b4-b83c-4b76ecc3db2d None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:26.370378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 117/227] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:05:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:26.396731 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd684edc-de93-43b4-b83c-4b76ecc3db2d None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:26.506775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d020fc-313e-4b18-b7a8-4f5dd120762c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:26.579138 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae17ef-063d-4af7-8a9a-0c28ad8a0cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:26.580041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae17ef-063d-4af7-8a9a-0c28ad8a0cbd None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:26.580590 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae17ef-063d-4af7-8a9a-0c28ad8a0cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:26.581066 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae17ef-063d-4af7-8a9a-0c28ad8a0cbd None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:26.582255 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae17ef-063d-4af7-8a9a-0c28ad8a0cbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:26.582805 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae17ef-063d-4af7-8a9a-0c28ad8a0cbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:26.586111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae17ef-063d-4af7-8a9a-0c28ad8a0cbd None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:26.615255 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 111/228] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:26.627477 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae17ef-063d-4af7-8a9a-0c28ad8a0cbd None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:26.647379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:26.797510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd684edc-de93-43b4-b83c-4b76ecc3db2d None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:26.843656 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:26.873660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f92861-a537-4592-b11a-080221fded74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:26.874730 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f92861-a537-4592-b11a-080221fded74 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:26.875210 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f92861-a537-4592-b11a-080221fded74 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:26.876090 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f92861-a537-4592-b11a-080221fded74 None admin] PATH_INFO: `/v3/users/50ba6cdf8d4446b6a743f28a9660fcce` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:26.878775 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f92861-a537-4592-b11a-080221fded74 None admin] RBAC: Authorizing `identity:get_user(user_id=50ba6cdf8d4446b6a743f28a9660fcce)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:26.886624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f92861-a537-4592-b11a-080221fded74 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:26.886624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 118/229] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:26 2022] GET /identity/v3/users/50ba6cdf8d4446b6a743f28a9660fcce => generated 283 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:26.893854 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f92861-a537-4592-b11a-080221fded74 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:27.002027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae17ef-063d-4af7-8a9a-0c28ad8a0cbd None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:27.100775 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f92861-a537-4592-b11a-080221fded74 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:27.132239 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf0179-33ff-43a2-8e61-41231b87968b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:27.133234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf0179-33ff-43a2-8e61-41231b87968b None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:27.133658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf0179-33ff-43a2-8e61-41231b87968b None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:27.134130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf0179-33ff-43a2-8e61-41231b87968b None admin] PATH_INFO: `/v3/users/50ba6cdf8d4446b6a743f28a9660fcce` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:27.136619 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf0179-33ff-43a2-8e61-41231b87968b None admin] RBAC: Authorizing `identity:get_user(user_id=50ba6cdf8d4446b6a743f28a9660fcce)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:27.139240 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf0179-33ff-43a2-8e61-41231b87968b None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:27.151077 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 112/230] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:26 2022] GET /identity/v3/users/50ba6cdf8d4446b6a743f28a9660fcce => generated 283 bytes in 524 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:27.152591 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf0179-33ff-43a2-8e61-41231b87968b None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:27.162880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dda427-bd0f-44e0-9a28-867026bde2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:27.164091 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dda427-bd0f-44e0-9a28-867026bde2da None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:27.164575 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dda427-bd0f-44e0-9a28-867026bde2da None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:27.165042 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dda427-bd0f-44e0-9a28-867026bde2da None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:27.167358 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dda427-bd0f-44e0-9a28-867026bde2da None admin] RBAC: Authorizing `identity:get_project(project_id=6d9e32fd96ae4748a30237bde6c1463f)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:27.169037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dda427-bd0f-44e0-9a28-867026bde2da None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:27.171289 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 119/231] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:26 2022] GET /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:27.178382 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dda427-bd0f-44e0-9a28-867026bde2da None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:27.290760 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:27.371930 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dda427-bd0f-44e0-9a28-867026bde2da None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:27.373929 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:27.444082 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f861c-c129-41cc-a565-ff7c7e19f446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:27.444843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f861c-c129-41cc-a565-ff7c7e19f446 None admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:27.445125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f861c-c129-41cc-a565-ff7c7e19f446 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:27.445414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f861c-c129-41cc-a565-ff7c7e19f446 None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f/users/50ba6cdf8d4446b6a743f28a9660fcce/roles/a9e6249ed8cd44ce9fac74a4c8155978` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:27.451115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f861c-c129-41cc-a565-ff7c7e19f446 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d9e32fd96ae4748a30237bde6c1463f, user_id=50ba6cdf8d4446b6a743f28a9660fcce, role_id=a9e6249ed8cd44ce9fac74a4c8155978)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:27.453592 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f861c-c129-41cc-a565-ff7c7e19f446 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:27.475112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf0179-33ff-43a2-8e61-41231b87968b None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:27.536205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d0c92-d256-46d6-b8d1-97d364d473ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:27.537643 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d0c92-d256-46d6-b8d1-97d364d473ee None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:27.538046 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d0c92-d256-46d6-b8d1-97d364d473ee None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:27.541132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d0c92-d256-46d6-b8d1-97d364d473ee None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:27.548247 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 120/232] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:05:27 2022] PUT /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f/users/50ba6cdf8d4446b6a743f28a9660fcce/roles/a9e6249ed8cd44ce9fac74a4c8155978 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:05:27.555883 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d0c92-d256-46d6-b8d1-97d364d473ee None admin] RBAC: Authorizing `identity:get_project(project_id=6d9e32fd96ae4748a30237bde6c1463f)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:27.558092 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d0c92-d256-46d6-b8d1-97d364d473ee None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:27.561096 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 113/233] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:27 2022] GET /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f => generated 302 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:27.569557 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f861c-c129-41cc-a565-ff7c7e19f446 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:27.743874 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f861c-c129-41cc-a565-ff7c7e19f446 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:27.767079 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:27.797474 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb5b83-56fb-4896-a68f-f553e5502805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:27.798180 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb5b83-56fb-4896-a68f-f553e5502805 None admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:27.798461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb5b83-56fb-4896-a68f-f553e5502805 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:27.798831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb5b83-56fb-4896-a68f-f553e5502805 None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f/users/50ba6cdf8d4446b6a743f28a9660fcce/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:27.805109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb5b83-56fb-4896-a68f-f553e5502805 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d9e32fd96ae4748a30237bde6c1463f, user_id=50ba6cdf8d4446b6a743f28a9660fcce, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:27.806869 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb5b83-56fb-4896-a68f-f553e5502805 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:27.928016 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 121/234] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:05:27 2022] PUT /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f/users/50ba6cdf8d4446b6a743f28a9660fcce/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:05:28.610429 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a917c12-68e2-4145-874b-c541162d4f4c None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:28.611009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a917c12-68e2-4145-874b-c541162d4f4c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:28.611009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a917c12-68e2-4145-874b-c541162d4f4c None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:28.612364 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 114/235] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:28.619078 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a055e-633f-49a8-a89c-32a13176c876 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:28.619721 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a055e-633f-49a8-a89c-32a13176c876 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:28.619721 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a055e-633f-49a8-a89c-32a13176c876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:28.647882 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-e17a055e-633f-49a8-a89c-32a13176c876 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:28.649224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e17a055e-633f-49a8-a89c-32a13176c876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:28.753277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 122/236] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:29.010678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fe2b8-67d3-4afa-a57b-103dee75f541 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:29.011073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fe2b8-67d3-4afa-a57b-103dee75f541 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:29.011216 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fe2b8-67d3-4afa-a57b-103dee75f541 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:29.012768 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 115/237] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:29.019289 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf06724-6aa3-4b37-b3d1-12b7d0572e4a None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:29.019577 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf06724-6aa3-4b37-b3d1-12b7d0572e4a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:29.019872 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf06724-6aa3-4b37-b3d1-12b7d0572e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:29.047825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-0cf06724-6aa3-4b37-b3d1-12b7d0572e4a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:29.049086 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-0cf06724-6aa3-4b37-b3d1-12b7d0572e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:29.168479 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 123/238] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:29.298068 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fe2b8-67d3-4afa-a57b-103dee75f541 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:29.317387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8f2f1-859c-4e38-9b0f-53a9cbe644ca None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:29.317667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8f2f1-859c-4e38-9b0f-53a9cbe644ca None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:29.318015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8f2f1-859c-4e38-9b0f-53a9cbe644ca None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:29.319362 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 124/239] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:05:29.328060 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9b382-aeeb-462e-bac6-bf3a1db57bb7 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:29.328330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9b382-aeeb-462e-bac6-bf3a1db57bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:29.328647 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9b382-aeeb-462e-bac6-bf3a1db57bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:29.366758 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-3ed9b382-aeeb-462e-bac6-bf3a1db57bb7 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:29.368728 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-3ed9b382-aeeb-462e-bac6-bf3a1db57bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:29.444283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:29.514249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fe2b8-67d3-4afa-a57b-103dee75f541 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:29.529832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 125/240] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:29.564673 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9b382-aeeb-462e-bac6-bf3a1db57bb7 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:29.601492 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ee7fa-5649-473c-89ab-1570d9aa7aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:29.602155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ee7fa-5649-473c-89ab-1570d9aa7aee None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:29.602428 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ee7fa-5649-473c-89ab-1570d9aa7aee None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:29.602723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ee7fa-5649-473c-89ab-1570d9aa7aee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:29.617968 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:29.626158 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ee7fa-5649-473c-89ab-1570d9aa7aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:29.632507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-6d0ee7fa-5649-473c-89ab-1570d9aa7aee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 01:05:29.632507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:29.632507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:29.632507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:29.632507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:29.632507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:29.632507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:29.632507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:29.632507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:29.632507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:29.632507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:29.632507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:29.632507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:29.632507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:29.632507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:29.632507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:29.633671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:29.633671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:29.633671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:29.633671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:29.633671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:29.633671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:29.633671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:29.633671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:29.633671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:29.633671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:29.633671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:29.633671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:29.633671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:29.633671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:29.633671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:29.633671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:29.634454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:29.634454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:29.634454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:29.634454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:29.634454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:29.634454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:29.634454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:29.634454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:29.634454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:29.634454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:29.634454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 01:05:29.634454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:29.634454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 116/241] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:29.643786 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ee7fa-5649-473c-89ab-1570d9aa7aee None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:29.748480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9b382-aeeb-462e-bac6-bf3a1db57bb7 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:29.807599 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce5505-bc08-413d-9663-886ece247a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:29.808383 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce5505-bc08-413d-9663-886ece247a96 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:29.808651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce5505-bc08-413d-9663-886ece247a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:29.809030 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce5505-bc08-413d-9663-886ece247a96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:29.814047 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce5505-bc08-413d-9663-886ece247a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:29.815737 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce5505-bc08-413d-9663-886ece247a96 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:29.817445 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 126/242] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:05:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:29.844193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce5505-bc08-413d-9663-886ece247a96 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:29.877945 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ee7fa-5649-473c-89ab-1570d9aa7aee None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:29.902085 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:29.927660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fb9df-b493-4e22-a4b9-a01960699c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:29.928750 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fb9df-b493-4e22-a4b9-a01960699c16 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:29.929210 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fb9df-b493-4e22-a4b9-a01960699c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:29.929647 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fb9df-b493-4e22-a4b9-a01960699c16 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:29.930499 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fb9df-b493-4e22-a4b9-a01960699c16 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:29.931109 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fb9df-b493-4e22-a4b9-a01960699c16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:29.932723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fb9df-b493-4e22-a4b9-a01960699c16 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:29.942699 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 117/243] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:29.945183 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fb9df-b493-4e22-a4b9-a01960699c16 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:30.022737 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce5505-bc08-413d-9663-886ece247a96 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:30.043057 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:30.101479 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e595f3-8cd8-492d-9cae-2f45bd4096bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:30.102776 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e595f3-8cd8-492d-9cae-2f45bd4096bf None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:30.103838 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e595f3-8cd8-492d-9cae-2f45bd4096bf None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:30.104432 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e595f3-8cd8-492d-9cae-2f45bd4096bf None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:30.106143 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e595f3-8cd8-492d-9cae-2f45bd4096bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:30.108469 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fb9df-b493-4e22-a4b9-a01960699c16 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:30.108652 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e595f3-8cd8-492d-9cae-2f45bd4096bf None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:30.169811 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2947a-cfdf-4231-8a07-05d6fcf79d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:30.170787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2947a-cfdf-4231-8a07-05d6fcf79d50 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:30.171362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2947a-cfdf-4231-8a07-05d6fcf79d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:30.171701 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2947a-cfdf-4231-8a07-05d6fcf79d50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:30.193851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2947a-cfdf-4231-8a07-05d6fcf79d50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:30.199997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-b9a2947a-cfdf-4231-8a07-05d6fcf79d50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:30.199997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:30.199997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:30.199997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:30.199997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:30.199997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:30.199997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:30.199997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:30.199997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:30.199997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:30.199997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:30.199997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:30.199997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:30.199997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:30.199997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:30.199997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:30.202262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:30.202262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:30.202262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:30.202262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:30.202262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:30.202262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:30.202262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:30.202262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:30.202262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:30.202262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:30.202262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:30.202262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:30.202262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:30.202262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:30.202262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:30.202262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:30.204234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:30.204234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:30.204234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:30.204234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:30.204234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:30.204234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:30.204234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:30.204234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:30.204234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:30.204234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:30.204234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:30.204234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:30.204234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 118/244] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:30.204234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2947a-cfdf-4231-8a07-05d6fcf79d50 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:30.280196 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 127/245] 10.222.0.83 () {60 vars in 1132 bytes} [Fri Sep 23 01:05:29 2022] POST /identity/v3/users => generated 293 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:05:30.281076 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e595f3-8cd8-492d-9cae-2f45bd4096bf None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:30.459765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:30.468393 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e595f3-8cd8-492d-9cae-2f45bd4096bf None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:30.543077 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2947a-cfdf-4231-8a07-05d6fcf79d50 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:30.569800 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c1771-0142-433d-b109-087730e8b515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:30.570463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c1771-0142-433d-b109-087730e8b515 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:30.573799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c1771-0142-433d-b109-087730e8b515 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:30.574183 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c1771-0142-433d-b109-087730e8b515 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:30.575004 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c1771-0142-433d-b109-087730e8b515 None admin] RBAC: Adding query filter params (name=member) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:30.575317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c1771-0142-433d-b109-087730e8b515 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:30.576956 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c1771-0142-433d-b109-087730e8b515 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:30.600315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 128/246] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:30.614096 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c1771-0142-433d-b109-087730e8b515 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:30.623084 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:30.666487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08d912-0310-4a5f-8302-5666bf2e384a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:30.669196 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08d912-0310-4a5f-8302-5666bf2e384a None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:30.670358 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08d912-0310-4a5f-8302-5666bf2e384a None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:30.671075 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08d912-0310-4a5f-8302-5666bf2e384a None admin] PATH_INFO: `/v3/users/5dc2b6e2dbc04121818769f13f5fee29` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:30.707845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08d912-0310-4a5f-8302-5666bf2e384a None admin] RBAC: Authorizing `identity:get_user(user_id=5dc2b6e2dbc04121818769f13f5fee29)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:30.711389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08d912-0310-4a5f-8302-5666bf2e384a None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:30.716099 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 119/247] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:30 2022] GET /identity/v3/users/5dc2b6e2dbc04121818769f13f5fee29 => generated 297 bytes in 512 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:30.721926 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08d912-0310-4a5f-8302-5666bf2e384a None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:30.869326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c1771-0142-433d-b109-087730e8b515 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:30.949991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08d912-0310-4a5f-8302-5666bf2e384a None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:30.951263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ef9b2-2f5b-4975-8432-cbb6b81e4bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:30.952343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ef9b2-2f5b-4975-8432-cbb6b81e4bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:30.952788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ef9b2-2f5b-4975-8432-cbb6b81e4bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:30.953266 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ef9b2-2f5b-4975-8432-cbb6b81e4bc4 None admin] PATH_INFO: `/v3/users/7fc2eae458ee4cb5b7e95afd90186f99` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:30.956617 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ef9b2-2f5b-4975-8432-cbb6b81e4bc4 None admin] RBAC: Authorizing `identity:get_user(user_id=7fc2eae458ee4cb5b7e95afd90186f99)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:30.958855 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ef9b2-2f5b-4975-8432-cbb6b81e4bc4 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:30.961631 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 129/248] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:30 2022] GET /identity/v3/users/7fc2eae458ee4cb5b7e95afd90186f99 => generated 297 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:30.961955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3be32-5fdb-43ae-8b50-b24247bef819 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:30.962243 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3be32-5fdb-43ae-8b50-b24247bef819 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:30.962497 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3be32-5fdb-43ae-8b50-b24247bef819 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:30.963933 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 130/249] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:30.970169 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8d74c-bf1d-4d8d-99b0-a9427a62ed40 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:30.970540 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8d74c-bf1d-4d8d-99b0-a9427a62ed40 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:30.971015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8d74c-bf1d-4d8d-99b0-a9427a62ed40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:30.995005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-bfa8d74c-bf1d-4d8d-99b0-a9427a62ed40 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:30.996260 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-bfa8d74c-bf1d-4d8d-99b0-a9427a62ed40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:31.022259 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:31.032136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9383de-1696-4d65-9b39-645ebca9fae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:31.032978 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9383de-1696-4d65-9b39-645ebca9fae4 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:31.036205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9383de-1696-4d65-9b39-645ebca9fae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:31.036205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9383de-1696-4d65-9b39-645ebca9fae4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:31.128224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:31.149202 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 131/250] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:05:31.151679 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8d74c-bf1d-4d8d-99b0-a9427a62ed40 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:31.174251 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9383de-1696-4d65-9b39-645ebca9fae4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:31.176814 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9383de-1696-4d65-9b39-645ebca9fae4 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:31.339674 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8d74c-bf1d-4d8d-99b0-a9427a62ed40 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:31.346719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 120/251] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:05:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:05:31.353747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9383de-1696-4d65-9b39-645ebca9fae4 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:31.397575 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb237f8-f003-4baf-a70b-c153299feeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:31.398173 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb237f8-f003-4baf-a70b-c153299feeb1 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:31.398450 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb237f8-f003-4baf-a70b-c153299feeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:31.398762 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb237f8-f003-4baf-a70b-c153299feeb1 None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:31.403906 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb237f8-f003-4baf-a70b-c153299feeb1 None admin] RBAC: Authorizing `identity:get_project(project_id=6d9e32fd96ae4748a30237bde6c1463f)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:31.405406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb237f8-f003-4baf-a70b-c153299feeb1 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:31.414635 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 132/252] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:31 2022] GET /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:31.422273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb237f8-f003-4baf-a70b-c153299feeb1 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:31.464775 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:31.554212 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:31.561301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb237f8-f003-4baf-a70b-c153299feeb1 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:31.608488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9383de-1696-4d65-9b39-645ebca9fae4 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:31.622759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fde6c-2ef7-4ba5-975f-3124aaff0b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:31.623554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fde6c-2ef7-4ba5-975f-3124aaff0b7c None admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:31.624030 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fde6c-2ef7-4ba5-975f-3124aaff0b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:31.624485 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fde6c-2ef7-4ba5-975f-3124aaff0b7c None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f/users/7fc2eae458ee4cb5b7e95afd90186f99/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:31.626985 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fde6c-2ef7-4ba5-975f-3124aaff0b7c None admin] RBAC: Authorizing `identity:create_grant(project_id=6d9e32fd96ae4748a30237bde6c1463f, user_id=7fc2eae458ee4cb5b7e95afd90186f99, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:31.630444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fde6c-2ef7-4ba5-975f-3124aaff0b7c None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:31.668396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ead7a-b0d1-472a-b462-b00fbd23c575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:31.669367 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ead7a-b0d1-472a-b462-b00fbd23c575 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:31.669765 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ead7a-b0d1-472a-b462-b00fbd23c575 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:31.670198 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ead7a-b0d1-472a-b462-b00fbd23c575 None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:31.671765 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ead7a-b0d1-472a-b462-b00fbd23c575 None admin] RBAC: Authorizing `identity:get_project(project_id=6d9e32fd96ae4748a30237bde6c1463f)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:31.673396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ead7a-b0d1-472a-b462-b00fbd23c575 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:31.679422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 121/253] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:31 2022] GET /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f => generated 302 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:31.679422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818a2cb-54ec-4a1a-9497-2aa86dab6670 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:31.679422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818a2cb-54ec-4a1a-9497-2aa86dab6670 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:31.679422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818a2cb-54ec-4a1a-9497-2aa86dab6670 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:31.680416 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 122/254] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:31.681252 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818a2cb-54ec-4a1a-9497-2aa86dab6670 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:31.716640 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 133/255] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:05:31 2022] PUT /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f/users/7fc2eae458ee4cb5b7e95afd90186f99/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:05:31.716640 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fde6c-2ef7-4ba5-975f-3124aaff0b7c None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:31.839992 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818a2cb-54ec-4a1a-9497-2aa86dab6670 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:31.907367 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112f757-fcb1-4bd3-9061-88e51bd082de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:31.908043 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112f757-fcb1-4bd3-9061-88e51bd082de None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:31.908319 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112f757-fcb1-4bd3-9061-88e51bd082de None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:31.908592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112f757-fcb1-4bd3-9061-88e51bd082de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:31.941750 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:31.951450 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112f757-fcb1-4bd3-9061-88e51bd082de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:31.957201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-b112f757-fcb1-4bd3-9061-88e51bd082de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:05:31.957201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:31.957201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:31.957201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:31.957201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:31.957201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:31.957201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:31.957201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:31.957201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:31.957201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:31.957201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:31.957201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:31.957201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:31.957201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:31.957201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:31.957201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:31.958219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:31.958219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:31.958219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:31.958219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:31.958219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:31.958219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:31.958219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:31.958219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:31.958219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:31.958219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:31.958219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:31.958219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:31.958219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:31.958219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:31.958219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:31.958219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:31.959087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:31.959087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:31.959087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:31.959087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:31.959087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:31.959087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:31.959087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:31.959087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:31.959087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:31.959087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:31.959087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:05:31.959087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:31.969759 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 123/256] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:05:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:31.969759 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c8e40-c56f-4549-b865-54b7b113163f None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:31.969759 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c8e40-c56f-4549-b865-54b7b113163f None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:31.969759 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c8e40-c56f-4549-b865-54b7b113163f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:31.978470 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fde6c-2ef7-4ba5-975f-3124aaff0b7c None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:31.995187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-048c8e40-c56f-4549-b865-54b7b113163f None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:31.996574 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-048c8e40-c56f-4549-b865-54b7b113163f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:31.999543 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:32.033990 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1a0f8-e8fd-4b5b-bcc5-af6a79034493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:32.034809 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1a0f8-e8fd-4b5b-bcc5-af6a79034493 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:32.035124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1a0f8-e8fd-4b5b-bcc5-af6a79034493 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:32.035405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1a0f8-e8fd-4b5b-bcc5-af6a79034493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:32.036238 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1a0f8-e8fd-4b5b-bcc5-af6a79034493 None admin] RBAC: Adding query filter params (role.id=4459bad5351b44b3b48d09c46d197855, scope.project.id=6d9e32fd96ae4748a30237bde6c1463f, user.id=5dc2b6e2dbc04121818769f13f5fee29) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:32.036558 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1a0f8-e8fd-4b5b-bcc5-af6a79034493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:32.038422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1a0f8-e8fd-4b5b-bcc5-af6a79034493 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:32.046216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 134/257] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:05:31 2022] GET /identity/v3/role_assignments?user.id=5dc2b6e2dbc04121818769f13f5fee29&scope.project.id=6d9e32fd96ae4748a30237bde6c1463f&role.id=4459bad5351b44b3b48d09c46d197855 => generated 259 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:32.047207 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1a0f8-e8fd-4b5b-bcc5-af6a79034493 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:32.102158 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 124/258] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:32.229077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1a0f8-e8fd-4b5b-bcc5-af6a79034493 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:32.284169 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b330a3-a621-4bb2-947e-882c16130281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:32.285267 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b330a3-a621-4bb2-947e-882c16130281 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:32.285779 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b330a3-a621-4bb2-947e-882c16130281 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:32.286252 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b330a3-a621-4bb2-947e-882c16130281 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:32.287399 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b330a3-a621-4bb2-947e-882c16130281 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:32.288090 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b330a3-a621-4bb2-947e-882c16130281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:32.290025 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b330a3-a621-4bb2-947e-882c16130281 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:32.303947 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 135/259] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:05:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:32.311763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c8e40-c56f-4549-b865-54b7b113163f None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:32.460873 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c8e40-c56f-4549-b865-54b7b113163f None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:32.516594 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3c6c0-0ef4-448c-ae71-25e45186bbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:32.517263 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3c6c0-0ef4-448c-ae71-25e45186bbb1 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:32.517544 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3c6c0-0ef4-448c-ae71-25e45186bbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:32.517813 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3c6c0-0ef4-448c-ae71-25e45186bbb1 None admin] PATH_INFO: `/v3/users/50ba6cdf8d4446b6a743f28a9660fcce` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:32.519074 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3c6c0-0ef4-448c-ae71-25e45186bbb1 None admin] RBAC: Authorizing `identity:get_user(user_id=50ba6cdf8d4446b6a743f28a9660fcce)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:32.520837 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3c6c0-0ef4-448c-ae71-25e45186bbb1 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:32.522968 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 125/260] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:32 2022] GET /identity/v3/users/50ba6cdf8d4446b6a743f28a9660fcce => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:32.528646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b330a3-a621-4bb2-947e-882c16130281 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:32.536514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:32.694454 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b330a3-a621-4bb2-947e-882c16130281 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:32.721528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3c6c0-0ef4-448c-ae71-25e45186bbb1 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:32.732005 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:32.782461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b5f5f-4814-44e2-92f7-8023c6ba5481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:32.783496 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b5f5f-4814-44e2-92f7-8023c6ba5481 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:32.784132 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b5f5f-4814-44e2-92f7-8023c6ba5481 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:32.784607 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b5f5f-4814-44e2-92f7-8023c6ba5481 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:32.884955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b5f5f-4814-44e2-92f7-8023c6ba5481 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:32.887318 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b5f5f-4814-44e2-92f7-8023c6ba5481 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:32.904004 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:33.001088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3c6c0-0ef4-448c-ae71-25e45186bbb1 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:33.087261 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b0fdd-a2a5-44ff-96e9-fba3a32e1994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:33.088260 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b0fdd-a2a5-44ff-96e9-fba3a32e1994 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:33.088870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b0fdd-a2a5-44ff-96e9-fba3a32e1994 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:33.089357 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b0fdd-a2a5-44ff-96e9-fba3a32e1994 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:33.128181 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b0fdd-a2a5-44ff-96e9-fba3a32e1994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:33.140019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-067b0fdd-a2a5-44ff-96e9-fba3a32e1994 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:05:33.140019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:33.140019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:33.140019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:33.140019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:33.140019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:33.140019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:33.140019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:33.140019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:33.140019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:33.140019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:33.140019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:33.140019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:33.140019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:33.140019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:33.140019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:33.141164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:33.141164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:33.141164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:33.141164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:33.141164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:33.141164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:33.141164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:33.141164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:33.141164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:33.141164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:33.141164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:33.141164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:33.141164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:33.141164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:33.141164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:33.141164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:33.142124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:33.142124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:33.142124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:33.142124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:33.142124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:33.142124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:33.142124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:33.142124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:33.142124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:33.142124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:33.142124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:05:33.142124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:33.142961 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 126/261] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:05:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:05:33.150000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b0fdd-a2a5-44ff-96e9-fba3a32e1994 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:33.155892 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 136/262] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:05:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:05:33.162401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b5f5f-4814-44e2-92f7-8023c6ba5481 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:33.313342 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:33.412785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b0fdd-a2a5-44ff-96e9-fba3a32e1994 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:33.419587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b5f5f-4814-44e2-92f7-8023c6ba5481 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:33.430146 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:33.504208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b84c3d-36b9-438a-886e-0bf25ea93ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:33.504855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b84c3d-36b9-438a-886e-0bf25ea93ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:33.505182 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b84c3d-36b9-438a-886e-0bf25ea93ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:33.505546 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b84c3d-36b9-438a-886e-0bf25ea93ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:33.506281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b84c3d-36b9-438a-886e-0bf25ea93ef7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:33.506742 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b84c3d-36b9-438a-886e-0bf25ea93ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:33.508548 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b84c3d-36b9-438a-886e-0bf25ea93ef7 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:33.509616 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bc83e-014a-4e9a-89c8-6f0dbf5994d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:33.510531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bc83e-014a-4e9a-89c8-6f0dbf5994d5 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:33.511149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bc83e-014a-4e9a-89c8-6f0dbf5994d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:33.511635 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bc83e-014a-4e9a-89c8-6f0dbf5994d5 None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:33.515098 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bc83e-014a-4e9a-89c8-6f0dbf5994d5 None admin] RBAC: Authorizing `identity:get_project(project_id=6d9e32fd96ae4748a30237bde6c1463f)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:33.517100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bc83e-014a-4e9a-89c8-6f0dbf5994d5 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:33.522627 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 127/263] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:33.523946 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 137/264] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:33 2022] GET /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f => generated 302 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:33.529748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b84c3d-36b9-438a-886e-0bf25ea93ef7 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:33.530296 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bc83e-014a-4e9a-89c8-6f0dbf5994d5 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:33.774041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b84c3d-36b9-438a-886e-0bf25ea93ef7 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:33.844335 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:33.853747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bc83e-014a-4e9a-89c8-6f0dbf5994d5 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:33.854619 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2826b-3fe1-44c8-973c-38ebceee92f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:33.860981 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2826b-3fe1-44c8-973c-38ebceee92f6 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:33.860981 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2826b-3fe1-44c8-973c-38ebceee92f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:33.860981 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2826b-3fe1-44c8-973c-38ebceee92f6 None admin] PATH_INFO: `/v3/users/50ba6cdf8d4446b6a743f28a9660fcce` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:33.860981 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2826b-3fe1-44c8-973c-38ebceee92f6 None admin] RBAC: Authorizing `identity:get_user(user_id=50ba6cdf8d4446b6a743f28a9660fcce)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:33.860981 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2826b-3fe1-44c8-973c-38ebceee92f6 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:33.861499 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 128/265] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:33 2022] GET /identity/v3/users/50ba6cdf8d4446b6a743f28a9660fcce => generated 283 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:33.868290 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2826b-3fe1-44c8-973c-38ebceee92f6 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:33.958895 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a637a-c43e-47b3-9598-b6068514732a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:33.959550 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a637a-c43e-47b3-9598-b6068514732a None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:33.959832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a637a-c43e-47b3-9598-b6068514732a None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:33.960107 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a637a-c43e-47b3-9598-b6068514732a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:33.961269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a637a-c43e-47b3-9598-b6068514732a None admin] RBAC: Adding query filter params (role.id=a9e6249ed8cd44ce9fac74a4c8155978, scope.project.id=6d9e32fd96ae4748a30237bde6c1463f, user.id=50ba6cdf8d4446b6a743f28a9660fcce) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:33.961665 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a637a-c43e-47b3-9598-b6068514732a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:33.963280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a637a-c43e-47b3-9598-b6068514732a None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:33.980147 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 138/266] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:05:33 2022] GET /identity/v3/role_assignments?user.id=50ba6cdf8d4446b6a743f28a9660fcce&scope.project.id=6d9e32fd96ae4748a30237bde6c1463f&role.id=a9e6249ed8cd44ce9fac74a4c8155978 => generated 608 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:34.124093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2826b-3fe1-44c8-973c-38ebceee92f6 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:34.185670 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f21d6f-a63f-4683-a8d7-223302aa6fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:34.186298 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f21d6f-a63f-4683-a8d7-223302aa6fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:34.186573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f21d6f-a63f-4683-a8d7-223302aa6fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:34.186933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f21d6f-a63f-4683-a8d7-223302aa6fc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:34.287170 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:34.299029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f21d6f-a63f-4683-a8d7-223302aa6fc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:34.300571 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f21d6f-a63f-4683-a8d7-223302aa6fc0 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:34.449116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 129/267] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:05:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 01:05:34.455149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a637a-c43e-47b3-9598-b6068514732a None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:34.527598 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:34.633291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a637a-c43e-47b3-9598-b6068514732a None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:34.635230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c54f1-fd15-426c-ad1a-f5c32bb13f1c None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:34.635802 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c54f1-fd15-426c-ad1a-f5c32bb13f1c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:34.636350 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c54f1-fd15-426c-ad1a-f5c32bb13f1c None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:34.638269 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 130/268] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:05:34.644205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f6ceb-79d8-4ebc-8c21-00b8e4e5152b None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:34.644987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f6ceb-79d8-4ebc-8c21-00b8e4e5152b None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:34.645472 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f6ceb-79d8-4ebc-8c21-00b8e4e5152b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:34.669154 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-794f6ceb-79d8-4ebc-8c21-00b8e4e5152b None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:34.670803 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-794f6ceb-79d8-4ebc-8c21-00b8e4e5152b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:34.711694 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb5ab2-845e-4f43-b9ca-06cd1367e041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:34.712106 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb5ab2-845e-4f43-b9ca-06cd1367e041 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:34.712399 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb5ab2-845e-4f43-b9ca-06cd1367e041 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:34.712673 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb5ab2-845e-4f43-b9ca-06cd1367e041 None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:34.713978 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb5ab2-845e-4f43-b9ca-06cd1367e041 None admin] RBAC: Authorizing `identity:get_project(project_id=6d9e32fd96ae4748a30237bde6c1463f)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:34.715587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb5ab2-845e-4f43-b9ca-06cd1367e041 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:34.717655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 139/269] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:34 2022] GET /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:34.725170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb5ab2-845e-4f43-b9ca-06cd1367e041 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:34.814618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 131/270] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:05:34.814618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2229fc-571c-4a60-af46-4c6c0e4c0e1d None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:34.814618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2229fc-571c-4a60-af46-4c6c0e4c0e1d None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:34.814618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2229fc-571c-4a60-af46-4c6c0e4c0e1d None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:34.814618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 132/271] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:34.825748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa027b1c-7f21-452d-8b2d-5215ddbbb902 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:34.825748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa027b1c-7f21-452d-8b2d-5215ddbbb902 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:34.825748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa027b1c-7f21-452d-8b2d-5215ddbbb902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:34.863822 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-aa027b1c-7f21-452d-8b2d-5215ddbbb902 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:34.868041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-aa027b1c-7f21-452d-8b2d-5215ddbbb902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:34.899452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb5ab2-845e-4f43-b9ca-06cd1367e041 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:34.904008 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:34.924109 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:34.999481 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a109fc3-ee49-4375-8d29-00bd477786d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:35.000062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a109fc3-ee49-4375-8d29-00bd477786d7 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:35.000342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a109fc3-ee49-4375-8d29-00bd477786d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:35.000648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a109fc3-ee49-4375-8d29-00bd477786d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:35.005430 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a109fc3-ee49-4375-8d29-00bd477786d7 None admin] RBAC: Adding query filter params (role.id=d365054bc34046c5829cd1355f3a31ac, scope.project.id=6d9e32fd96ae4748a30237bde6c1463f, user.id=50ba6cdf8d4446b6a743f28a9660fcce) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:35.005646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a109fc3-ee49-4375-8d29-00bd477786d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:35.007227 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a109fc3-ee49-4375-8d29-00bd477786d7 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:35.024293 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 140/272] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:05:34 2022] GET /identity/v3/role_assignments?user.id=50ba6cdf8d4446b6a743f28a9660fcce&scope.project.id=6d9e32fd96ae4748a30237bde6c1463f&role.id=d365054bc34046c5829cd1355f3a31ac => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:35.045503 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 133/273] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:05:35.216891 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a109fc3-ee49-4375-8d29-00bd477786d7 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:35.382294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a109fc3-ee49-4375-8d29-00bd477786d7 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:35.453562 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3c077-56ce-4d4e-aef1-319a4135819c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:35.455037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3c077-56ce-4d4e-aef1-319a4135819c None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:35.455694 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3c077-56ce-4d4e-aef1-319a4135819c None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:35.457114 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3c077-56ce-4d4e-aef1-319a4135819c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:35.475883 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3c077-56ce-4d4e-aef1-319a4135819c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:35.484526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-eff3c077-56ce-4d4e-aef1-319a4135819c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:35.484526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:35.484526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:35.484526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:35.484526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:35.484526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:35.484526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:35.484526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:35.484526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:35.484526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:35.484526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:35.484526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:35.484526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:35.484526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:35.484526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:35.484526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:35.485926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:35.485926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:35.485926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:35.485926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:35.485926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:35.485926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:35.485926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:35.485926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:35.485926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:35.485926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:35.485926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:35.485926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:35.485926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:35.485926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:35.485926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:35.485926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:35.486791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:35.486791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:35.486791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:35.486791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:35.486791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:35.486791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:35.486791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:35.486791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:35.486791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:35.486791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:35.486791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:35.486791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:05:35.490203 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 141/274] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:35.495830 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa027b1c-7f21-452d-8b2d-5215ddbbb902 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:35.497053 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3c077-56ce-4d4e-aef1-319a4135819c None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:35.571534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:35.697951 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa027b1c-7f21-452d-8b2d-5215ddbbb902 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:35.705264 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3c077-56ce-4d4e-aef1-319a4135819c None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:35.757330 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc263dd3-6115-43ea-9dc8-c4da23b4c3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:35.757964 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc263dd3-6115-43ea-9dc8-c4da23b4c3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:35.758240 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc263dd3-6115-43ea-9dc8-c4da23b4c3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:35.758684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc263dd3-6115-43ea-9dc8-c4da23b4c3e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:35.759762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc263dd3-6115-43ea-9dc8-c4da23b4c3e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:35.761440 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc263dd3-6115-43ea-9dc8-c4da23b4c3e5 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:35.763405 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 134/275] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:05:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:35.770066 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749caba-fcb5-4661-b621-0c004b54d754 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:35.770442 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749caba-fcb5-4661-b621-0c004b54d754 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:35.770722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749caba-fcb5-4661-b621-0c004b54d754 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:35.772996 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 135/276] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:35.776647 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749caba-fcb5-4661-b621-0c004b54d754 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:35.780199 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af7bea-b035-4273-b1d3-036285a001ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:35.781230 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af7bea-b035-4273-b1d3-036285a001ea None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:35.781714 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af7bea-b035-4273-b1d3-036285a001ea None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:35.782184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af7bea-b035-4273-b1d3-036285a001ea None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:35.783446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af7bea-b035-4273-b1d3-036285a001ea None admin] RBAC: Adding query filter params (name=member) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:35.783995 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af7bea-b035-4273-b1d3-036285a001ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:35.786655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af7bea-b035-4273-b1d3-036285a001ea None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:35.802915 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 142/277] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:35.805237 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79f887-f594-4ab7-9faa-28afddbba0d0 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:35.806015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79f887-f594-4ab7-9faa-28afddbba0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:35.806167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79f887-f594-4ab7-9faa-28afddbba0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:35.819878 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:35.840617 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-bf79f887-f594-4ab7-9faa-28afddbba0d0 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:35.842962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-bf79f887-f594-4ab7-9faa-28afddbba0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:35.955902 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749caba-fcb5-4661-b621-0c004b54d754 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:35.957818 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 143/278] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:35.959843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79f887-f594-4ab7-9faa-28afddbba0d0 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:35.995872 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:36.009005 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4795a-92bc-4bd1-9511-340243277f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:36.013655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4795a-92bc-4bd1-9511-340243277f32 None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:36.013655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4795a-92bc-4bd1-9511-340243277f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:36.013655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4795a-92bc-4bd1-9511-340243277f32 None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:36.013655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4795a-92bc-4bd1-9511-340243277f32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:36.013655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4795a-92bc-4bd1-9511-340243277f32 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:36.107117 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79f887-f594-4ab7-9faa-28afddbba0d0 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:36.152148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 136/279] 10.222.0.83 () {60 vars in 1132 bytes} [Fri Sep 23 01:05:35 2022] POST /identity/v3/users => generated 293 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:05:36.153794 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70284127-d656-4572-b931-0b3eeed20c20 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:36.154279 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70284127-d656-4572-b931-0b3eeed20c20 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:36.155071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70284127-d656-4572-b931-0b3eeed20c20 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:36.157045 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 137/280] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:36.163127 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d14cb-11f9-4a77-b8e5-ee5a73030f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:36.164239 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d14cb-11f9-4a77-b8e5-ee5a73030f16 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:36.164779 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d14cb-11f9-4a77-b8e5-ee5a73030f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:36.165246 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d14cb-11f9-4a77-b8e5-ee5a73030f16 None admin] PATH_INFO: `/v3/users/ec82beeefcd34264b324c5a1a699e488` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:36.169956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfabb47-4569-4861-a875-5dfbe5bdddb9 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:36.170355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfabb47-4569-4861-a875-5dfbe5bdddb9 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:36.170781 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfabb47-4569-4861-a875-5dfbe5bdddb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:36.197087 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d14cb-11f9-4a77-b8e5-ee5a73030f16 None admin] RBAC: Authorizing `identity:get_user(user_id=ec82beeefcd34264b324c5a1a699e488)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:36.200456 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d14cb-11f9-4a77-b8e5-ee5a73030f16 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:36.204284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 144/281] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:35 2022] GET /identity/v3/users/ec82beeefcd34264b324c5a1a699e488 => generated 293 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:36.213814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d14cb-11f9-4a77-b8e5-ee5a73030f16 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:36.216684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-8bfabb47-4569-4861-a875-5dfbe5bdddb9 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:36.218079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-8bfabb47-4569-4861-a875-5dfbe5bdddb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:36.324715 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:36.325898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 138/282] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:36.326908 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfabb47-4569-4861-a875-5dfbe5bdddb9 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:36.345288 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:36.379976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d14cb-11f9-4a77-b8e5-ee5a73030f16 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:36.470007 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b443391-f538-47f7-a57f-a5e4bf9569a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:36.471011 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b443391-f538-47f7-a57f-a5e4bf9569a5 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:36.471363 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b443391-f538-47f7-a57f-a5e4bf9569a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:36.473168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b443391-f538-47f7-a57f-a5e4bf9569a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:36.473363 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b443391-f538-47f7-a57f-a5e4bf9569a5 None admin] RBAC: Adding query filter params (role.id=986891361f4f4893a1cb2d0e0b523bff, user.id=ec82beeefcd34264b324c5a1a699e488, scope.system=all) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:36.473799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b443391-f538-47f7-a57f-a5e4bf9569a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:36.479232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b443391-f538-47f7-a57f-a5e4bf9569a5 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:36.488985 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 145/283] 10.222.0.83 () {56 vars in 1308 bytes} [Fri Sep 23 01:05:36 2022] GET /identity/v3/role_assignments?user.id=ec82beeefcd34264b324c5a1a699e488&scope.system=all&role.id=986891361f4f4893a1cb2d0e0b523bff => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:36.550476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfabb47-4569-4861-a875-5dfbe5bdddb9 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:36.603742 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d34090-a3f0-4c31-8f3d-296b2372d276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:36.604657 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d34090-a3f0-4c31-8f3d-296b2372d276 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:36.604952 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d34090-a3f0-4c31-8f3d-296b2372d276 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:36.605353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d34090-a3f0-4c31-8f3d-296b2372d276 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:36.624988 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d34090-a3f0-4c31-8f3d-296b2372d276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:36.633999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-54d34090-a3f0-4c31-8f3d-296b2372d276 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:36.633999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:36.633999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:36.633999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:36.633999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:36.633999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:36.633999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:36.633999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:36.633999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:36.633999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:36.633999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:36.633999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:36.633999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:36.633999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:36.633999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:36.633999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:36.635683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:36.635683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:36.635683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:36.635683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:36.635683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:36.635683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:36.635683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:36.635683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:36.635683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:36.635683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:36.635683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:36.635683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:36.635683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:36.635683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:36.635683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:36.635683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:36.637110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:36.637110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:36.637110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:36.637110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:36.637110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:36.637110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:36.637110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:36.637110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:36.637110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:36.637110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:36.637110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:36.637110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:36.637110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 139/284] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:36.644367 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b443391-f538-47f7-a57f-a5e4bf9569a5 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:36.729550 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d34090-a3f0-4c31-8f3d-296b2372d276 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:36.866734 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b443391-f538-47f7-a57f-a5e4bf9569a5 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:36.903036 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:36.932738 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d34090-a3f0-4c31-8f3d-296b2372d276 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:36.962517 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e931a-1837-4bb2-ac44-6c453edc5010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:36.962517 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e931a-1837-4bb2-ac44-6c453edc5010 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:36.962517 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e931a-1837-4bb2-ac44-6c453edc5010 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:36.963087 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e931a-1837-4bb2-ac44-6c453edc5010 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:36.963870 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e931a-1837-4bb2-ac44-6c453edc5010 None admin] RBAC: Adding query filter params (name=member) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:36.964401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e931a-1837-4bb2-ac44-6c453edc5010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:36.975540 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e931a-1837-4bb2-ac44-6c453edc5010 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:36.988003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 146/285] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:36.999296 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e931a-1837-4bb2-ac44-6c453edc5010 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:37.006986 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:37.075488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9873de2-4778-4d57-842c-3ab3463e9c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:37.076295 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9873de2-4778-4d57-842c-3ab3463e9c37 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:37.076692 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9873de2-4778-4d57-842c-3ab3463e9c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:37.077099 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9873de2-4778-4d57-842c-3ab3463e9c37 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:37.105507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9873de2-4778-4d57-842c-3ab3463e9c37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:37.115986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-e9873de2-4778-4d57-842c-3ab3463e9c37 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 01:05:37.115986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:37.115986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:37.115986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:37.115986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:37.115986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:37.115986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:37.115986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:37.115986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:37.115986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:37.115986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:37.115986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:37.115986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:37.115986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:37.115986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:37.115986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:37.117064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:37.117064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:37.117064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:37.117064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:37.117064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:37.117064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:37.117064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:37.117064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:37.117064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:37.117064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:37.117064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:37.117064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:37.117064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:37.117064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:37.117064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:37.117064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:37.117847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:37.117847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:37.117847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:37.117847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:37.117847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:37.117847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:37.117847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:37.117847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:37.117847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:37.117847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:37.117847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 01:05:37.117847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:37.117847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 140/286] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:05:37.127393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9873de2-4778-4d57-842c-3ab3463e9c37 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:37.270027 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e931a-1837-4bb2-ac44-6c453edc5010 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:37.355222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c728d1-ccb5-4a36-aabe-11ef2c322a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:37.356294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c728d1-ccb5-4a36-aabe-11ef2c322a0b None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:37.356771 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c728d1-ccb5-4a36-aabe-11ef2c322a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:37.357239 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c728d1-ccb5-4a36-aabe-11ef2c322a0b None admin] PATH_INFO: `/v3/users/7fc2eae458ee4cb5b7e95afd90186f99` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:37.361310 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c728d1-ccb5-4a36-aabe-11ef2c322a0b None admin] RBAC: Authorizing `identity:get_user(user_id=7fc2eae458ee4cb5b7e95afd90186f99)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:37.364065 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c728d1-ccb5-4a36-aabe-11ef2c322a0b None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:37.383919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 147/287] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:36 2022] GET /identity/v3/users/7fc2eae458ee4cb5b7e95afd90186f99 => generated 297 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:37.391956 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c728d1-ccb5-4a36-aabe-11ef2c322a0b None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:37.424748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9873de2-4778-4d57-842c-3ab3463e9c37 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:37.479391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:37.487201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fa4c6-09b2-4c88-8dee-ea833e9d1612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:37.487851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fa4c6-09b2-4c88-8dee-ea833e9d1612 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:37.488206 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fa4c6-09b2-4c88-8dee-ea833e9d1612 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:37.488477 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fa4c6-09b2-4c88-8dee-ea833e9d1612 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:37.489199 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fa4c6-09b2-4c88-8dee-ea833e9d1612 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:37.489506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fa4c6-09b2-4c88-8dee-ea833e9d1612 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:37.491944 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fa4c6-09b2-4c88-8dee-ea833e9d1612 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:37.511499 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 141/288] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:37.519259 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fa4c6-09b2-4c88-8dee-ea833e9d1612 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:37.577999 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:37.649436 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c728d1-ccb5-4a36-aabe-11ef2c322a0b None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:37.758810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fa4c6-09b2-4c88-8dee-ea833e9d1612 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:37.772397 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2810d-065c-4535-8f4a-c64740181376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:37.773449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2810d-065c-4535-8f4a-c64740181376 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:37.773952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2810d-065c-4535-8f4a-c64740181376 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:37.774446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2810d-065c-4535-8f4a-c64740181376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:37.849899 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81647acf-ba5a-4796-88e2-2ae6dd488b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:37.850725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81647acf-ba5a-4796-88e2-2ae6dd488b72 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:37.851052 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81647acf-ba5a-4796-88e2-2ae6dd488b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:37.851625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81647acf-ba5a-4796-88e2-2ae6dd488b72 None admin] PATH_INFO: `/v3/users/5dc2b6e2dbc04121818769f13f5fee29` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:37.853213 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81647acf-ba5a-4796-88e2-2ae6dd488b72 None admin] RBAC: Authorizing `identity:get_user(user_id=5dc2b6e2dbc04121818769f13f5fee29)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:37.854785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81647acf-ba5a-4796-88e2-2ae6dd488b72 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:37.856825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 142/289] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:37 2022] GET /identity/v3/users/5dc2b6e2dbc04121818769f13f5fee29 => generated 297 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:37.862562 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81647acf-ba5a-4796-88e2-2ae6dd488b72 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:37.951253 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:37.994511 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81647acf-ba5a-4796-88e2-2ae6dd488b72 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:38.035263 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e946ca9-43ca-418a-9a7a-7c5d7802a80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:38.035918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e946ca9-43ca-418a-9a7a-7c5d7802a80e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:38.036196 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e946ca9-43ca-418a-9a7a-7c5d7802a80e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:38.037281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e946ca9-43ca-418a-9a7a-7c5d7802a80e None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:38.038668 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e946ca9-43ca-418a-9a7a-7c5d7802a80e None admin] RBAC: Authorizing `identity:get_project(project_id=6d9e32fd96ae4748a30237bde6c1463f)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:38.043180 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e946ca9-43ca-418a-9a7a-7c5d7802a80e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:38.046678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 143/290] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:37 2022] GET /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:38.053762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e946ca9-43ca-418a-9a7a-7c5d7802a80e None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:38.059616 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2810d-065c-4535-8f4a-c64740181376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:38.061432 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2810d-065c-4535-8f4a-c64740181376 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:38.206000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e946ca9-43ca-418a-9a7a-7c5d7802a80e None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:38.240472 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:38.253772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fecabf-6a08-47a9-b6e9-8e6baf82710d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:38.254487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fecabf-6a08-47a9-b6e9-8e6baf82710d None admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:38.258795 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fecabf-6a08-47a9-b6e9-8e6baf82710d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:38.258795 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fecabf-6a08-47a9-b6e9-8e6baf82710d None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f/users/5dc2b6e2dbc04121818769f13f5fee29/roles/4459bad5351b44b3b48d09c46d197855` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:38.258795 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fecabf-6a08-47a9-b6e9-8e6baf82710d None admin] RBAC: Authorizing `identity:create_grant(project_id=6d9e32fd96ae4748a30237bde6c1463f, user_id=5dc2b6e2dbc04121818769f13f5fee29, role_id=4459bad5351b44b3b48d09c46d197855)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:38.259728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fecabf-6a08-47a9-b6e9-8e6baf82710d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:38.284085 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:38.327998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 148/291] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:05:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 937 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 01:05:38.337619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2810d-065c-4535-8f4a-c64740181376 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:38.365820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 144/292] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:05:38 2022] PUT /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f/users/5dc2b6e2dbc04121818769f13f5fee29/roles/4459bad5351b44b3b48d09c46d197855 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:05:38.591962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2810d-065c-4535-8f4a-c64740181376 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:38.672704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba5ef3-9bee-46cf-9b47-677050efba11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:38.674109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba5ef3-9bee-46cf-9b47-677050efba11 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:38.674866 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba5ef3-9bee-46cf-9b47-677050efba11 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:38.675519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba5ef3-9bee-46cf-9b47-677050efba11 None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:38.678037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba5ef3-9bee-46cf-9b47-677050efba11 None admin] RBAC: Authorizing `identity:get_project(project_id=6d9e32fd96ae4748a30237bde6c1463f)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:38.681490 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba5ef3-9bee-46cf-9b47-677050efba11 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:38.685520 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 149/293] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:38 2022] GET /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f => generated 302 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:38.696826 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fecabf-6a08-47a9-b6e9-8e6baf82710d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:38.909596 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fecabf-6a08-47a9-b6e9-8e6baf82710d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:38.964601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37023d-98dd-4c63-a41b-e9fff4080068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:38.965791 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37023d-98dd-4c63-a41b-e9fff4080068 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:38.966143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37023d-98dd-4c63-a41b-e9fff4080068 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:38.966641 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37023d-98dd-4c63-a41b-e9fff4080068 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:38.968008 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37023d-98dd-4c63-a41b-e9fff4080068 None admin] RBAC: Adding query filter params (role.id=986891361f4f4893a1cb2d0e0b523bff, scope.project.id=6d9e32fd96ae4748a30237bde6c1463f, user.id=7fc2eae458ee4cb5b7e95afd90186f99) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:38.968556 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37023d-98dd-4c63-a41b-e9fff4080068 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:38.971632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37023d-98dd-4c63-a41b-e9fff4080068 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:38.984041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 145/294] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:05:38 2022] GET /identity/v3/role_assignments?user.id=7fc2eae458ee4cb5b7e95afd90186f99&scope.project.id=6d9e32fd96ae4748a30237bde6c1463f&role.id=986891361f4f4893a1cb2d0e0b523bff => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:39.932238 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150ce8e-35b6-4db9-a981-9f37a81e7e1a None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:39.933864 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150ce8e-35b6-4db9-a981-9f37a81e7e1a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:39.934677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150ce8e-35b6-4db9-a981-9f37a81e7e1a None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:39.938104 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 150/295] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:39.947505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895aeb5-28c2-46e6-acf9-4cbce8a445f3 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:39.948023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895aeb5-28c2-46e6-acf9-4cbce8a445f3 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:39.948542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895aeb5-28c2-46e6-acf9-4cbce8a445f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:39.978007 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-0895aeb5-28c2-46e6-acf9-4cbce8a445f3 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:39.979995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-0895aeb5-28c2-46e6-acf9-4cbce8a445f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:40.070137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47258e55-dac6-4348-87f8-edc0f3813909 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:40.070997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47258e55-dac6-4348-87f8-edc0f3813909 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:40.071477 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47258e55-dac6-4348-87f8-edc0f3813909 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:40.074355 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 151/296] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:40.085026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6db8e6-5ce2-4f9e-8078-5da7178cd795 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:40.085278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:40.086071 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6db8e6-5ce2-4f9e-8078-5da7178cd795 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:40.086863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6db8e6-5ce2-4f9e-8078-5da7178cd795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:40.123047 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-bb6db8e6-5ce2-4f9e-8078-5da7178cd795 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:40.125262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-bb6db8e6-5ce2-4f9e-8078-5da7178cd795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:40.133351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 146/297] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:40.195229 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:40.213887 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e23e1d-1609-409d-aefc-03df8402c852 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:40.214259 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e23e1d-1609-409d-aefc-03df8402c852 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:40.214695 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e23e1d-1609-409d-aefc-03df8402c852 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:40.222051 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 147/298] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:05:40.224402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b13e3-403f-4c7c-8059-76298014ce16 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:40.224787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b13e3-403f-4c7c-8059-76298014ce16 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:40.225165 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b13e3-403f-4c7c-8059-76298014ce16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:40.258633 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-686b13e3-403f-4c7c-8059-76298014ce16 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:40.258633 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-686b13e3-403f-4c7c-8059-76298014ce16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:40.259284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 152/299] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:05:40.382139 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 148/300] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:40.562222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6db8e6-5ce2-4f9e-8078-5da7178cd795 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:40.691003 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b13e3-403f-4c7c-8059-76298014ce16 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:40.730508 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6db8e6-5ce2-4f9e-8078-5da7178cd795 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:40.779434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8880989-b857-4e96-83c9-1462a96f9be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:40.780099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8880989-b857-4e96-83c9-1462a96f9be9 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:40.780464 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8880989-b857-4e96-83c9-1462a96f9be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:40.780912 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8880989-b857-4e96-83c9-1462a96f9be9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:40.797041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8880989-b857-4e96-83c9-1462a96f9be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:40.807980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-a8880989-b857-4e96-83c9-1462a96f9be9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:40.807980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:40.807980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:40.807980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:40.807980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:40.807980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:40.807980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:40.807980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:40.807980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:40.807980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:40.807980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:40.807980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:40.807980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:40.807980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:40.807980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:40.807980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:40.809586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:40.809586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:40.809586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:40.809586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:40.809586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:40.809586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:40.809586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:40.809586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:40.809586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:40.809586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:40.809586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:40.809586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:40.809586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:40.809586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:40.809586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:40.809586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:40.810980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:40.810980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:40.810980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:40.810980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:40.810980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:40.810980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:40.810980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:40.810980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:40.810980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:40.810980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:40.810980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:40.810980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:05:40.810980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 153/301] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:40.811989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8880989-b857-4e96-83c9-1462a96f9be9 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:40.871675 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:40.881466 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b13e3-403f-4c7c-8059-76298014ce16 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:40.906189 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:40.947827 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c8891-a5e9-44c1-a7c9-bbbc4bb660b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:40.949052 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c8891-a5e9-44c1-a7c9-bbbc4bb660b7 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:40.949422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c8891-a5e9-44c1-a7c9-bbbc4bb660b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:40.949702 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c8891-a5e9-44c1-a7c9-bbbc4bb660b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:40.951949 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c8891-a5e9-44c1-a7c9-bbbc4bb660b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:40.953461 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c8891-a5e9-44c1-a7c9-bbbc4bb660b7 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:40.956081 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 149/302] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:05:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:40.956757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c8891-a5e9-44c1-a7c9-bbbc4bb660b7 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:40.993249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8880989-b857-4e96-83c9-1462a96f9be9 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:41.064003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55bd08-5e18-4bcb-a114-051a5e581f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:41.065491 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55bd08-5e18-4bcb-a114-051a5e581f9e None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:41.065958 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55bd08-5e18-4bcb-a114-051a5e581f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:41.066439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55bd08-5e18-4bcb-a114-051a5e581f9e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:41.090566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55bd08-5e18-4bcb-a114-051a5e581f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:41.100642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-ac55bd08-5e18-4bcb-a114-051a5e581f9e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 01:05:41.100642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:41.100642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:41.100642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:41.100642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:41.100642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:41.100642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:41.100642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:41.100642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:41.100642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:41.100642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:41.100642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:41.100642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:41.100642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:41.100642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:41.100642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:41.102265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:41.102265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:41.102265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:41.102265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:41.102265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:41.102265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:41.102265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:41.102265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:41.102265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:41.102265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:41.102265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:41.102265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:41.102265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:41.102265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:41.102265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:41.102265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:41.105519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:41.105519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:41.105519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:41.105519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:41.105519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:41.105519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:41.105519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:41.105519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:41.105519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:41.105519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:41.105519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 01:05:41.105519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:05:41.105519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 154/303] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:41.105519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55bd08-5e18-4bcb-a114-051a5e581f9e None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:41.127098 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c8891-a5e9-44c1-a7c9-bbbc4bb660b7 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:41.185013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5650215-cabd-4621-a2ad-f01acaa335c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:41.186492 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5650215-cabd-4621-a2ad-f01acaa335c8 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:41.187141 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5650215-cabd-4621-a2ad-f01acaa335c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:41.187699 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5650215-cabd-4621-a2ad-f01acaa335c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:41.188805 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5650215-cabd-4621-a2ad-f01acaa335c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:41.189262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5650215-cabd-4621-a2ad-f01acaa335c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:41.191834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5650215-cabd-4621-a2ad-f01acaa335c8 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:41.207395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 150/304] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:41.208676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5650215-cabd-4621-a2ad-f01acaa335c8 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:41.277038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:41.298573 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:41.305902 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55bd08-5e18-4bcb-a114-051a5e581f9e None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:41.378234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5d71f-b22b-49bd-9b82-33c3d87dcb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:41.379360 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5d71f-b22b-49bd-9b82-33c3d87dcb33 None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:41.379854 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5d71f-b22b-49bd-9b82-33c3d87dcb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:41.380904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5d71f-b22b-49bd-9b82-33c3d87dcb33 None admin] PATH_INFO: `/v3/groups` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:41.382132 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5d71f-b22b-49bd-9b82-33c3d87dcb33 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:41.385030 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5d71f-b22b-49bd-9b82-33c3d87dcb33 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:41.400757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5650215-cabd-4621-a2ad-f01acaa335c8 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:41.467636 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e37442-c4b1-4f57-86dc-3d165eb62912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:41.468650 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e37442-c4b1-4f57-86dc-3d165eb62912 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:41.469131 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e37442-c4b1-4f57-86dc-3d165eb62912 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:41.469653 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e37442-c4b1-4f57-86dc-3d165eb62912 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:41.470912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e37442-c4b1-4f57-86dc-3d165eb62912 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:41.471356 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e37442-c4b1-4f57-86dc-3d165eb62912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:41.473931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e37442-c4b1-4f57-86dc-3d165eb62912 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:41.496972 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 151/305] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:41.496972 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e37442-c4b1-4f57-86dc-3d165eb62912 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:41.511243 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 155/306] 10.222.0.83 () {60 vars in 1134 bytes} [Fri Sep 23 01:05:41 2022] POST /identity/v3/groups => generated 229 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:05:41.513647 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5d71f-b22b-49bd-9b82-33c3d87dcb33 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:41.689394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e37442-c4b1-4f57-86dc-3d165eb62912 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:41.695537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:41.755883 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2968e-66ae-4b9b-abfc-02f95f5dc98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:41.757069 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2968e-66ae-4b9b-abfc-02f95f5dc98c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:41.757628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2968e-66ae-4b9b-abfc-02f95f5dc98c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:41.758103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2968e-66ae-4b9b-abfc-02f95f5dc98c None admin] PATH_INFO: `/v3/users/ec82beeefcd34264b324c5a1a699e488` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:41.760419 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2968e-66ae-4b9b-abfc-02f95f5dc98c None admin] RBAC: Authorizing `identity:get_user(user_id=ec82beeefcd34264b324c5a1a699e488)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:41.763232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2968e-66ae-4b9b-abfc-02f95f5dc98c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:41.772042 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 152/307] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:41 2022] GET /identity/v3/users/ec82beeefcd34264b324c5a1a699e488 => generated 293 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:41.774265 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2968e-66ae-4b9b-abfc-02f95f5dc98c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:41.777371 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5d71f-b22b-49bd-9b82-33c3d87dcb33 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:41.853391 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35330b2-5a68-4a3b-b9b5-dcb5c732f9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:41.854356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35330b2-5a68-4a3b-b9b5-dcb5c732f9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:41.855002 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35330b2-5a68-4a3b-b9b5-dcb5c732f9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:41.855656 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35330b2-5a68-4a3b-b9b5-dcb5c732f9c5 None admin] PATH_INFO: `/v3/users/6099aaad10364d35943d00ebabdd4f32` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:41.885616 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35330b2-5a68-4a3b-b9b5-dcb5c732f9c5 None admin] RBAC: Authorizing `identity:get_user(user_id=6099aaad10364d35943d00ebabdd4f32)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:41.889518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35330b2-5a68-4a3b-b9b5-dcb5c732f9c5 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:41.892818 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 156/308] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:41 2022] GET /identity/v3/users/6099aaad10364d35943d00ebabdd4f32 => generated 293 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:41.900788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35330b2-5a68-4a3b-b9b5-dcb5c732f9c5 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:41.922890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:42.009622 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2968e-66ae-4b9b-abfc-02f95f5dc98c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:42.100938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc4c58-ee99-4625-939c-c4785037466f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:42.102784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc4c58-ee99-4625-939c-c4785037466f None admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:42.103571 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc4c58-ee99-4625-939c-c4785037466f None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:42.104384 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc4c58-ee99-4625-939c-c4785037466f None admin] PATH_INFO: `/v3/system/users/ec82beeefcd34264b324c5a1a699e488/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:42.107569 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc4c58-ee99-4625-939c-c4785037466f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ec82beeefcd34264b324c5a1a699e488, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:42.110711 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc4c58-ee99-4625-939c-c4785037466f None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:42.136655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35330b2-5a68-4a3b-b9b5-dcb5c732f9c5 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:42.213871 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0615a22-6925-49e3-8575-5dc2193b62a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:42.215049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0615a22-6925-49e3-8575-5dc2193b62a9 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:42.215558 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0615a22-6925-49e3-8575-5dc2193b62a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:42.216065 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0615a22-6925-49e3-8575-5dc2193b62a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:42.217768 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0615a22-6925-49e3-8575-5dc2193b62a9 None admin] RBAC: Adding query filter params (role.id=4459bad5351b44b3b48d09c46d197855, user.id=6099aaad10364d35943d00ebabdd4f32, scope.system=all) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:42.218408 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0615a22-6925-49e3-8575-5dc2193b62a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:42.221647 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0615a22-6925-49e3-8575-5dc2193b62a9 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:42.232786 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 157/309] 10.222.0.83 () {56 vars in 1308 bytes} [Fri Sep 23 01:05:41 2022] GET /identity/v3/role_assignments?user.id=6099aaad10364d35943d00ebabdd4f32&scope.system=all&role.id=4459bad5351b44b3b48d09c46d197855 => generated 226 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:42.235244 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c810d0f-f71f-42df-9afa-544902a6b462 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:42.235743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c810d0f-f71f-42df-9afa-544902a6b462 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:42.236243 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c810d0f-f71f-42df-9afa-544902a6b462 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:42.239270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 158/310] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:42.249725 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b024f6-9f31-4184-9cc2-b60589df2a37 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:42.250230 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b024f6-9f31-4184-9cc2-b60589df2a37 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:42.250885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b024f6-9f31-4184-9cc2-b60589df2a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:42.267070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 153/311] 10.222.0.83 () {58 vars in 1334 bytes} [Fri Sep 23 01:05:41 2022] PUT /identity/v3/system/users/ec82beeefcd34264b324c5a1a699e488/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:05:42.287253 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-10b024f6-9f31-4184-9cc2-b60589df2a37 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:42.289755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-10b024f6-9f31-4184-9cc2-b60589df2a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:42.452338 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 159/312] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:05:42.999936 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc4c58-ee99-4625-939c-c4785037466f None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:43.073719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:43.216488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc4c58-ee99-4625-939c-c4785037466f None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:43.289896 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd42b9c-aeb5-4d7e-b42b-0a2f1b3e3ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:43.290981 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd42b9c-aeb5-4d7e-b42b-0a2f1b3e3ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:43.291455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd42b9c-aeb5-4d7e-b42b-0a2f1b3e3ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:43.291932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd42b9c-aeb5-4d7e-b42b-0a2f1b3e3ee8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:43.311155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd42b9c-aeb5-4d7e-b42b-0a2f1b3e3ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:43.320134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-1bd42b9c-aeb5-4d7e-b42b-0a2f1b3e3ee8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 01:05:43.320134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:43.320134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:43.320134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:43.320134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:43.320134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:43.320134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:43.320134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:43.320134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:43.320134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:43.320134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:43.320134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:43.320134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:43.320134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:43.320134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:43.320134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:43.321745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:43.321745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:43.321745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:43.321745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:43.321745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:43.321745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:43.321745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:43.321745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:43.321745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:43.321745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:43.321745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:43.321745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:43.321745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:43.321745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:43.321745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:43.321745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:43.322505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:43.322505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:43.322505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:43.322505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:43.322505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:43.322505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:43.322505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:43.322505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:43.322505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:43.322505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:43.322505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 01:05:43.322505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:43.322505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 154/313] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:43.331890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b024f6-9f31-4184-9cc2-b60589df2a37 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:43.339186 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:43.532756 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b024f6-9f31-4184-9cc2-b60589df2a37 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:43.600647 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fe7cc-328c-4ad3-a4dc-5fa3b5a0ea7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:43.601727 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fe7cc-328c-4ad3-a4dc-5fa3b5a0ea7c None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:43.602229 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fe7cc-328c-4ad3-a4dc-5fa3b5a0ea7c None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:43.602786 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fe7cc-328c-4ad3-a4dc-5fa3b5a0ea7c None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:43.603766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fe7cc-328c-4ad3-a4dc-5fa3b5a0ea7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:43.604405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fe7cc-328c-4ad3-a4dc-5fa3b5a0ea7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:43.606447 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fe7cc-328c-4ad3-a4dc-5fa3b5a0ea7c None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:43.620573 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 160/314] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:43.632672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd42b9c-aeb5-4d7e-b42b-0a2f1b3e3ee8 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:43.819834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:43.832389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd42b9c-aeb5-4d7e-b42b-0a2f1b3e3ee8 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:43.893041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5b839-1976-4a35-9a02-f4a7c32a4504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:43.893695 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5b839-1976-4a35-9a02-f4a7c32a4504 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:43.893976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5b839-1976-4a35-9a02-f4a7c32a4504 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:43.894241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5b839-1976-4a35-9a02-f4a7c32a4504 None admin] PATH_INFO: `/v3/users/5dc2b6e2dbc04121818769f13f5fee29` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:43.895543 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5b839-1976-4a35-9a02-f4a7c32a4504 None admin] RBAC: Authorizing `identity:get_user(user_id=5dc2b6e2dbc04121818769f13f5fee29)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:43.897132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5b839-1976-4a35-9a02-f4a7c32a4504 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:43.899209 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 155/315] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:43 2022] GET /identity/v3/users/5dc2b6e2dbc04121818769f13f5fee29 => generated 297 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:43.908174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fe7cc-328c-4ad3-a4dc-5fa3b5a0ea7c None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:44.028862 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:44.090269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fe7cc-328c-4ad3-a4dc-5fa3b5a0ea7c None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:44.135360 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80e582-dd7a-4840-8c96-37ed09f81f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:44.136377 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80e582-dd7a-4840-8c96-37ed09f81f40 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:44.136857 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80e582-dd7a-4840-8c96-37ed09f81f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:44.137339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80e582-dd7a-4840-8c96-37ed09f81f40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:44.232386 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80e582-dd7a-4840-8c96-37ed09f81f40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:44.234424 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80e582-dd7a-4840-8c96-37ed09f81f40 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:44.333800 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:44.397485 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 161/316] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:05:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:05:44.410652 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5b839-1976-4a35-9a02-f4a7c32a4504 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:44.568776 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5b839-1976-4a35-9a02-f4a7c32a4504 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:44.612756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0947bd-9849-4209-9b32-fb17e70ed5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:44.613469 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0947bd-9849-4209-9b32-fb17e70ed5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:44.613748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0947bd-9849-4209-9b32-fb17e70ed5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:44.614018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0947bd-9849-4209-9b32-fb17e70ed5d9 None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:44.615354 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0947bd-9849-4209-9b32-fb17e70ed5d9 None admin] RBAC: Authorizing `identity:get_project(project_id=6d9e32fd96ae4748a30237bde6c1463f)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:44.616812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0947bd-9849-4209-9b32-fb17e70ed5d9 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:44.618645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 156/317] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:44 2022] GET /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:44.628886 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80e582-dd7a-4840-8c96-37ed09f81f40 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:44.823111 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80e582-dd7a-4840-8c96-37ed09f81f40 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:44.899639 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3544a6-3dc4-46cb-8af6-a7e1bfe49828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:44.901026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3544a6-3dc4-46cb-8af6-a7e1bfe49828 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:44.901750 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3544a6-3dc4-46cb-8af6-a7e1bfe49828 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:44.902434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3544a6-3dc4-46cb-8af6-a7e1bfe49828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:44.904108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3544a6-3dc4-46cb-8af6-a7e1bfe49828 None admin] RBAC: Adding query filter params (role.id=4459bad5351b44b3b48d09c46d197855, scope.project.id=6d9e32fd96ae4748a30237bde6c1463f, user.id=5dc2b6e2dbc04121818769f13f5fee29) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:44.904880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3544a6-3dc4-46cb-8af6-a7e1bfe49828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:44.907982 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3544a6-3dc4-46cb-8af6-a7e1bfe49828 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:44.920541 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 162/318] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:05:44 2022] GET /identity/v3/role_assignments?user.id=5dc2b6e2dbc04121818769f13f5fee29&scope.project.id=6d9e32fd96ae4748a30237bde6c1463f&role.id=4459bad5351b44b3b48d09c46d197855 => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:44.970635 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36359d-9b0c-4424-91dd-cfe740630a8e None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:44.970635 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36359d-9b0c-4424-91dd-cfe740630a8e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:44.970635 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36359d-9b0c-4424-91dd-cfe740630a8e None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:44.973121 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 157/319] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:44.983862 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323e78c-d784-4282-abdf-f65ce86dc40d None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:44.984344 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323e78c-d784-4282-abdf-f65ce86dc40d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:44.984845 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323e78c-d784-4282-abdf-f65ce86dc40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:45.011837 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-6323e78c-d784-4282-abdf-f65ce86dc40d None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:45.013265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6323e78c-d784-4282-abdf-f65ce86dc40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:45.049186 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:45.114879 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 163/320] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:45.382424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6083ca-80a7-49f3-a85d-625e6f4ba63b None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:45.382935 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6083ca-80a7-49f3-a85d-625e6f4ba63b None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:45.383274 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6083ca-80a7-49f3-a85d-625e6f4ba63b None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:45.385548 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 158/321] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:45.393748 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036da5b7-1f46-4fde-a7c3-072fec46a9f1 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:45.394426 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036da5b7-1f46-4fde-a7c3-072fec46a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:45.394797 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036da5b7-1f46-4fde-a7c3-072fec46a9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:45.430040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-036da5b7-1f46-4fde-a7c3-072fec46a9f1 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:45.431449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-036da5b7-1f46-4fde-a7c3-072fec46a9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:45.519900 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 164/322] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:45.576662 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6083ca-80a7-49f3-a85d-625e6f4ba63b None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:45.636318 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:45.717213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065e3bb-3056-4d9b-ac25-8b9af6916fe9 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:45.717650 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065e3bb-3056-4d9b-ac25-8b9af6916fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:45.717905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065e3bb-3056-4d9b-ac25-8b9af6916fe9 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:45.721592 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 165/323] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:05:45.730890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d97e7-fbe3-4592-9658-7d4981f921e7 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:45.731393 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d97e7-fbe3-4592-9658-7d4981f921e7 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:45.731894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d97e7-fbe3-4592-9658-7d4981f921e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:45.760724 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6083ca-80a7-49f3-a85d-625e6f4ba63b None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:45.764557 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-4e1d97e7-fbe3-4592-9658-7d4981f921e7 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:45.766705 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4e1d97e7-fbe3-4592-9658-7d4981f921e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:45.824153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca35cd-1af4-46d7-ad06-fa93e93668ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:45.825748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca35cd-1af4-46d7-ad06-fa93e93668ec None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:45.826508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca35cd-1af4-46d7-ad06-fa93e93668ec None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:45.827220 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca35cd-1af4-46d7-ad06-fa93e93668ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:45.829100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca35cd-1af4-46d7-ad06-fa93e93668ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:45.831066 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca35cd-1af4-46d7-ad06-fa93e93668ec None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:45.833089 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 159/324] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:05:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:45.840926 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca35cd-1af4-46d7-ad06-fa93e93668ec None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:45.899991 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 166/325] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:05:45.967056 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d97e7-fbe3-4592-9658-7d4981f921e7 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:45.992158 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:46.038206 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:46.043661 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca35cd-1af4-46d7-ad06-fa93e93668ec None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:46.116184 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd48527-d06d-4019-92e1-2bdb906affac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:46.117239 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd48527-d06d-4019-92e1-2bdb906affac None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:46.117733 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd48527-d06d-4019-92e1-2bdb906affac None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:46.118218 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd48527-d06d-4019-92e1-2bdb906affac None admin] PATH_INFO: `/v3/groups` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:46.120427 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd48527-d06d-4019-92e1-2bdb906affac None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:46.123341 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd48527-d06d-4019-92e1-2bdb906affac None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:46.139371 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d97e7-fbe3-4592-9658-7d4981f921e7 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:46.201513 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48d210-7259-487a-b36c-62e185b1a066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:46.202413 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48d210-7259-487a-b36c-62e185b1a066 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:46.202949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48d210-7259-487a-b36c-62e185b1a066 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:46.203450 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48d210-7259-487a-b36c-62e185b1a066 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:46.222221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48d210-7259-487a-b36c-62e185b1a066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:46.231834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-9a48d210-7259-487a-b36c-62e185b1a066 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 01:05:46.231834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:46.231834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:46.231834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:46.231834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:46.231834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:46.231834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:46.231834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:46.231834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:46.231834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:46.231834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:46.231834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:46.231834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:46.231834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:46.231834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:46.231834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:46.233628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:46.233628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:46.233628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:46.233628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:46.233628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:46.233628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:46.233628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:46.233628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:46.233628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:46.233628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:46.233628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:46.233628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:46.233628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:46.233628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:46.233628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:46.233628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:46.238240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:46.238240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:46.238240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:46.238240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:46.238240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:46.238240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:46.238240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:46.238240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:46.238240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:46.238240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:46.238240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 01:05:46.238240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:05:46.238240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 167/326] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:05:46.244556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48d210-7259-487a-b36c-62e185b1a066 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:46.249056 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 160/327] 10.222.0.83 () {60 vars in 1134 bytes} [Fri Sep 23 01:05:45 2022] POST /identity/v3/groups => generated 226 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:05:46.251723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd48527-d06d-4019-92e1-2bdb906affac None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:46.408101 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:46.457527 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd48527-d06d-4019-92e1-2bdb906affac None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:46.458005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48d210-7259-487a-b36c-62e185b1a066 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:46.521328 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadff728-6d76-4a2a-a5a3-7498ba534ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:46.522110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadff728-6d76-4a2a-a5a3-7498ba534ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:46.522522 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadff728-6d76-4a2a-a5a3-7498ba534ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:46.522970 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadff728-6d76-4a2a-a5a3-7498ba534ae5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:46.525558 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ac71f-fe83-4d93-9b8a-f1065506622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:46.527260 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ac71f-fe83-4d93-9b8a-f1065506622c None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:46.528398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ac71f-fe83-4d93-9b8a-f1065506622c None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:46.529081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ac71f-fe83-4d93-9b8a-f1065506622c None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:46.530464 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ac71f-fe83-4d93-9b8a-f1065506622c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:46.531312 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ac71f-fe83-4d93-9b8a-f1065506622c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:46.533997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ac71f-fe83-4d93-9b8a-f1065506622c None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:46.543858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadff728-6d76-4a2a-a5a3-7498ba534ae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:46.545944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 168/328] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:46.553733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ac71f-fe83-4d93-9b8a-f1065506622c None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:46.555784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-eadff728-6d76-4a2a-a5a3-7498ba534ae5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:46.555784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:46.555784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:46.555784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:46.555784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:46.555784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:46.555784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:46.555784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:46.555784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:46.555784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:46.555784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:46.555784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:46.555784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:46.555784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:46.555784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:46.555784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:46.557413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:46.557413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:46.557413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:46.557413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:46.557413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:46.557413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:46.557413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:46.557413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:46.557413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:46.557413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:46.557413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:46.557413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:46.557413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:46.557413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:46.557413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:46.557413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:46.558377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:46.558377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:46.558377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:46.558377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:46.558377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:46.558377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:46.558377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:46.558377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:46.558377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:46.558377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:46.558377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:46.558377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:46.558377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 161/329] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:46.568216 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadff728-6d76-4a2a-a5a3-7498ba534ae5 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:46.615608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:46.766981 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ac71f-fe83-4d93-9b8a-f1065506622c None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:46.807635 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadff728-6d76-4a2a-a5a3-7498ba534ae5 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:46.815992 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8e7be-d30e-463b-b92e-62867e316e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:46.816741 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8e7be-d30e-463b-b92e-62867e316e09 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:46.817115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8e7be-d30e-463b-b92e-62867e316e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:46.817452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8e7be-d30e-463b-b92e-62867e316e09 None admin] PATH_INFO: `/v3/users/6099aaad10364d35943d00ebabdd4f32` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:46.820027 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8e7be-d30e-463b-b92e-62867e316e09 None admin] RBAC: Authorizing `identity:get_user(user_id=6099aaad10364d35943d00ebabdd4f32)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:46.823126 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8e7be-d30e-463b-b92e-62867e316e09 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:46.826680 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 169/330] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:46 2022] GET /identity/v3/users/6099aaad10364d35943d00ebabdd4f32 => generated 293 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:46.836271 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8e7be-d30e-463b-b92e-62867e316e09 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:46.861460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:46.899356 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84995740-ec14-45c6-ad7b-ed3ac3b5dbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:46.900082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84995740-ec14-45c6-ad7b-ed3ac3b5dbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:46.900436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84995740-ec14-45c6-ad7b-ed3ac3b5dbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:46.900801 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84995740-ec14-45c6-ad7b-ed3ac3b5dbe6 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:46.901846 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84995740-ec14-45c6-ad7b-ed3ac3b5dbe6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:46.902174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84995740-ec14-45c6-ad7b-ed3ac3b5dbe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:46.904738 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84995740-ec14-45c6-ad7b-ed3ac3b5dbe6 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:46.924797 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 162/331] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:46.940071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84995740-ec14-45c6-ad7b-ed3ac3b5dbe6 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:47.068992 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8e7be-d30e-463b-b92e-62867e316e09 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:47.108654 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:47.143166 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84995740-ec14-45c6-ad7b-ed3ac3b5dbe6 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:47.171857 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db6a39-c0fa-4b7d-b595-bd4b0df27fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:47.172928 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db6a39-c0fa-4b7d-b595-bd4b0df27fdd None admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:47.173225 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db6a39-c0fa-4b7d-b595-bd4b0df27fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:47.173509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db6a39-c0fa-4b7d-b595-bd4b0df27fdd None admin] PATH_INFO: `/v3/system/users/6099aaad10364d35943d00ebabdd4f32/roles/4459bad5351b44b3b48d09c46d197855` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:47.175769 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db6a39-c0fa-4b7d-b595-bd4b0df27fdd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6099aaad10364d35943d00ebabdd4f32, role_id=4459bad5351b44b3b48d09c46d197855)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:47.177437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db6a39-c0fa-4b7d-b595-bd4b0df27fdd None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:47.267895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b048e-0c05-48cc-88d2-11dd3f8a3328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:47.269098 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b048e-0c05-48cc-88d2-11dd3f8a3328 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:47.269937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b048e-0c05-48cc-88d2-11dd3f8a3328 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:47.270404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b048e-0c05-48cc-88d2-11dd3f8a3328 None admin] PATH_INFO: `/v3/users/ec82beeefcd34264b324c5a1a699e488` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:47.273928 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b048e-0c05-48cc-88d2-11dd3f8a3328 None admin] RBAC: Authorizing `identity:get_user(user_id=ec82beeefcd34264b324c5a1a699e488)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:47.276637 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b048e-0c05-48cc-88d2-11dd3f8a3328 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:47.278944 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 163/332] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:46 2022] GET /identity/v3/users/ec82beeefcd34264b324c5a1a699e488 => generated 293 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:47.289958 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b048e-0c05-48cc-88d2-11dd3f8a3328 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:47.294684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 170/333] 10.222.0.83 () {58 vars in 1334 bytes} [Fri Sep 23 01:05:46 2022] PUT /identity/v3/system/users/6099aaad10364d35943d00ebabdd4f32/roles/4459bad5351b44b3b48d09c46d197855 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:05:47.521212 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b048e-0c05-48cc-88d2-11dd3f8a3328 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:47.604337 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06449912-0d4e-4f71-9f5b-e808e162ea72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:47.605936 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449912-0d4e-4f71-9f5b-e808e162ea72 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:47.606755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449912-0d4e-4f71-9f5b-e808e162ea72 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:47.607579 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449912-0d4e-4f71-9f5b-e808e162ea72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:47.609206 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06449912-0d4e-4f71-9f5b-e808e162ea72 None admin] RBAC: Adding query filter params (role.id=986891361f4f4893a1cb2d0e0b523bff, user.id=ec82beeefcd34264b324c5a1a699e488, scope.system=all) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:47.609999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06449912-0d4e-4f71-9f5b-e808e162ea72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:47.613152 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06449912-0d4e-4f71-9f5b-e808e162ea72 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:47.639109 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 164/334] 10.222.0.83 () {56 vars in 1308 bytes} [Fri Sep 23 01:05:47 2022] GET /identity/v3/role_assignments?user.id=ec82beeefcd34264b324c5a1a699e488&scope.system=all&role.id=986891361f4f4893a1cb2d0e0b523bff => generated 510 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:50.832664 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b046a0-f895-45ac-a8ab-35a609ec3967 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:50.833614 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b046a0-f895-45ac-a8ab-35a609ec3967 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:50.833759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b046a0-f895-45ac-a8ab-35a609ec3967 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:50.836351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 171/335] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:50.843666 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c6d2-46e3-4fff-aa40-80d9f85a7f88 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:50.844496 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c6d2-46e3-4fff-aa40-80d9f85a7f88 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:50.844496 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c6d2-46e3-4fff-aa40-80d9f85a7f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:50.871944 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-0426c6d2-46e3-4fff-aa40-80d9f85a7f88 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:50.873543 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-0426c6d2-46e3-4fff-aa40-80d9f85a7f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:50.877528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:51.000568 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 165/336] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:51.197542 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56e35c-fedc-4f20-a326-66b29806f52e None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:51.198532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56e35c-fedc-4f20-a326-66b29806f52e None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:51.199348 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56e35c-fedc-4f20-a326-66b29806f52e None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:51.202178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 172/337] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:51.213850 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219bbe2-272a-4fea-be91-fdebd56b5f2e None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:51.214704 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219bbe2-272a-4fea-be91-fdebd56b5f2e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:51.215204 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219bbe2-272a-4fea-be91-fdebd56b5f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:51.230046 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bca94-343c-4a8f-8939-af11f63f5ac9 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:51.231034 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bca94-343c-4a8f-8939-af11f63f5ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:51.231827 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bca94-343c-4a8f-8939-af11f63f5ac9 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:51.234908 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 173/338] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:51.243622 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63dd38-1aa6-4266-a145-5a8bb7e2a5b6 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:51.244506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63dd38-1aa6-4266-a145-5a8bb7e2a5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:51.245392 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63dd38-1aa6-4266-a145-5a8bb7e2a5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:51.245903 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-1219bbe2-272a-4fea-be91-fdebd56b5f2e None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:51.247441 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-1219bbe2-272a-4fea-be91-fdebd56b5f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:51.292751 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-4b63dd38-1aa6-4266-a145-5a8bb7e2a5b6 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:51.295365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4b63dd38-1aa6-4266-a145-5a8bb7e2a5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:51.420292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 166/339] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:51.477853 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 174/340] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:51.680890 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219bbe2-272a-4fea-be91-fdebd56b5f2e None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:51.857041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:51.917042 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63dd38-1aa6-4266-a145-5a8bb7e2a5b6 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:51.926640 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:51.934551 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219bbe2-272a-4fea-be91-fdebd56b5f2e None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:52.053104 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4434e-2fc2-455e-9196-9e9597d275bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:52.054522 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4434e-2fc2-455e-9196-9e9597d275bc None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:52.055215 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4434e-2fc2-455e-9196-9e9597d275bc None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:52.055878 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4434e-2fc2-455e-9196-9e9597d275bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:52.100303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4434e-2fc2-455e-9196-9e9597d275bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:52.106573 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63dd38-1aa6-4266-a145-5a8bb7e2a5b6 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:52.111834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-a8a4434e-2fc2-455e-9196-9e9597d275bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:52.111834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:52.111834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:52.111834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:52.111834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:52.111834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:52.111834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:52.111834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:52.111834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:52.111834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:52.111834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:52.111834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:52.111834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:52.111834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:52.111834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:52.111834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:52.113024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:52.113024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:52.113024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:52.113024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:52.113024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:52.113024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:52.113024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:52.113024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:52.113024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:52.113024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:52.113024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:52.113024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:52.113024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:52.113024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:52.113024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:52.113024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:52.113937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:52.113937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:52.113937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:52.113937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:52.113937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:52.113937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:52.113937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:52.113937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:52.113937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:52.113937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:52.113937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:52.113937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:52.117691 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 167/341] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:52.119597 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbe20f-7dda-4617-a93b-b86919b87c89 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:52.120232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbe20f-7dda-4617-a93b-b86919b87c89 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:52.120878 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbe20f-7dda-4617-a93b-b86919b87c89 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:52.127516 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 168/342] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:52.128882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbe20f-7dda-4617-a93b-b86919b87c89 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:52.177700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d857c55-c7f3-4200-aa30-0ca371b5d612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:52.179179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d857c55-c7f3-4200-aa30-0ca371b5d612 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:52.179481 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d857c55-c7f3-4200-aa30-0ca371b5d612 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:52.179777 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d857c55-c7f3-4200-aa30-0ca371b5d612 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:52.203148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d857c55-c7f3-4200-aa30-0ca371b5d612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:52.213494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-4d857c55-c7f3-4200-aa30-0ca371b5d612 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:05:52.213494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:52.213494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:52.213494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:52.213494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:52.213494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:52.213494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:52.213494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:52.213494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:52.213494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:52.213494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:52.213494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:52.213494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:52.213494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:52.213494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:52.213494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:52.214678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:52.214678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:52.214678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:52.214678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:52.214678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:52.214678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:52.214678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:52.214678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:52.214678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:52.214678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:52.214678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:52.214678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:52.214678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:52.214678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:52.214678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:52.214678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:52.215690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:52.215690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:52.215690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:52.215690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:52.215690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:52.215690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:52.215690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:52.215690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:52.215690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:52.215690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:52.215690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:05:52.215690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:05:52.215690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 175/343] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:05:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:52.218510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d857c55-c7f3-4200-aa30-0ca371b5d612 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:52.277324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbe20f-7dda-4617-a93b-b86919b87c89 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:52.329159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:52.338884 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:52.352410 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23a5b0-65cf-4d78-bd63-ea666cdda801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:52.353355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23a5b0-65cf-4d78-bd63-ea666cdda801 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:52.353794 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23a5b0-65cf-4d78-bd63-ea666cdda801 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:52.354818 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23a5b0-65cf-4d78-bd63-ea666cdda801 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:52.355737 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23a5b0-65cf-4d78-bd63-ea666cdda801 None admin] RBAC: Adding query filter params (name=member) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:52.356189 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23a5b0-65cf-4d78-bd63-ea666cdda801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:52.359539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23a5b0-65cf-4d78-bd63-ea666cdda801 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:52.372976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 169/344] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:52.374821 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5cd1a-4e21-47ea-a326-fb8ec5cfdf8b None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:52.375472 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5cd1a-4e21-47ea-a326-fb8ec5cfdf8b None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:52.375947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5cd1a-4e21-47ea-a326-fb8ec5cfdf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:52.393839 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d857c55-c7f3-4200-aa30-0ca371b5d612 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:52.407139 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-3ea5cd1a-4e21-47ea-a326-fb8ec5cfdf8b None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:52.409945 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-3ea5cd1a-4e21-47ea-a326-fb8ec5cfdf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:52.464941 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3413c-b295-430b-81b6-afe42345effe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:52.466278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3413c-b295-430b-81b6-afe42345effe None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:52.466979 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3413c-b295-430b-81b6-afe42345effe None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:52.467642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3413c-b295-430b-81b6-afe42345effe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:52.487007 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3413c-b295-430b-81b6-afe42345effe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:52.496037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-4ef3413c-b295-430b-81b6-afe42345effe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:52.496037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:52.496037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:52.496037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:52.496037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:52.496037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:52.496037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:52.496037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:52.496037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:52.496037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:52.496037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:52.496037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:52.496037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:52.496037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:52.496037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:52.496037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:52.497791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:52.497791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:52.497791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:52.497791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:52.497791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:52.497791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:52.497791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:52.497791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:52.497791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:52.497791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:52.497791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:52.497791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:52.497791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:52.497791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:52.497791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:52.497791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:52.499446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:52.499446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:52.499446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:52.499446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:52.499446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:52.499446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:52.499446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:52.499446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:52.499446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:52.499446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:52.499446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:05:52.499446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:05:52.503900 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 176/345] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:52.506441 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3413c-b295-430b-81b6-afe42345effe None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:52.530398 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 170/346] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:52.531930 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5cd1a-4e21-47ea-a326-fb8ec5cfdf8b None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:52.685618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5cd1a-4e21-47ea-a326-fb8ec5cfdf8b None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:52.731192 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:52.753846 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c1c2f-2294-442e-90d7-ed150bf357dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:52.755413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c1c2f-2294-442e-90d7-ed150bf357dc None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:52.755869 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c1c2f-2294-442e-90d7-ed150bf357dc None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:52.756351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c1c2f-2294-442e-90d7-ed150bf357dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:52.870010 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3413c-b295-430b-81b6-afe42345effe None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:52.897282 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c1c2f-2294-442e-90d7-ed150bf357dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:52.899378 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c1c2f-2294-442e-90d7-ed150bf357dc None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:52.974197 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:53.039689 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8dc683-8bf1-49a5-819e-c01a8ad2a4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:53.041312 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dc683-8bf1-49a5-819e-c01a8ad2a4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:53.042161 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dc683-8bf1-49a5-819e-c01a8ad2a4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:53.042945 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dc683-8bf1-49a5-819e-c01a8ad2a4c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:53.044498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dc683-8bf1-49a5-819e-c01a8ad2a4c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:53.045260 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dc683-8bf1-49a5-819e-c01a8ad2a4c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:53.048234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dc683-8bf1-49a5-819e-c01a8ad2a4c6 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:53.078701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 177/347] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:05:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 574 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:53.080910 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 171/348] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:05:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:05:53.081462 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8dc683-8bf1-49a5-819e-c01a8ad2a4c6 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:53.088891 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c1c2f-2294-442e-90d7-ed150bf357dc None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:53.130994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:53.250109 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c1c2f-2294-442e-90d7-ed150bf357dc None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:53.317474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4fcc1-a263-4b24-b39e-03887fda43bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:53.317474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4fcc1-a263-4b24-b39e-03887fda43bc None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:53.317474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4fcc1-a263-4b24-b39e-03887fda43bc None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:53.317474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4fcc1-a263-4b24-b39e-03887fda43bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:53.405484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8dc683-8bf1-49a5-819e-c01a8ad2a4c6 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:53.475753 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4fcc1-a263-4b24-b39e-03887fda43bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:53.478328 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4fcc1-a263-4b24-b39e-03887fda43bc None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:53.482257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07ba86-a318-4433-9516-cd5a2431b3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:53.485182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07ba86-a318-4433-9516-cd5a2431b3fd None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:53.485712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07ba86-a318-4433-9516-cd5a2431b3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:53.486173 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07ba86-a318-4433-9516-cd5a2431b3fd None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:53.487674 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07ba86-a318-4433-9516-cd5a2431b3fd None admin] RBAC: Adding query filter params (name=member) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:53.488209 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07ba86-a318-4433-9516-cd5a2431b3fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:53.491510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07ba86-a318-4433-9516-cd5a2431b3fd None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:53.513174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 178/349] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:53.514830 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07ba86-a318-4433-9516-cd5a2431b3fd None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:53.527001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:53.598319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:53.680744 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 172/350] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:05:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 01:05:53.684345 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeb8b4-8383-49e5-9028-1311c09b299e None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:53.684956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeb8b4-8383-49e5-9028-1311c09b299e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:53.685525 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeb8b4-8383-49e5-9028-1311c09b299e None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:53.689032 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 173/351] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:53.690801 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aeb8b4-8383-49e5-9028-1311c09b299e None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:53.718541 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07ba86-a318-4433-9516-cd5a2431b3fd None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:53.788498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442846e-de27-4596-8141-4135710e3d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:53.789102 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442846e-de27-4596-8141-4135710e3d20 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:53.789385 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442846e-de27-4596-8141-4135710e3d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:53.789658 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442846e-de27-4596-8141-4135710e3d20 None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:53.791050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442846e-de27-4596-8141-4135710e3d20 None admin] RBAC: Authorizing `identity:get_project(project_id=612f86bc1b6c4d8ab8393c2393a01341)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:53.792558 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442846e-de27-4596-8141-4135710e3d20 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:53.794521 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 179/352] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:53 2022] GET /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:53.795748 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442846e-de27-4596-8141-4135710e3d20 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:53.882430 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aeb8b4-8383-49e5-9028-1311c09b299e None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:53.922470 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:53.943710 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ff233-dcc0-4f2e-98d3-5c833b6493e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:53.944741 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ff233-dcc0-4f2e-98d3-5c833b6493e2 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:53.945220 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ff233-dcc0-4f2e-98d3-5c833b6493e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:53.945687 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ff233-dcc0-4f2e-98d3-5c833b6493e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:53.963562 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ff233-dcc0-4f2e-98d3-5c833b6493e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:53.969025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-9d9ff233-dcc0-4f2e-98d3-5c833b6493e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 01:05:53.969025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:53.969025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:53.969025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:53.969025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:53.969025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:53.969025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:53.969025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:53.969025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:53.969025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:53.969025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:53.969025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:53.969025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:53.969025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:53.969025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:53.969025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:53.969987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:53.969987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:53.969987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:53.969987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:53.969987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:53.969987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:53.969987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:53.969987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:53.969987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:53.969987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:53.969987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:53.969987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:53.969987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:53.969987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:53.969987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:53.969987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:53.970841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:53.970841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:53.970841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:53.970841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:53.970841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:53.970841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:53.970841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:53.970841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:53.970841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:53.970841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:53.970841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 01:05:53.970841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:53.970841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 174/353] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:53.972694 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ff233-dcc0-4f2e-98d3-5c833b6493e2 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:54.016540 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442846e-de27-4596-8141-4135710e3d20 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:54.041571 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:54.085522 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535f8b1-8372-4710-a4c2-18cf86519154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:54.086661 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535f8b1-8372-4710-a4c2-18cf86519154 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:54.086842 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535f8b1-8372-4710-a4c2-18cf86519154 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:54.087057 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535f8b1-8372-4710-a4c2-18cf86519154 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:54.140413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ff233-dcc0-4f2e-98d3-5c833b6493e2 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:54.204130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35f9a4-8466-4d2d-a4db-2a8e1766944a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:54.205945 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35f9a4-8466-4d2d-a4db-2a8e1766944a None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:54.206854 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35f9a4-8466-4d2d-a4db-2a8e1766944a None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:54.207343 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35f9a4-8466-4d2d-a4db-2a8e1766944a None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:54.210445 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35f9a4-8466-4d2d-a4db-2a8e1766944a None admin] RBAC: Authorizing `identity:get_project(project_id=612f86bc1b6c4d8ab8393c2393a01341)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:54.216008 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35f9a4-8466-4d2d-a4db-2a8e1766944a None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:54.217710 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 175/354] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:53 2022] GET /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:54.220782 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4b85c-2c51-4370-aa52-64f59175ec9a None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:54.220782 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4b85c-2c51-4370-aa52-64f59175ec9a None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:54.220782 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4b85c-2c51-4370-aa52-64f59175ec9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:54.233015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535f8b1-8372-4710-a4c2-18cf86519154 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:54.236045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535f8b1-8372-4710-a4c2-18cf86519154 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:54.257710 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-91f4b85c-2c51-4370-aa52-64f59175ec9a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:54.259930 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-91f4b85c-2c51-4370-aa52-64f59175ec9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:54.352161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:54.398813 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 176/355] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:54.400751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4b85c-2c51-4370-aa52-64f59175ec9a None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:54.462143 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 180/356] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:05:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:05:54.465303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b038679-7879-4370-90c5-61eeb27066d9 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:54.466111 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b038679-7879-4370-90c5-61eeb27066d9 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:54.467056 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b038679-7879-4370-90c5-61eeb27066d9 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:54.470095 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 181/357] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:54.473098 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b038679-7879-4370-90c5-61eeb27066d9 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:54.502733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:54.599557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4b85c-2c51-4370-aa52-64f59175ec9a None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:54.673369 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c368c-1298-459f-abde-33d2e986ed13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:54.675319 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c368c-1298-459f-abde-33d2e986ed13 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:54.676167 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c368c-1298-459f-abde-33d2e986ed13 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:54.676965 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c368c-1298-459f-abde-33d2e986ed13 None admin] PATH_INFO: `/v3/groups/73f02e5440a544418afcb8d84f2dfd1e` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:54.691709 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c368c-1298-459f-abde-33d2e986ed13 None admin] RBAC: Authorizing `identity:get_group(group_id=73f02e5440a544418afcb8d84f2dfd1e)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:54.694698 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b038679-7879-4370-90c5-61eeb27066d9 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:54.694972 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c368c-1298-459f-abde-33d2e986ed13 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:54.698759 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 177/358] 10.222.0.83 () {56 vars in 1180 bytes} [Fri Sep 23 01:05:54 2022] GET /identity/v3/groups/73f02e5440a544418afcb8d84f2dfd1e => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:54.700375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c368c-1298-459f-abde-33d2e986ed13 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:54.765072 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2092d9-edcf-4199-842b-1574ab023265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:54.766652 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2092d9-edcf-4199-842b-1574ab023265 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:54.767400 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2092d9-edcf-4199-842b-1574ab023265 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:54.768120 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2092d9-edcf-4199-842b-1574ab023265 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:54.769803 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2092d9-edcf-4199-842b-1574ab023265 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:54.771317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2092d9-edcf-4199-842b-1574ab023265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:54.774025 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2092d9-edcf-4199-842b-1574ab023265 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:54.790926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 182/359] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:05:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:54.791708 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:54.794783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1d553-1bef-4104-b535-6935c94e97bf None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:54.795702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1d553-1bef-4104-b535-6935c94e97bf None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:54.796578 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1d553-1bef-4104-b535-6935c94e97bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:54.829842 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-61e1d553-1bef-4104-b535-6935c94e97bf None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:54.831898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-61e1d553-1bef-4104-b535-6935c94e97bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:54.916762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c368c-1298-459f-abde-33d2e986ed13 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:54.979509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 183/360] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:05:54.981675 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1d553-1bef-4104-b535-6935c94e97bf None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:54.997165 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b1b70-61ba-4e2d-a012-ebb4ab6cae02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:54.998357 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:55.000146 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b1b70-61ba-4e2d-a012-ebb4ab6cae02 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:55.001052 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b1b70-61ba-4e2d-a012-ebb4ab6cae02 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:55.001725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b1b70-61ba-4e2d-a012-ebb4ab6cae02 None admin] PATH_INFO: `/v3/groups/73f02e5440a544418afcb8d84f2dfd1e` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:55.006971 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b1b70-61ba-4e2d-a012-ebb4ab6cae02 None admin] RBAC: Authorizing `identity:get_group(group_id=73f02e5440a544418afcb8d84f2dfd1e)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:55.015137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b1b70-61ba-4e2d-a012-ebb4ab6cae02 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:55.015137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 178/361] 10.222.0.83 () {56 vars in 1180 bytes} [Fri Sep 23 01:05:54 2022] GET /identity/v3/groups/73f02e5440a544418afcb8d84f2dfd1e => generated 226 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:55.015137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b1b70-61ba-4e2d-a012-ebb4ab6cae02 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:55.211084 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1d553-1bef-4104-b535-6935c94e97bf None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:55.235265 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b1b70-61ba-4e2d-a012-ebb4ab6cae02 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:55.256569 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:55.288208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f106b61-f783-4020-bd5a-a9da53c939a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:55.288909 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f106b61-f783-4020-bd5a-a9da53c939a5 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:55.289064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dfad6-b959-4049-beb3-ffa36f55abc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:55.289381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f106b61-f783-4020-bd5a-a9da53c939a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:55.289554 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f106b61-f783-4020-bd5a-a9da53c939a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:55.290086 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dfad6-b959-4049-beb3-ffa36f55abc6 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:55.290326 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f106b61-f783-4020-bd5a-a9da53c939a5 None admin] RBAC: Adding query filter params (group.id=73f02e5440a544418afcb8d84f2dfd1e, role.id=986891361f4f4893a1cb2d0e0b523bff, scope.project.id=612f86bc1b6c4d8ab8393c2393a01341) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:55.290566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dfad6-b959-4049-beb3-ffa36f55abc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:55.290762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f106b61-f783-4020-bd5a-a9da53c939a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:55.291045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dfad6-b959-4049-beb3-ffa36f55abc6 None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:55.292372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f106b61-f783-4020-bd5a-a9da53c939a5 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:55.293324 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337dfad6-b959-4049-beb3-ffa36f55abc6 None admin] RBAC: Authorizing `identity:get_project(project_id=6d9e32fd96ae4748a30237bde6c1463f)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:55.296204 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337dfad6-b959-4049-beb3-ffa36f55abc6 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:55.307911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 184/362] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:54 2022] GET /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:55.308215 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 179/363] 10.222.0.83 () {56 vars in 1376 bytes} [Fri Sep 23 01:05:55 2022] GET /identity/v3/role_assignments?group.id=73f02e5440a544418afcb8d84f2dfd1e&scope.project.id=612f86bc1b6c4d8ab8393c2393a01341&role.id=986891361f4f4893a1cb2d0e0b523bff => generated 260 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:55.308367 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dfad6-b959-4049-beb3-ffa36f55abc6 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:55.311653 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f106b61-f783-4020-bd5a-a9da53c939a5 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:55.496061 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:55.515358 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f106b61-f783-4020-bd5a-a9da53c939a5 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:55.546841 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dfad6-b959-4049-beb3-ffa36f55abc6 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:55.568778 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3b71b-b58c-41fb-844e-a3fc223c4d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:55.569910 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3b71b-b58c-41fb-844e-a3fc223c4d1c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:55.570411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3b71b-b58c-41fb-844e-a3fc223c4d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:55.571720 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3b71b-b58c-41fb-844e-a3fc223c4d1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:55.589726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3b71b-b58c-41fb-844e-a3fc223c4d1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:55.596838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-61c3b71b-b58c-41fb-844e-a3fc223c4d1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:05:55.596838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:55.596838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:55.596838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:55.596838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:55.596838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:55.596838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:55.596838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:55.596838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:55.596838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:55.596838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:55.596838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:55.596838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:55.596838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:55.596838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:55.596838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:55.598031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:55.598031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:55.598031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:55.598031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:55.598031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:55.598031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:55.598031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:55.598031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:55.598031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:55.598031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:55.598031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:55.598031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:55.598031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:55.598031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:55.598031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:55.598031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:55.600852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:55.600852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:55.600852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:55.600852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:55.600852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:55.600852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:55.600852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:55.600852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:55.600852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:55.600852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:55.600852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:05:55.600852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:05:55.600852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 180/364] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:05:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:55.600852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3b71b-b58c-41fb-844e-a3fc223c4d1c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:55.622339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71f66b-c744-4d04-a7d5-1a9abd76925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:55.622339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71f66b-c744-4d04-a7d5-1a9abd76925a None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:55.622767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71f66b-c744-4d04-a7d5-1a9abd76925a None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:55.623387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71f66b-c744-4d04-a7d5-1a9abd76925a None admin] PATH_INFO: `/v3/users/6099aaad10364d35943d00ebabdd4f32` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:55.625153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71f66b-c744-4d04-a7d5-1a9abd76925a None admin] RBAC: Authorizing `identity:get_user(user_id=6099aaad10364d35943d00ebabdd4f32)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:55.626814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71f66b-c744-4d04-a7d5-1a9abd76925a None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:55.629060 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 185/365] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:05:55 2022] GET /identity/v3/users/6099aaad10364d35943d00ebabdd4f32 => generated 293 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:55.630559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71f66b-c744-4d04-a7d5-1a9abd76925a None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:55.664012 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:55.803935 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71f66b-c744-4d04-a7d5-1a9abd76925a None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:55.805515 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3b71b-b58c-41fb-844e-a3fc223c4d1c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:55.849256 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4d9a0-2b70-4d4b-9a79-8abbc48d93f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:55.850149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4d9a0-2b70-4d4b-9a79-8abbc48d93f6 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:55.850637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4d9a0-2b70-4d4b-9a79-8abbc48d93f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:55.851038 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4d9a0-2b70-4d4b-9a79-8abbc48d93f6 None admin] PATH_INFO: `/v3/groups/73f02e5440a544418afcb8d84f2dfd1e` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:55.852685 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4d9a0-2b70-4d4b-9a79-8abbc48d93f6 None admin] RBAC: Authorizing `identity:get_group(group_id=73f02e5440a544418afcb8d84f2dfd1e)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:55.854468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4d9a0-2b70-4d4b-9a79-8abbc48d93f6 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:55.863997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 186/366] 10.222.0.83 () {56 vars in 1180 bytes} [Fri Sep 23 01:05:55 2022] GET /identity/v3/groups/73f02e5440a544418afcb8d84f2dfd1e => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:55.863997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4d9a0-2b70-4d4b-9a79-8abbc48d93f6 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:55.878507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:55.879484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25778ce4-729b-458a-93f3-c6e3f95d650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:55.880633 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25778ce4-729b-458a-93f3-c6e3f95d650a None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:55.881120 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25778ce4-729b-458a-93f3-c6e3f95d650a None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:55.881610 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25778ce4-729b-458a-93f3-c6e3f95d650a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:55.882934 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25778ce4-729b-458a-93f3-c6e3f95d650a None admin] RBAC: Adding query filter params (group.id=73f02e5440a544418afcb8d84f2dfd1e, role.id=a9e6249ed8cd44ce9fac74a4c8155978, scope.project.id=612f86bc1b6c4d8ab8393c2393a01341) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:55.883463 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25778ce4-729b-458a-93f3-c6e3f95d650a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:55.886453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25778ce4-729b-458a-93f3-c6e3f95d650a None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:55.896979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 181/367] 10.222.0.83 () {56 vars in 1376 bytes} [Fri Sep 23 01:05:55 2022] GET /identity/v3/role_assignments?group.id=73f02e5440a544418afcb8d84f2dfd1e&scope.project.id=612f86bc1b6c4d8ab8393c2393a01341&role.id=a9e6249ed8cd44ce9fac74a4c8155978 => generated 260 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:55.900892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25778ce4-729b-458a-93f3-c6e3f95d650a None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:56.080043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4d9a0-2b70-4d4b-9a79-8abbc48d93f6 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:56.127019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:56.137450 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25778ce4-729b-458a-93f3-c6e3f95d650a None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:56.155978 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf22b6-5f2d-4dca-98a2-9e75249958fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:56.157068 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf22b6-5f2d-4dca-98a2-9e75249958fa None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:56.157556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf22b6-5f2d-4dca-98a2-9e75249958fa None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:56.158042 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf22b6-5f2d-4dca-98a2-9e75249958fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:56.181342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf22b6-5f2d-4dca-98a2-9e75249958fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:05:56.192961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-8daf22b6-5f2d-4dca-98a2-9e75249958fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:05:56.192961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:05:56.192961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:05:56.192961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:05:56.192961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:05:56.192961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:05:56.192961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:05:56.192961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:05:56.192961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:05:56.192961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:05:56.192961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:05:56.192961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:05:56.192961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:05:56.192961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:05:56.192961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:05:56.192961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:05:56.194667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:05:56.194667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:05:56.194667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:05:56.194667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:05:56.194667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:05:56.194667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:05:56.194667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:05:56.194667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:05:56.194667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:05:56.194667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:05:56.194667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:05:56.194667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:05:56.194667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:05:56.194667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:05:56.194667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:05:56.194667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:05:56.196452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:05:56.196452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:05:56.196452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:05:56.196452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:05:56.196452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:05:56.196452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:05:56.196452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:05:56.196452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:05:56.196452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:05:56.196452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:05:56.196452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:05:56.196452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:05:56.197602 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 187/368] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:05:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:05:56.198992 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf22b6-5f2d-4dca-98a2-9e75249958fa None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:56.224258 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061a7ba-4b25-4e3c-bcb4-b6b96d59a4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:56.226118 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061a7ba-4b25-4e3c-bcb4-b6b96d59a4dc None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:56.227368 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061a7ba-4b25-4e3c-bcb4-b6b96d59a4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:56.228220 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061a7ba-4b25-4e3c-bcb4-b6b96d59a4dc None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:56.229745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061a7ba-4b25-4e3c-bcb4-b6b96d59a4dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:56.230721 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061a7ba-4b25-4e3c-bcb4-b6b96d59a4dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:56.233765 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061a7ba-4b25-4e3c-bcb4-b6b96d59a4dc None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:56.250530 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 182/369] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:05:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:56.252519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061a7ba-4b25-4e3c-bcb4-b6b96d59a4dc None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:56.348262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:56.404922 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf22b6-5f2d-4dca-98a2-9e75249958fa None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:56.450164 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc41050-feb1-49a4-aee8-889d20942036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:56.450956 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc41050-feb1-49a4-aee8-889d20942036 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:56.451426 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc41050-feb1-49a4-aee8-889d20942036 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:56.451885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc41050-feb1-49a4-aee8-889d20942036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:56.453277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc41050-feb1-49a4-aee8-889d20942036 None admin] RBAC: Adding query filter params (role.id=4459bad5351b44b3b48d09c46d197855, user.id=6099aaad10364d35943d00ebabdd4f32, scope.system=all) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:56.453813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc41050-feb1-49a4-aee8-889d20942036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:56.456736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc41050-feb1-49a4-aee8-889d20942036 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:56.485441 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061a7ba-4b25-4e3c-bcb4-b6b96d59a4dc None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:56.487088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 188/370] 10.222.0.83 () {56 vars in 1308 bytes} [Fri Sep 23 01:05:56 2022] GET /identity/v3/role_assignments?user.id=6099aaad10364d35943d00ebabdd4f32&scope.system=all&role.id=4459bad5351b44b3b48d09c46d197855 => generated 510 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:56.488197 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc41050-feb1-49a4-aee8-889d20942036 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:56.569382 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d145a4c-125d-4154-af66-b37a29e17404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:56.571369 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d145a4c-125d-4154-af66-b37a29e17404 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:56.572260 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d145a4c-125d-4154-af66-b37a29e17404 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:56.573169 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d145a4c-125d-4154-af66-b37a29e17404 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:56.575071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d145a4c-125d-4154-af66-b37a29e17404 None admin] RBAC: Adding query filter params (group.id=73f02e5440a544418afcb8d84f2dfd1e, role.id=986891361f4f4893a1cb2d0e0b523bff, scope.project.id=6d9e32fd96ae4748a30237bde6c1463f) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:56.581432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d145a4c-125d-4154-af66-b37a29e17404 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:56.585797 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d145a4c-125d-4154-af66-b37a29e17404 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:56.610172 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 183/371] 10.222.0.83 () {56 vars in 1376 bytes} [Fri Sep 23 01:05:56 2022] GET /identity/v3/role_assignments?group.id=73f02e5440a544418afcb8d84f2dfd1e&scope.project.id=6d9e32fd96ae4748a30237bde6c1463f&role.id=986891361f4f4893a1cb2d0e0b523bff => generated 260 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:56.612478 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d145a4c-125d-4154-af66-b37a29e17404 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:56.685258 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:56.691638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc41050-feb1-49a4-aee8-889d20942036 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:56.739737 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:56.754522 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d389027-4de8-422c-a06a-6fa00bad7b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:56.756158 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d389027-4de8-422c-a06a-6fa00bad7b59 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:56.756641 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d389027-4de8-422c-a06a-6fa00bad7b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:56.757110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d389027-4de8-422c-a06a-6fa00bad7b59 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:56.758396 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d389027-4de8-422c-a06a-6fa00bad7b59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:56.759421 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d389027-4de8-422c-a06a-6fa00bad7b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:56.762412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d389027-4de8-422c-a06a-6fa00bad7b59 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:56.781103 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 189/372] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:05:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:56.790781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d389027-4de8-422c-a06a-6fa00bad7b59 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:56.860151 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d145a4c-125d-4154-af66-b37a29e17404 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:56.946845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7242e-fa11-43ac-8137-22c0daa9663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:56.948483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7242e-fa11-43ac-8137-22c0daa9663c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:56.949286 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7242e-fa11-43ac-8137-22c0daa9663c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:56.950040 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7242e-fa11-43ac-8137-22c0daa9663c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:57.026985 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d389027-4de8-422c-a06a-6fa00bad7b59 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:57.090871 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbf800-a364-48f0-8b8f-43e45b630e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:57.098893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbf800-a364-48f0-8b8f-43e45b630e05 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:57.098893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbf800-a364-48f0-8b8f-43e45b630e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:57.098893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbf800-a364-48f0-8b8f-43e45b630e05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:57.146235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7242e-fa11-43ac-8137-22c0daa9663c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:57.146235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7242e-fa11-43ac-8137-22c0daa9663c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:57.203222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:57.213217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:57.233594 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbf800-a364-48f0-8b8f-43e45b630e05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:57.236334 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbf800-a364-48f0-8b8f-43e45b630e05 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:57.383012 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 184/373] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:05:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 771 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:05:57.399028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7242e-fa11-43ac-8137-22c0daa9663c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:57.446638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 190/374] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:05:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:05:57.455010 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbf800-a364-48f0-8b8f-43e45b630e05 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:57.631791 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7242e-fa11-43ac-8137-22c0daa9663c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:57.676016 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:57.689164 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbf800-a364-48f0-8b8f-43e45b630e05 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:57.701704 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:57.727613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f0381-a7fb-42d3-b686-6630b397b753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:57.728862 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f0381-a7fb-42d3-b686-6630b397b753 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:57.732567 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f0381-a7fb-42d3-b686-6630b397b753 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:57.732567 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f0381-a7fb-42d3-b686-6630b397b753 None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:57.732869 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f0381-a7fb-42d3-b686-6630b397b753 None admin] RBAC: Authorizing `identity:get_project(project_id=6d9e32fd96ae4748a30237bde6c1463f)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:57.737760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f0381-a7fb-42d3-b686-6630b397b753 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:57.745625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 185/375] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:57 2022] GET /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f => generated 302 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:57.756016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f0381-a7fb-42d3-b686-6630b397b753 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:57.762970 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60c967-3c6e-4e4e-93c3-cc93b8b392a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:57.764417 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60c967-3c6e-4e4e-93c3-cc93b8b392a6 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:57.765093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60c967-3c6e-4e4e-93c3-cc93b8b392a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:57.765746 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60c967-3c6e-4e4e-93c3-cc93b8b392a6 None admin] PATH_INFO: `/v3/projects/bb2e67cab7234c2983ce58824e8c7d2f` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:57.768162 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60c967-3c6e-4e4e-93c3-cc93b8b392a6 None admin] RBAC: Authorizing `identity:get_project(project_id=bb2e67cab7234c2983ce58824e8c7d2f)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:57.771736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60c967-3c6e-4e4e-93c3-cc93b8b392a6 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:57.775181 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 191/376] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:05:57 2022] GET /identity/v3/projects/bb2e67cab7234c2983ce58824e8c7d2f => generated 344 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:57.785443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60c967-3c6e-4e4e-93c3-cc93b8b392a6 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:57.988355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f0381-a7fb-42d3-b686-6630b397b753 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:58.086883 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60c967-3c6e-4e4e-93c3-cc93b8b392a6 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:58.092216 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02765d44-6398-4abe-8ad9-575c75d719d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:58.093309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02765d44-6398-4abe-8ad9-575c75d719d1 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:58.093792 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02765d44-6398-4abe-8ad9-575c75d719d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:58.097983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02765d44-6398-4abe-8ad9-575c75d719d1 None admin] PATH_INFO: `/v3/groups/73f02e5440a544418afcb8d84f2dfd1e` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:58.097983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02765d44-6398-4abe-8ad9-575c75d719d1 None admin] RBAC: Authorizing `identity:get_group(group_id=73f02e5440a544418afcb8d84f2dfd1e)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:58.100434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02765d44-6398-4abe-8ad9-575c75d719d1 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:58.104240 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 186/377] 10.222.0.83 () {56 vars in 1180 bytes} [Fri Sep 23 01:05:57 2022] GET /identity/v3/groups/73f02e5440a544418afcb8d84f2dfd1e => generated 226 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:58.116217 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02765d44-6398-4abe-8ad9-575c75d719d1 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:58.215150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff80c3-3891-491c-98e9-4a2de9675846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:58.216256 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff80c3-3891-491c-98e9-4a2de9675846 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:58.216736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff80c3-3891-491c-98e9-4a2de9675846 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:58.217205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff80c3-3891-491c-98e9-4a2de9675846 None admin] PATH_INFO: `/v3/groups/a41cffb3a2cb44078ecd6c00cccd2943` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:58.244409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:58.245148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff80c3-3891-491c-98e9-4a2de9675846 None admin] RBAC: Authorizing `identity:get_group(group_id=a41cffb3a2cb44078ecd6c00cccd2943)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:58.247862 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff80c3-3891-491c-98e9-4a2de9675846 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:58.251366 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 192/378] 10.222.0.83 () {56 vars in 1180 bytes} [Fri Sep 23 01:05:57 2022] GET /identity/v3/groups/a41cffb3a2cb44078ecd6c00cccd2943 => generated 229 bytes in 467 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:05:58.259832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff80c3-3891-491c-98e9-4a2de9675846 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:05:58.334486 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02765d44-6398-4abe-8ad9-575c75d719d1 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:58.351129 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:05:58.409442 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab12f2-af1b-4304-8b47-3e15cab0321b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:58.410613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab12f2-af1b-4304-8b47-3e15cab0321b None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:58.411714 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab12f2-af1b-4304-8b47-3e15cab0321b None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:58.412267 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab12f2-af1b-4304-8b47-3e15cab0321b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:58.413928 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab12f2-af1b-4304-8b47-3e15cab0321b None admin] RBAC: Adding query filter params (group.id=73f02e5440a544418afcb8d84f2dfd1e, role.id=a9e6249ed8cd44ce9fac74a4c8155978, scope.project.id=6d9e32fd96ae4748a30237bde6c1463f) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:58.414476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab12f2-af1b-4304-8b47-3e15cab0321b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:58.418763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab12f2-af1b-4304-8b47-3e15cab0321b None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:58.431558 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 187/379] 10.222.0.83 () {56 vars in 1376 bytes} [Fri Sep 23 01:05:58 2022] GET /identity/v3/role_assignments?group.id=73f02e5440a544418afcb8d84f2dfd1e&scope.project.id=6d9e32fd96ae4748a30237bde6c1463f&role.id=a9e6249ed8cd44ce9fac74a4c8155978 => generated 260 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:58.599551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff80c3-3891-491c-98e9-4a2de9675846 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:05:58.671781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04f1fb-7a65-4861-b1bb-1786a8921cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:05:58.672578 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04f1fb-7a65-4861-b1bb-1786a8921cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:58.672881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04f1fb-7a65-4861-b1bb-1786a8921cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:58.673152 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04f1fb-7a65-4861-b1bb-1786a8921cf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:58.674092 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04f1fb-7a65-4861-b1bb-1786a8921cf3 None admin] RBAC: Adding query filter params (group.id=a41cffb3a2cb44078ecd6c00cccd2943, role.id=d365054bc34046c5829cd1355f3a31ac, scope.project.id=bb2e67cab7234c2983ce58824e8c7d2f) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:05:58.674560 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04f1fb-7a65-4861-b1bb-1786a8921cf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:05:58.676259 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04f1fb-7a65-4861-b1bb-1786a8921cf3 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:05:58.685141 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 193/380] 10.222.0.83 () {56 vars in 1376 bytes} [Fri Sep 23 01:05:58 2022] GET /identity/v3/role_assignments?group.id=a41cffb3a2cb44078ecd6c00cccd2943&scope.project.id=bb2e67cab7234c2983ce58824e8c7d2f&role.id=d365054bc34046c5829cd1355f3a31ac => generated 260 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:05:59.732515 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf77ac8-3b8d-4a41-b1dd-aa27feca2eda None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:59.733244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf77ac8-3b8d-4a41-b1dd-aa27feca2eda None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:59.733355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf77ac8-3b8d-4a41-b1dd-aa27feca2eda None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:59.736423 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 188/381] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:05:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:05:59.744302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b91c08-2441-4ca1-8a0c-e5f6b35ed1a9 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:05:59.744915 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b91c08-2441-4ca1-8a0c-e5f6b35ed1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:05:59.745212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b91c08-2441-4ca1-8a0c-e5f6b35ed1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:05:59.787743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-98b91c08-2441-4ca1-8a0c-e5f6b35ed1a9 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:05:59.790351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-98b91c08-2441-4ca1-8a0c-e5f6b35ed1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:05:59.947477 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 194/382] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:00.682571 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf77ac8-3b8d-4a41-b1dd-aa27feca2eda None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:00.850822 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39e1e3-d0fe-4187-8e58-072cdbd243ba None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:00.852499 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39e1e3-d0fe-4187-8e58-072cdbd243ba None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:00.853382 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39e1e3-d0fe-4187-8e58-072cdbd243ba None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:00.861287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 195/383] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:00 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:00.869060 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7d9eb-0bd5-451c-88c1-99447125bb87 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:00.869970 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7d9eb-0bd5-451c-88c1-99447125bb87 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:00.874781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7d9eb-0bd5-451c-88c1-99447125bb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:00.916932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf77ac8-3b8d-4a41-b1dd-aa27feca2eda None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:00.940949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-88c7d9eb-0bd5-451c-88c1-99447125bb87 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:00.943051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-88c7d9eb-0bd5-451c-88c1-99447125bb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:00.987244 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:01.009055 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:01.044342 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e2c0c-0ad3-42fc-bb1e-4cf24ab47271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:01.047794 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e2c0c-0ad3-42fc-bb1e-4cf24ab47271 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:01.048827 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e2c0c-0ad3-42fc-bb1e-4cf24ab47271 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:01.051748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e2c0c-0ad3-42fc-bb1e-4cf24ab47271 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:01.102502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e2c0c-0ad3-42fc-bb1e-4cf24ab47271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:01.113844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-324e2c0c-0ad3-42fc-bb1e-4cf24ab47271 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:06:01.113844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:01.113844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:01.113844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:01.113844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:01.113844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:01.113844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:01.113844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:01.113844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:01.113844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:01.113844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:01.113844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:01.113844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:01.113844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:01.113844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:01.113844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:01.116573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:01.116573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:01.116573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:01.116573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:01.116573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:01.116573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:01.116573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:01.116573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:01.116573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:01.116573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:01.116573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:01.116573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:01.116573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:01.116573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:01.116573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:01.116573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:01.118292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:01.118292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:01.118292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:01.118292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:01.118292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:01.118292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:01.118292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:01.118292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:01.118292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:01.118292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:01.118292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:06:01.118292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:01.122712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 189/384] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:06:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:01.139807 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e2c0c-0ad3-42fc-bb1e-4cf24ab47271 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:01.168635 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 196/385] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:01.372726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e2c0c-0ad3-42fc-bb1e-4cf24ab47271 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:01.468608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a7307-3a12-45d4-bdec-37a5cefcba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:01.469978 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a7307-3a12-45d4-bdec-37a5cefcba27 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:01.470469 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a7307-3a12-45d4-bdec-37a5cefcba27 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:01.470993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a7307-3a12-45d4-bdec-37a5cefcba27 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:01.472367 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a7307-3a12-45d4-bdec-37a5cefcba27 None admin] RBAC: Adding query filter params (name=member) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:01.472899 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a7307-3a12-45d4-bdec-37a5cefcba27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:01.476337 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a7307-3a12-45d4-bdec-37a5cefcba27 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:01.501389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 190/386] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:06:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:01.511345 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7d9eb-0bd5-451c-88c1-99447125bb87 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:01.621087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a18654-901b-4576-9ecc-0d0e15b361f2 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:01.621520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a18654-901b-4576-9ecc-0d0e15b361f2 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:01.621808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a18654-901b-4576-9ecc-0d0e15b361f2 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:01.625151 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 191/387] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:06:01.631731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fdb3e-9398-4594-abdd-b1f1da3d40b8 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:01.631983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fdb3e-9398-4594-abdd-b1f1da3d40b8 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:01.632331 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fdb3e-9398-4594-abdd-b1f1da3d40b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:01.668364 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-e56fdb3e-9398-4594-abdd-b1f1da3d40b8 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:01.670298 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-e56fdb3e-9398-4594-abdd-b1f1da3d40b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:01.798716 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7d9eb-0bd5-451c-88c1-99447125bb87 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:01.799009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:01.846510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 192/388] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:01.849280 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fdb3e-9398-4594-abdd-b1f1da3d40b8 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:01.890734 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8249f-11b0-4586-acad-d128d8c14cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:01.890734 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8249f-11b0-4586-acad-d128d8c14cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:01.890734 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8249f-11b0-4586-acad-d128d8c14cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:01.890734 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8249f-11b0-4586-acad-d128d8c14cd9 None admin] PATH_INFO: `/v3/groups/73f02e5440a544418afcb8d84f2dfd1e` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:01.892645 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8249f-11b0-4586-acad-d128d8c14cd9 None admin] RBAC: Authorizing `identity:get_group(group_id=73f02e5440a544418afcb8d84f2dfd1e)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:01.895312 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8249f-11b0-4586-acad-d128d8c14cd9 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:01.906683 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 197/389] 10.222.0.83 () {56 vars in 1180 bytes} [Fri Sep 23 01:06:01 2022] GET /identity/v3/groups/73f02e5440a544418afcb8d84f2dfd1e => generated 226 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:01.907175 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8249f-11b0-4586-acad-d128d8c14cd9 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:01.962780 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:02.200729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8249f-11b0-4586-acad-d128d8c14cd9 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:02.230063 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fdb3e-9398-4594-abdd-b1f1da3d40b8 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:02.281543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1123396-1afd-4f8a-88c3-025ff0eaccd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:02.282875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1123396-1afd-4f8a-88c3-025ff0eaccd6 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:02.283950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1123396-1afd-4f8a-88c3-025ff0eaccd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:02.284578 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1123396-1afd-4f8a-88c3-025ff0eaccd6 None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:02.288241 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1123396-1afd-4f8a-88c3-025ff0eaccd6 None admin] RBAC: Authorizing `identity:get_project(project_id=612f86bc1b6c4d8ab8393c2393a01341)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:02.291890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1123396-1afd-4f8a-88c3-025ff0eaccd6 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:02.293049 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111154d3-1ce4-499e-92f8-5d0850b9901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:02.294410 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111154d3-1ce4-499e-92f8-5d0850b9901a None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:02.295140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111154d3-1ce4-499e-92f8-5d0850b9901a None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:02.295805 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111154d3-1ce4-499e-92f8-5d0850b9901a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:02.296459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 198/390] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:06:01 2022] GET /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341 => generated 298 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:02.298403 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1123396-1afd-4f8a-88c3-025ff0eaccd6 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:02.319918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111154d3-1ce4-499e-92f8-5d0850b9901a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:02.332860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-111154d3-1ce4-499e-92f8-5d0850b9901a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:06:02.332860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:02.332860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:02.332860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:02.332860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:02.332860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:02.332860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:02.332860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:02.332860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:02.332860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:02.332860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:02.332860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:02.332860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:02.332860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:02.332860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:02.332860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:02.334155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:02.334155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:02.334155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:02.334155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:02.334155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:02.334155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:02.334155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:02.334155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:02.334155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:02.334155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:02.334155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:02.334155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:02.334155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:02.334155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:02.334155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:02.334155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:02.335474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:02.335474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:02.335474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:02.335474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:02.335474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:02.335474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:02.335474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:02.335474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:02.335474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:02.335474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:02.335474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:06:02.335474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:02.337127 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 193/391] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:06:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 489 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:02.338911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111154d3-1ce4-499e-92f8-5d0850b9901a None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:02.413105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:02.475251 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:02.515962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1123396-1afd-4f8a-88c3-025ff0eaccd6 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:02.547012 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111154d3-1ce4-499e-92f8-5d0850b9901a None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:02.596352 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecfd6a-edf6-4e09-8d8d-ca68137e597c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:02.597934 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecfd6a-edf6-4e09-8d8d-ca68137e597c None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:02.599505 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecfd6a-edf6-4e09-8d8d-ca68137e597c None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:02.600302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecfd6a-edf6-4e09-8d8d-ca68137e597c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:02.622645 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecfd6a-edf6-4e09-8d8d-ca68137e597c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:02.627534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c5b25-35ec-4eb9-84f9-ec1a78c3c048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:02.628457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c5b25-35ec-4eb9-84f9-ec1a78c3c048 None admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:02.628878 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c5b25-35ec-4eb9-84f9-ec1a78c3c048 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:02.629363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c5b25-35ec-4eb9-84f9-ec1a78c3c048 None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341/groups/73f02e5440a544418afcb8d84f2dfd1e/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:02.633168 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c5b25-35ec-4eb9-84f9-ec1a78c3c048 None admin] RBAC: Authorizing `identity:create_grant(project_id=612f86bc1b6c4d8ab8393c2393a01341, group_id=73f02e5440a544418afcb8d84f2dfd1e, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:02.634368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-0fecfd6a-edf6-4e09-8d8d-ca68137e597c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:06:02.634368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:02.634368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:02.634368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:02.634368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:02.634368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:02.634368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:02.634368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:02.634368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:02.634368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:02.634368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:02.634368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:02.634368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:02.634368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:02.634368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:02.634368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:02.635881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:02.635881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:02.635881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:02.635881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:02.635881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:02.635881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:02.635881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:02.635881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:02.635881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:02.635881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:02.635881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:02.635881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:02.635881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:02.635881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:02.635881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:02.635881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:02.637398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:02.637398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:02.637398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:02.637398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:02.637398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:02.637398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:02.637398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:02.637398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:02.637398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:02.637398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:02.637398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:06:02.637398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:02.638296 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c5b25-35ec-4eb9-84f9-ec1a78c3c048 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:02.646803 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 199/392] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:06:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:02.648905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecfd6a-edf6-4e09-8d8d-ca68137e597c None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:02.722555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 194/393] 10.222.0.83 () {58 vars in 1442 bytes} [Fri Sep 23 01:06:02 2022] PUT /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341/groups/73f02e5440a544418afcb8d84f2dfd1e/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:06:02.724548 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c5b25-35ec-4eb9-84f9-ec1a78c3c048 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:02.921956 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecfd6a-edf6-4e09-8d8d-ca68137e597c None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:03.002430 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b64161-cca8-4cfd-8c34-25107d968b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:03.003993 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b64161-cca8-4cfd-8c34-25107d968b10 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:03.004784 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b64161-cca8-4cfd-8c34-25107d968b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:03.005508 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b64161-cca8-4cfd-8c34-25107d968b10 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:03.007052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b64161-cca8-4cfd-8c34-25107d968b10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:03.007861 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b64161-cca8-4cfd-8c34-25107d968b10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:03.010378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b64161-cca8-4cfd-8c34-25107d968b10 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:03.028561 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 200/394] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:03.029175 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:03.031378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993289c-1514-4299-b49d-f390575af94d None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:03.032126 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993289c-1514-4299-b49d-f390575af94d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:03.032780 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993289c-1514-4299-b49d-f390575af94d None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:03.036538 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 201/395] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:03.044960 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993289c-1514-4299-b49d-f390575af94d None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:03.052675 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:03.053624 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c5b25-35ec-4eb9-84f9-ec1a78c3c048 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:03.135006 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3585a-f0a4-40b1-ba18-b3b0a76d3876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:03.136086 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3585a-f0a4-40b1-ba18-b3b0a76d3876 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:03.136585 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3585a-f0a4-40b1-ba18-b3b0a76d3876 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:03.137083 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3585a-f0a4-40b1-ba18-b3b0a76d3876 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:03.138424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3585a-f0a4-40b1-ba18-b3b0a76d3876 None admin] RBAC: Adding query filter params (name=member) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:03.138934 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3585a-f0a4-40b1-ba18-b3b0a76d3876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:03.141766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3585a-f0a4-40b1-ba18-b3b0a76d3876 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:03.158189 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 195/396] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:06:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:03.160608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edea31-69a2-413b-8753-4d2244440b7a None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:03.161658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edea31-69a2-413b-8753-4d2244440b7a None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:03.162120 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edea31-69a2-413b-8753-4d2244440b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:03.196530 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-b9edea31-69a2-413b-8753-4d2244440b7a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:03.198775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b9edea31-69a2-413b-8753-4d2244440b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:03.257526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993289c-1514-4299-b49d-f390575af94d None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:03.329442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755229d-94fb-4972-93ad-098215e72652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:03.329720 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 196/397] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:03.330375 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755229d-94fb-4972-93ad-098215e72652 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:03.330499 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755229d-94fb-4972-93ad-098215e72652 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:03.331252 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755229d-94fb-4972-93ad-098215e72652 None admin] PATH_INFO: `/v3/groups/73f02e5440a544418afcb8d84f2dfd1e` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:03.332097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef6bf2-7c8b-4b94-8c95-8c9cd17b0b3e None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:03.332549 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755229d-94fb-4972-93ad-098215e72652 None admin] RBAC: Authorizing `identity:get_group(group_id=73f02e5440a544418afcb8d84f2dfd1e)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:03.332747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef6bf2-7c8b-4b94-8c95-8c9cd17b0b3e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:03.333679 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef6bf2-7c8b-4b94-8c95-8c9cd17b0b3e None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:03.342676 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755229d-94fb-4972-93ad-098215e72652 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:03.346795 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 197/399] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:03 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:03.347051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 202/399] 10.222.0.83 () {56 vars in 1180 bytes} [Fri Sep 23 01:06:03 2022] GET /identity/v3/groups/73f02e5440a544418afcb8d84f2dfd1e => generated 226 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:03.347213 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef6bf2-7c8b-4b94-8c95-8c9cd17b0b3e None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:03.347343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb114af-b59e-476b-a5aa-ee02f3ba4b68 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:03.347343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb114af-b59e-476b-a5aa-ee02f3ba4b68 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:03.347592 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb114af-b59e-476b-a5aa-ee02f3ba4b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:03.397715 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-4fb114af-b59e-476b-a5aa-ee02f3ba4b68 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:03.399712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4fb114af-b59e-476b-a5aa-ee02f3ba4b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:03.548102 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 203/400] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:03.554056 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:03.557511 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb114af-b59e-476b-a5aa-ee02f3ba4b68 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:03.566885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:03.593486 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef6bf2-7c8b-4b94-8c95-8c9cd17b0b3e None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:03.678068 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17773589-57f7-41cc-a356-b2aec78b0053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:03.679203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17773589-57f7-41cc-a356-b2aec78b0053 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:03.680665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17773589-57f7-41cc-a356-b2aec78b0053 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:03.681202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17773589-57f7-41cc-a356-b2aec78b0053 None admin] PATH_INFO: `/v3/groups/73f02e5440a544418afcb8d84f2dfd1e` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:03.683608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17773589-57f7-41cc-a356-b2aec78b0053 None admin] RBAC: Authorizing `identity:get_group(group_id=73f02e5440a544418afcb8d84f2dfd1e)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:03.687498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17773589-57f7-41cc-a356-b2aec78b0053 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:03.691583 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 198/401] 10.222.0.83 () {56 vars in 1180 bytes} [Fri Sep 23 01:06:03 2022] GET /identity/v3/groups/73f02e5440a544418afcb8d84f2dfd1e => generated 226 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:03.708909 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17773589-57f7-41cc-a356-b2aec78b0053 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:03.809460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb114af-b59e-476b-a5aa-ee02f3ba4b68 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:03.861309 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ce8cc-e7aa-4727-975b-d3322a9f5c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:03.861979 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ce8cc-e7aa-4727-975b-d3322a9f5c1e None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:03.862259 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ce8cc-e7aa-4727-975b-d3322a9f5c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:03.862569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ce8cc-e7aa-4727-975b-d3322a9f5c1e None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:03.864467 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ce8cc-e7aa-4727-975b-d3322a9f5c1e None admin] RBAC: Authorizing `identity:get_project(project_id=612f86bc1b6c4d8ab8393c2393a01341)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:03.867130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ce8cc-e7aa-4727-975b-d3322a9f5c1e None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:03.871116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 204/402] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:06:03 2022] GET /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341 => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:03.872650 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ce8cc-e7aa-4727-975b-d3322a9f5c1e None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:03.884325 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17773589-57f7-41cc-a356-b2aec78b0053 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:03.938551 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e1fe5-4545-4101-81be-5140d8e7deb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:03.939719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e1fe5-4545-4101-81be-5140d8e7deb2 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:03.940205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e1fe5-4545-4101-81be-5140d8e7deb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:03.940775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e1fe5-4545-4101-81be-5140d8e7deb2 None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:03.942799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e1fe5-4545-4101-81be-5140d8e7deb2 None admin] RBAC: Authorizing `identity:get_project(project_id=6d9e32fd96ae4748a30237bde6c1463f)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:03.946267 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e1fe5-4545-4101-81be-5140d8e7deb2 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:03.954529 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 199/403] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:06:03 2022] GET /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:03.955964 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e1fe5-4545-4101-81be-5140d8e7deb2 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:03.989299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:03.991881 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:04.049572 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ce8cc-e7aa-4727-975b-d3322a9f5c1e None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:04.118177 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3025c-dc6d-453c-bf31-a23c13a761d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:04.119289 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3025c-dc6d-453c-bf31-a23c13a761d5 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:04.119767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3025c-dc6d-453c-bf31-a23c13a761d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:04.120240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3025c-dc6d-453c-bf31-a23c13a761d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:04.140812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e1fe5-4545-4101-81be-5140d8e7deb2 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:04.141067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3025c-dc6d-453c-bf31-a23c13a761d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:04.152976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-fbf3025c-dc6d-453c-bf31-a23c13a761d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:06:04.152976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:04.152976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:04.152976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:04.152976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:04.152976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:04.152976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:04.152976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:04.152976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:04.152976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:04.152976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:04.152976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:04.152976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:04.152976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:04.152976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:04.152976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:04.155313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:04.155313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:04.155313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:04.155313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:04.155313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:04.155313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:04.155313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:04.155313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:04.155313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:04.155313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:04.155313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:04.155313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:04.155313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:04.155313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:04.155313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:04.155313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:04.157277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:04.157277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:04.157277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:04.157277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:04.157277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:04.157277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:04.157277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:04.157277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:04.157277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:04.157277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:04.157277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:06:04.157277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:04.157277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 205/404] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:06:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:04.157277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3025c-dc6d-453c-bf31-a23c13a761d5 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:04.213662 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da442d0-8b49-4075-9602-73bd050332e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:04.214731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da442d0-8b49-4075-9602-73bd050332e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:04.215142 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da442d0-8b49-4075-9602-73bd050332e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:04.215563 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da442d0-8b49-4075-9602-73bd050332e1 None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341/groups/73f02e5440a544418afcb8d84f2dfd1e/roles/a9e6249ed8cd44ce9fac74a4c8155978` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:04.219242 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da442d0-8b49-4075-9602-73bd050332e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=612f86bc1b6c4d8ab8393c2393a01341, group_id=73f02e5440a544418afcb8d84f2dfd1e, role_id=a9e6249ed8cd44ce9fac74a4c8155978)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:04.221789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da442d0-8b49-4075-9602-73bd050332e1 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:04.312577 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 200/405] 10.222.0.83 () {58 vars in 1442 bytes} [Fri Sep 23 01:06:03 2022] PUT /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341/groups/73f02e5440a544418afcb8d84f2dfd1e/roles/a9e6249ed8cd44ce9fac74a4c8155978 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:06:04.314046 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da442d0-8b49-4075-9602-73bd050332e1 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:04.359342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3025c-dc6d-453c-bf31-a23c13a761d5 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:04.426926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:04.440793 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbf991-946b-40a2-99af-7b7608e6e014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:04.442908 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbf991-946b-40a2-99af-7b7608e6e014 None admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:04.443613 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbf991-946b-40a2-99af-7b7608e6e014 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:04.445479 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbf991-946b-40a2-99af-7b7608e6e014 None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f/groups/73f02e5440a544418afcb8d84f2dfd1e/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:04.450425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbf991-946b-40a2-99af-7b7608e6e014 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d9e32fd96ae4748a30237bde6c1463f, group_id=73f02e5440a544418afcb8d84f2dfd1e, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:04.454353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbf991-946b-40a2-99af-7b7608e6e014 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:04.517095 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:04.548097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da442d0-8b49-4075-9602-73bd050332e1 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:04.572985 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 206/406] 10.222.0.83 () {58 vars in 1442 bytes} [Fri Sep 23 01:06:04 2022] PUT /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f/groups/73f02e5440a544418afcb8d84f2dfd1e/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:06:04.574444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbf991-946b-40a2-99af-7b7608e6e014 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:04.639787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63516a-0a4e-47b6-a16e-06a7b45ae816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:04.640882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63516a-0a4e-47b6-a16e-06a7b45ae816 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:04.641368 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63516a-0a4e-47b6-a16e-06a7b45ae816 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:04.641995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63516a-0a4e-47b6-a16e-06a7b45ae816 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:04.669383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63516a-0a4e-47b6-a16e-06a7b45ae816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:04.680847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-0f63516a-0a4e-47b6-a16e-06a7b45ae816 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:06:04.680847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:04.680847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:04.680847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:04.680847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:04.680847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:04.680847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:04.680847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:04.680847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:04.680847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:04.680847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:04.680847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:04.680847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:04.680847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:04.680847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:04.680847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:04.682103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:04.682103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:04.682103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:04.682103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:04.682103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:04.682103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:04.682103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:04.682103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:04.682103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:04.682103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:04.682103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:04.682103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:04.682103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:04.682103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:04.682103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:04.682103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:04.682959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:04.682959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:04.682959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:04.682959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:04.682959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:04.682959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:04.682959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:04.682959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:04.682959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:04.682959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:04.682959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:06:04.682959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:04.690186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 201/407] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:06:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:04.693841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63516a-0a4e-47b6-a16e-06a7b45ae816 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:04.912624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbf991-946b-40a2-99af-7b7608e6e014 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:04.963791 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63516a-0a4e-47b6-a16e-06a7b45ae816 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:05.035944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492ad64-3ca5-4aed-b717-755c0aa3fc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:05.037036 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492ad64-3ca5-4aed-b717-755c0aa3fc0e None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:05.037485 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492ad64-3ca5-4aed-b717-755c0aa3fc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:05.037979 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492ad64-3ca5-4aed-b717-755c0aa3fc0e None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:05.039289 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492ad64-3ca5-4aed-b717-755c0aa3fc0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:05.039791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492ad64-3ca5-4aed-b717-755c0aa3fc0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:05.042570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492ad64-3ca5-4aed-b717-755c0aa3fc0e None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:05.059461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 207/408] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:05.068475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492ad64-3ca5-4aed-b717-755c0aa3fc0e None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:05.085760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84ec2e-9176-4efc-8289-9483947ba3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:05.086518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84ec2e-9176-4efc-8289-9483947ba3ed None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:05.086872 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84ec2e-9176-4efc-8289-9483947ba3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:05.087150 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84ec2e-9176-4efc-8289-9483947ba3ed None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:05.088127 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84ec2e-9176-4efc-8289-9483947ba3ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:05.088713 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84ec2e-9176-4efc-8289-9483947ba3ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:05.090614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84ec2e-9176-4efc-8289-9483947ba3ed None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:05.120700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 202/409] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:06:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:05.129322 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84ec2e-9176-4efc-8289-9483947ba3ed None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:05.149134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:05.235177 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:05.427184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492ad64-3ca5-4aed-b717-755c0aa3fc0e None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:05.456122 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84ec2e-9176-4efc-8289-9483947ba3ed None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:05.553340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b814a6d-35b6-4b06-a40e-13faf344f3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:05.554524 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b814a6d-35b6-4b06-a40e-13faf344f3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:05.555049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b814a6d-35b6-4b06-a40e-13faf344f3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:05.555536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b814a6d-35b6-4b06-a40e-13faf344f3e4 None admin] PATH_INFO: `/v3/groups/73f02e5440a544418afcb8d84f2dfd1e` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:05.559792 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b814a6d-35b6-4b06-a40e-13faf344f3e4 None admin] RBAC: Authorizing `identity:get_group(group_id=73f02e5440a544418afcb8d84f2dfd1e)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:05.562706 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b814a6d-35b6-4b06-a40e-13faf344f3e4 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:05.569014 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 208/410] 10.222.0.83 () {56 vars in 1180 bytes} [Fri Sep 23 01:06:05 2022] GET /identity/v3/groups/73f02e5440a544418afcb8d84f2dfd1e => generated 226 bytes in 500 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:05.576321 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b814a6d-35b6-4b06-a40e-13faf344f3e4 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:05.596692 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b303d6-fc78-48f7-b47d-19877988f2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:05.597829 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b303d6-fc78-48f7-b47d-19877988f2fa None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:05.602365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b303d6-fc78-48f7-b47d-19877988f2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:05.603055 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b303d6-fc78-48f7-b47d-19877988f2fa None admin] PATH_INFO: `/v3/groups/a41cffb3a2cb44078ecd6c00cccd2943` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:05.608172 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b303d6-fc78-48f7-b47d-19877988f2fa None admin] RBAC: Authorizing `identity:get_group(group_id=a41cffb3a2cb44078ecd6c00cccd2943)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:05.612928 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b303d6-fc78-48f7-b47d-19877988f2fa None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:05.624452 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 203/411] 10.222.0.83 () {56 vars in 1180 bytes} [Fri Sep 23 01:06:05 2022] GET /identity/v3/groups/a41cffb3a2cb44078ecd6c00cccd2943 => generated 229 bytes in 496 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:05.631012 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b303d6-fc78-48f7-b47d-19877988f2fa None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:05.927206 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:05.982631 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b814a6d-35b6-4b06-a40e-13faf344f3e4 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:06.024018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:06.044941 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b303d6-fc78-48f7-b47d-19877988f2fa None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:06.068563 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daae791-f51d-4f89-a860-f27a5d45aaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:06.069706 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daae791-f51d-4f89-a860-f27a5d45aaa7 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:06.070136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daae791-f51d-4f89-a860-f27a5d45aaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:06.070472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daae791-f51d-4f89-a860-f27a5d45aaa7 None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:06.077127 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daae791-f51d-4f89-a860-f27a5d45aaa7 None admin] RBAC: Authorizing `identity:get_project(project_id=6d9e32fd96ae4748a30237bde6c1463f)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:06.079138 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daae791-f51d-4f89-a860-f27a5d45aaa7 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:06.082266 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 209/412] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:06:05 2022] GET /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f => generated 302 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:06.098993 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daae791-f51d-4f89-a860-f27a5d45aaa7 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:06.185003 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014bbf1-5a55-44bc-8022-4e94a721e90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:06.186211 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014bbf1-5a55-44bc-8022-4e94a721e90c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:06.186734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014bbf1-5a55-44bc-8022-4e94a721e90c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:06.187453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014bbf1-5a55-44bc-8022-4e94a721e90c None admin] PATH_INFO: `/v3/projects/bb2e67cab7234c2983ce58824e8c7d2f` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:06.189892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014bbf1-5a55-44bc-8022-4e94a721e90c None admin] RBAC: Authorizing `identity:get_project(project_id=bb2e67cab7234c2983ce58824e8c7d2f)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:06.193541 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014bbf1-5a55-44bc-8022-4e94a721e90c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:06.208250 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 204/413] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:06:05 2022] GET /identity/v3/projects/bb2e67cab7234c2983ce58824e8c7d2f => generated 344 bytes in 579 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:06:06.220411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014bbf1-5a55-44bc-8022-4e94a721e90c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:06.436098 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daae791-f51d-4f89-a860-f27a5d45aaa7 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:06.494174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b632c15-d7dc-403a-9fe9-f16ccd42e065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:06.496834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b632c15-d7dc-403a-9fe9-f16ccd42e065 None admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:06.497306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b632c15-d7dc-403a-9fe9-f16ccd42e065 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:06.497792 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b632c15-d7dc-403a-9fe9-f16ccd42e065 None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f/groups/73f02e5440a544418afcb8d84f2dfd1e/roles/a9e6249ed8cd44ce9fac74a4c8155978` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:06.507573 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b632c15-d7dc-403a-9fe9-f16ccd42e065 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d9e32fd96ae4748a30237bde6c1463f, group_id=73f02e5440a544418afcb8d84f2dfd1e, role_id=a9e6249ed8cd44ce9fac74a4c8155978)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:06.510009 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b632c15-d7dc-403a-9fe9-f16ccd42e065 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:06.576854 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014bbf1-5a55-44bc-8022-4e94a721e90c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:06.620478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 210/414] 10.222.0.83 () {58 vars in 1442 bytes} [Fri Sep 23 01:06:06 2022] PUT /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f/groups/73f02e5440a544418afcb8d84f2dfd1e/roles/a9e6249ed8cd44ce9fac74a4c8155978 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:06:06.650251 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6b5f0-e42e-4cec-986c-34ebfde3b4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:06.651313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6b5f0-e42e-4cec-986c-34ebfde3b4ed None admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:06.651658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6b5f0-e42e-4cec-986c-34ebfde3b4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:06.651993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6b5f0-e42e-4cec-986c-34ebfde3b4ed None admin] PATH_INFO: `/v3/projects/bb2e67cab7234c2983ce58824e8c7d2f/groups/a41cffb3a2cb44078ecd6c00cccd2943/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:06.655838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6b5f0-e42e-4cec-986c-34ebfde3b4ed None admin] RBAC: Authorizing `identity:create_grant(project_id=bb2e67cab7234c2983ce58824e8c7d2f, group_id=a41cffb3a2cb44078ecd6c00cccd2943, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:06.659020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6b5f0-e42e-4cec-986c-34ebfde3b4ed None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:06.719674 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3a203-569d-4aa7-8e24-7e334e80c7d2 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:06.720339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3a203-569d-4aa7-8e24-7e334e80c7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:06.720957 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3a203-569d-4aa7-8e24-7e334e80c7d2 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:06.723036 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 211/415] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:06.729934 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ea8a8-374e-4dd1-8943-82c5d7d6456a None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:06.730700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ea8a8-374e-4dd1-8943-82c5d7d6456a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:06.731288 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ea8a8-374e-4dd1-8943-82c5d7d6456a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:06.755918 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-0b0ea8a8-374e-4dd1-8943-82c5d7d6456a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:06.757761 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-0b0ea8a8-374e-4dd1-8943-82c5d7d6456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:06.775021 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 205/416] 10.222.0.83 () {58 vars in 1442 bytes} [Fri Sep 23 01:06:06 2022] PUT /identity/v3/projects/bb2e67cab7234c2983ce58824e8c7d2f/groups/a41cffb3a2cb44078ecd6c00cccd2943/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:06:06.839468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:06.871697 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 212/417] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:06:07.437149 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6b5f0-e42e-4cec-986c-34ebfde3b4ed None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:07.442728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:07.677299 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6b5f0-e42e-4cec-986c-34ebfde3b4ed None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:07.764835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e79531-8178-4a63-832e-6ecec3bb8b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:07.766019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e79531-8178-4a63-832e-6ecec3bb8b91 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:07.766512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e79531-8178-4a63-832e-6ecec3bb8b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:07.766993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e79531-8178-4a63-832e-6ecec3bb8b91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:07.794257 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e79531-8178-4a63-832e-6ecec3bb8b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:07.805476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-20e79531-8178-4a63-832e-6ecec3bb8b91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:06:07.805476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:07.805476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:07.805476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:07.805476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:07.805476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:07.805476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:07.805476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:07.805476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:07.805476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:07.805476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:07.805476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:07.805476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:07.805476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:07.805476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:07.805476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:07.807233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:07.807233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:07.807233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:07.807233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:07.807233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:07.807233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:07.807233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:07.807233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:07.807233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:07.807233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:07.807233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:07.807233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:07.807233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:07.807233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:07.807233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:07.807233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:07.809432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:07.809432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:07.809432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:07.809432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:07.809432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:07.809432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:07.809432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:07.809432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:07.809432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:07.809432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:07.809432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:06:07.809432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:07.809432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 206/418] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:06:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:07.820161 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ea8a8-374e-4dd1-8943-82c5d7d6456a None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:08.048350 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ea8a8-374e-4dd1-8943-82c5d7d6456a None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:08.110468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b061d-cd28-49da-bccb-58ac6e6f7604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:08.111996 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b061d-cd28-49da-bccb-58ac6e6f7604 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:08.112524 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b061d-cd28-49da-bccb-58ac6e6f7604 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:08.112997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b061d-cd28-49da-bccb-58ac6e6f7604 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:08.114531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b061d-cd28-49da-bccb-58ac6e6f7604 None admin] RBAC: Adding query filter params (name=member) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:08.115225 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b061d-cd28-49da-bccb-58ac6e6f7604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:08.116917 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b061d-cd28-49da-bccb-58ac6e6f7604 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:08.135903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 213/419] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:06:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:06:08.145679 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e79531-8178-4a63-832e-6ecec3bb8b91 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:08.191413 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d21b16-3911-4a80-8af7-7516f786c757 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:08.192949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d21b16-3911-4a80-8af7-7516f786c757 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:08.193727 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d21b16-3911-4a80-8af7-7516f786c757 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:08.198081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 214/420] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:08.205608 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75fc7-7b02-4131-86d1-43de338a40d9 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:08.206556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75fc7-7b02-4131-86d1-43de338a40d9 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:08.207348 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75fc7-7b02-4131-86d1-43de338a40d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:08.253398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-00a75fc7-7b02-4131-86d1-43de338a40d9 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:08.257199 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-00a75fc7-7b02-4131-86d1-43de338a40d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:08.325057 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:08.387152 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:08.424026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e79531-8178-4a63-832e-6ecec3bb8b91 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:08.449525 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 215/421] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:06:08.452833 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49df94-939a-4fcf-b991-21b4eb90f6fd None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:08.453525 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49df94-939a-4fcf-b991-21b4eb90f6fd None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:08.454118 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49df94-939a-4fcf-b991-21b4eb90f6fd None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:08.462721 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 216/422] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:08.468302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1434b2-8ce0-4744-aa63-acd1f8a4e300 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:08.469221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1434b2-8ce0-4744-aa63-acd1f8a4e300 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:08.469774 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1434b2-8ce0-4744-aa63-acd1f8a4e300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:08.489521 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be7ce7-cfca-4467-b1a1-46f7319a5a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:08.490449 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be7ce7-cfca-4467-b1a1-46f7319a5a84 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:08.490897 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be7ce7-cfca-4467-b1a1-46f7319a5a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:08.491435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be7ce7-cfca-4467-b1a1-46f7319a5a84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:08.508224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-ca1434b2-8ce0-4744-aa63-acd1f8a4e300 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:08.510568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ca1434b2-8ce0-4744-aa63-acd1f8a4e300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:08.623612 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be7ce7-cfca-4467-b1a1-46f7319a5a84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:08.628273 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be7ce7-cfca-4467-b1a1-46f7319a5a84 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:08.704645 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 217/423] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:06:08.774126 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:08.850139 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 207/424] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:06:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:06:08.859298 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1434b2-8ce0-4744-aa63-acd1f8a4e300 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:09.115746 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:09.119067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1434b2-8ce0-4744-aa63-acd1f8a4e300 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:09.127253 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be7ce7-cfca-4467-b1a1-46f7319a5a84 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:09.168004 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82191236-07f7-4d85-8dae-09688baa7436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:09.168693 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82191236-07f7-4d85-8dae-09688baa7436 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:09.169149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82191236-07f7-4d85-8dae-09688baa7436 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:09.169436 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82191236-07f7-4d85-8dae-09688baa7436 None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:09.171642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82191236-07f7-4d85-8dae-09688baa7436 None admin] RBAC: Authorizing `identity:get_project(project_id=612f86bc1b6c4d8ab8393c2393a01341)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:09.173220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82191236-07f7-4d85-8dae-09688baa7436 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:09.175470 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 218/425] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:06:08 2022] GET /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341 => generated 298 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:09.184038 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82191236-07f7-4d85-8dae-09688baa7436 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:09.379989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be7ce7-cfca-4467-b1a1-46f7319a5a84 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:09.421454 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82191236-07f7-4d85-8dae-09688baa7436 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:09.443994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76977b1c-3ced-40c8-a6e1-817c5a806d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:09.444646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76977b1c-3ced-40c8-a6e1-817c5a806d67 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:09.444933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76977b1c-3ced-40c8-a6e1-817c5a806d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:09.445201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76977b1c-3ced-40c8-a6e1-817c5a806d67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:09.461412 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76977b1c-3ced-40c8-a6e1-817c5a806d67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:09.470375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-76977b1c-3ced-40c8-a6e1-817c5a806d67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:06:09.470375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:09.470375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:09.470375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:09.470375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:09.470375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:09.470375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:09.470375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:09.470375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:09.470375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:09.470375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:09.470375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:09.470375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:09.470375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:09.470375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:09.470375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:09.471414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:09.471414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:09.471414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:09.471414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:09.471414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:09.471414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:09.471414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:09.471414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:09.471414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:09.471414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:09.471414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:09.471414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:09.471414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:09.471414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:09.471414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:09.471414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:09.472232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:09.472232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:09.472232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:09.472232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:09.472232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:09.472232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:09.472232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:09.472232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:09.472232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:09.472232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:09.472232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 01:06:09.472232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:09.475325 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 208/426] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:06:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:06:09.476490 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76977b1c-3ced-40c8-a6e1-817c5a806d67 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:09.495926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7f9e3-a86e-41bd-98ca-e38aebfcc2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:09.497982 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7f9e3-a86e-41bd-98ca-e38aebfcc2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:09.498486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7f9e3-a86e-41bd-98ca-e38aebfcc2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:09.499038 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7f9e3-a86e-41bd-98ca-e38aebfcc2e6 None admin] PATH_INFO: `/v3/groups/73f02e5440a544418afcb8d84f2dfd1e` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:09.502418 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7f9e3-a86e-41bd-98ca-e38aebfcc2e6 None admin] RBAC: Authorizing `identity:get_group(group_id=73f02e5440a544418afcb8d84f2dfd1e)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:09.505385 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7f9e3-a86e-41bd-98ca-e38aebfcc2e6 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:09.514044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 219/427] 10.222.0.83 () {56 vars in 1180 bytes} [Fri Sep 23 01:06:09 2022] GET /identity/v3/groups/73f02e5440a544418afcb8d84f2dfd1e => generated 226 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:06:09.515575 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7f9e3-a86e-41bd-98ca-e38aebfcc2e6 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:09.525231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:09.615293 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:09.702753 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76977b1c-3ced-40c8-a6e1-817c5a806d67 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:09.765136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7f9e3-a86e-41bd-98ca-e38aebfcc2e6 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:09.776365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46cc59-f4ff-4161-b495-25edc5afd595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:09.779353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46cc59-f4ff-4161-b495-25edc5afd595 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:09.779816 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46cc59-f4ff-4161-b495-25edc5afd595 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:09.780289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46cc59-f4ff-4161-b495-25edc5afd595 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:09.807360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46cc59-f4ff-4161-b495-25edc5afd595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:09.822078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-cf46cc59-f4ff-4161-b495-25edc5afd595 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:06:09.822078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:09.822078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:09.822078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:09.822078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:09.822078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:09.822078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:09.822078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:09.822078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:09.822078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:09.822078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:09.822078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:09.822078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:09.822078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:09.822078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:09.822078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:09.823933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:09.823933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:09.823933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:09.823933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:09.823933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:09.823933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:09.823933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:09.823933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:09.823933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:09.823933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:09.823933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:09.823933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:09.823933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:09.823933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:09.823933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:09.823933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:09.825424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:09.825424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:09.825424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:09.825424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:09.825424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:09.825424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:09.825424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:09.825424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:09.825424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:09.825424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:09.825424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:06:09.825424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:09.829191 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 209/428] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:06:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:09.830527 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46cc59-f4ff-4161-b495-25edc5afd595 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:09.847938 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f7c3d-60d5-4c80-8628-fee034b46aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:09.849347 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f7c3d-60d5-4c80-8628-fee034b46aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:09.850092 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f7c3d-60d5-4c80-8628-fee034b46aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:09.851709 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f7c3d-60d5-4c80-8628-fee034b46aa2 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:09.853269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f7c3d-60d5-4c80-8628-fee034b46aa2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:09.854136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f7c3d-60d5-4c80-8628-fee034b46aa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:09.858743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f7c3d-60d5-4c80-8628-fee034b46aa2 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:09.891084 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 220/429] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:06:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:09.892281 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f7c3d-60d5-4c80-8628-fee034b46aa2 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:10.034349 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:10.072743 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46cc59-f4ff-4161-b495-25edc5afd595 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:10.141166 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:10.149112 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f7c3d-60d5-4c80-8628-fee034b46aa2 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:10.159270 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a791dda-08f3-4f95-982f-d6bb8e072985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:10.161462 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a791dda-08f3-4f95-982f-d6bb8e072985 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:10.162329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a791dda-08f3-4f95-982f-d6bb8e072985 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:10.163191 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a791dda-08f3-4f95-982f-d6bb8e072985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:10.166021 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a791dda-08f3-4f95-982f-d6bb8e072985 None admin] RBAC: Adding query filter params (group.id=73f02e5440a544418afcb8d84f2dfd1e, role.id=986891361f4f4893a1cb2d0e0b523bff, scope.project.id=612f86bc1b6c4d8ab8393c2393a01341) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:10.167011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a791dda-08f3-4f95-982f-d6bb8e072985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:10.171359 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a791dda-08f3-4f95-982f-d6bb8e072985 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:10.190208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 210/430] 10.222.0.83 () {56 vars in 1376 bytes} [Fri Sep 23 01:06:09 2022] GET /identity/v3/role_assignments?group.id=73f02e5440a544418afcb8d84f2dfd1e&scope.project.id=612f86bc1b6c4d8ab8393c2393a01341&role.id=986891361f4f4893a1cb2d0e0b523bff => generated 611 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:10.192478 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a791dda-08f3-4f95-982f-d6bb8e072985 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:10.259933 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1ab56-998d-428c-a7f4-82845ba8e40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:10.261004 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1ab56-998d-428c-a7f4-82845ba8e40b None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:10.261486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1ab56-998d-428c-a7f4-82845ba8e40b None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:10.261985 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1ab56-998d-428c-a7f4-82845ba8e40b None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:10.263356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1ab56-998d-428c-a7f4-82845ba8e40b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:10.264027 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1ab56-998d-428c-a7f4-82845ba8e40b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:10.266632 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1ab56-998d-428c-a7f4-82845ba8e40b None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:10.300569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 221/431] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:10.309594 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1ab56-998d-428c-a7f4-82845ba8e40b None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:10.445391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a791dda-08f3-4f95-982f-d6bb8e072985 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:10.535234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a4dca-ffb8-49fe-ac57-844501cd1fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:10.538150 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a4dca-ffb8-49fe-ac57-844501cd1fde None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:10.539399 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a4dca-ffb8-49fe-ac57-844501cd1fde None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:10.540142 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a4dca-ffb8-49fe-ac57-844501cd1fde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:10.581068 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:10.631017 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1ab56-998d-428c-a7f4-82845ba8e40b None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:10.708383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a4dca-ffb8-49fe-ac57-844501cd1fde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:10.710863 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a4dca-ffb8-49fe-ac57-844501cd1fde None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:10.711839 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445b77d-10b1-41e5-8467-cecd3c2149b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:10.712874 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445b77d-10b1-41e5-8467-cecd3c2149b0 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:10.713354 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445b77d-10b1-41e5-8467-cecd3c2149b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:10.713763 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445b77d-10b1-41e5-8467-cecd3c2149b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:10.776882 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:10.887978 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445b77d-10b1-41e5-8467-cecd3c2149b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:10.889642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445b77d-10b1-41e5-8467-cecd3c2149b0 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:10.946117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 211/432] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:06:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 755 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:06:10.949325 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335bfc4-15d0-4466-b244-c3b5ca68f877 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:10.949785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335bfc4-15d0-4466-b244-c3b5ca68f877 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:10.950226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335bfc4-15d0-4466-b244-c3b5ca68f877 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:10.952712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 212/433] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:10.954835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016848f-cfbc-4ab4-b074-9878f2f1ad92 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:10.955211 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016848f-cfbc-4ab4-b074-9878f2f1ad92 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:10.955661 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016848f-cfbc-4ab4-b074-9878f2f1ad92 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:10.958310 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 213/434] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:10.959523 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016848f-cfbc-4ab4-b074-9878f2f1ad92 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:11.060359 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:11.077063 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 222/435] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:06:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 769 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 01:06:11.080293 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e9c85-9f6e-446b-8f64-04dccf82f206 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:11.080764 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e9c85-9f6e-446b-8f64-04dccf82f206 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:11.081247 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e9c85-9f6e-446b-8f64-04dccf82f206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:11.110815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-440e9c85-9f6e-446b-8f64-04dccf82f206 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:11.112055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-440e9c85-9f6e-446b-8f64-04dccf82f206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:11.142689 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016848f-cfbc-4ab4-b074-9878f2f1ad92 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:11.184727 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc614af4-15f7-4984-a323-8ff8f7da482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:11.185422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc614af4-15f7-4984-a323-8ff8f7da482b None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:11.185749 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc614af4-15f7-4984-a323-8ff8f7da482b None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:11.185998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc614af4-15f7-4984-a323-8ff8f7da482b None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:11.187698 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc614af4-15f7-4984-a323-8ff8f7da482b None admin] RBAC: Authorizing `identity:get_project(project_id=6d9e32fd96ae4748a30237bde6c1463f)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:11.188837 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc614af4-15f7-4984-a323-8ff8f7da482b None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:11.190465 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 214/436] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:06:10 2022] GET /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:11.192154 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4e5ac-0f40-469a-9214-045a7ddfcfad None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:11.192458 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4e5ac-0f40-469a-9214-045a7ddfcfad None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:11.192722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4e5ac-0f40-469a-9214-045a7ddfcfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:11.211783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:11.220658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-f2c4e5ac-0f40-469a-9214-045a7ddfcfad None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:11.227182 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f2c4e5ac-0f40-469a-9214-045a7ddfcfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:11.246749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 223/437] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:11.246749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e9c85-9f6e-446b-8f64-04dccf82f206 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:11.353162 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 215/438] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:11.354070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4e5ac-0f40-469a-9214-045a7ddfcfad None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:11.433590 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:11.441608 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e9c85-9f6e-446b-8f64-04dccf82f206 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:11.519120 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cd381-f577-4002-8de8-4e09bf491bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:11.520712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cd381-f577-4002-8de8-4e09bf491bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:11.521499 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cd381-f577-4002-8de8-4e09bf491bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:11.522144 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cd381-f577-4002-8de8-4e09bf491bd5 None admin] PATH_INFO: `/v3/projects/612f86bc1b6c4d8ab8393c2393a01341` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:11.524519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cd381-f577-4002-8de8-4e09bf491bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=612f86bc1b6c4d8ab8393c2393a01341)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:11.528569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cd381-f577-4002-8de8-4e09bf491bd5 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:11.532409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 224/439] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:06:11 2022] GET /identity/v3/projects/612f86bc1b6c4d8ab8393c2393a01341 => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:11.538869 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4e5ac-0f40-469a-9214-045a7ddfcfad None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:11.542166 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cd381-f577-4002-8de8-4e09bf491bd5 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:11.626821 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35394fe9-b4f3-4d3f-86f1-8ae514dbb62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:11.627923 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35394fe9-b4f3-4d3f-86f1-8ae514dbb62e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:11.628428 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35394fe9-b4f3-4d3f-86f1-8ae514dbb62e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:11.629093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35394fe9-b4f3-4d3f-86f1-8ae514dbb62e None admin] PATH_INFO: `/v3/groups/73f02e5440a544418afcb8d84f2dfd1e` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:11.632731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35394fe9-b4f3-4d3f-86f1-8ae514dbb62e None admin] RBAC: Authorizing `identity:get_group(group_id=73f02e5440a544418afcb8d84f2dfd1e)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:11.636700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35394fe9-b4f3-4d3f-86f1-8ae514dbb62e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:11.641426 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 216/440] 10.222.0.83 () {56 vars in 1180 bytes} [Fri Sep 23 01:06:11 2022] GET /identity/v3/groups/73f02e5440a544418afcb8d84f2dfd1e => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:11.651678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35394fe9-b4f3-4d3f-86f1-8ae514dbb62e None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:11.672920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:11.767866 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cd381-f577-4002-8de8-4e09bf491bd5 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:11.823159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aaf1c3-dd46-41fa-aad9-aabafd69de65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:11.824193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aaf1c3-dd46-41fa-aad9-aabafd69de65 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:11.824693 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aaf1c3-dd46-41fa-aad9-aabafd69de65 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:11.825138 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aaf1c3-dd46-41fa-aad9-aabafd69de65 None admin] PATH_INFO: `/v3/groups/73f02e5440a544418afcb8d84f2dfd1e` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:11.826632 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aaf1c3-dd46-41fa-aad9-aabafd69de65 None admin] RBAC: Authorizing `identity:get_group(group_id=73f02e5440a544418afcb8d84f2dfd1e)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:11.828773 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aaf1c3-dd46-41fa-aad9-aabafd69de65 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:11.831258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 225/441] 10.222.0.83 () {56 vars in 1180 bytes} [Fri Sep 23 01:06:11 2022] GET /identity/v3/groups/73f02e5440a544418afcb8d84f2dfd1e => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:11.832336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aaf1c3-dd46-41fa-aad9-aabafd69de65 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:11.845444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35394fe9-b4f3-4d3f-86f1-8ae514dbb62e None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:11.869531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:11.908589 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b922c-80bc-4560-a962-1d41ffbeefcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:11.910005 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b922c-80bc-4560-a962-1d41ffbeefcc None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:11.911223 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b922c-80bc-4560-a962-1d41ffbeefcc None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:11.911719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b922c-80bc-4560-a962-1d41ffbeefcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:11.913239 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b922c-80bc-4560-a962-1d41ffbeefcc None admin] RBAC: Adding query filter params (group.id=73f02e5440a544418afcb8d84f2dfd1e, role.id=986891361f4f4893a1cb2d0e0b523bff, scope.project.id=6d9e32fd96ae4748a30237bde6c1463f) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:11.913800 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b922c-80bc-4560-a962-1d41ffbeefcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:11.916691 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b922c-80bc-4560-a962-1d41ffbeefcc None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:11.928932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 217/442] 10.222.0.83 () {56 vars in 1376 bytes} [Fri Sep 23 01:06:11 2022] GET /identity/v3/role_assignments?group.id=73f02e5440a544418afcb8d84f2dfd1e&scope.project.id=6d9e32fd96ae4748a30237bde6c1463f&role.id=986891361f4f4893a1cb2d0e0b523bff => generated 611 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:11.930071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b922c-80bc-4560-a962-1d41ffbeefcc None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:12.028111 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aaf1c3-dd46-41fa-aad9-aabafd69de65 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:12.073035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:12.091662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539078f-e49e-43a8-af85-7e4fe35226ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:12.093042 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539078f-e49e-43a8-af85-7e4fe35226ec None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:12.093042 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539078f-e49e-43a8-af85-7e4fe35226ec None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:12.093042 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539078f-e49e-43a8-af85-7e4fe35226ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:12.111433 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539078f-e49e-43a8-af85-7e4fe35226ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:12.120646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-f539078f-e49e-43a8-af85-7e4fe35226ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:06:12.120646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:12.120646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:12.120646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:12.120646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:12.120646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:12.120646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:12.120646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:12.120646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:12.120646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:12.120646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:12.120646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:12.120646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:12.120646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:12.120646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:12.120646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:12.122657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:12.122657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:12.122657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:12.122657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:12.122657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:12.122657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:12.122657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:12.122657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:12.122657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:12.122657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:12.122657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:12.122657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:12.122657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:12.122657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:12.122657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:12.122657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:12.124840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:12.124840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:12.124840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:12.124840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:12.124840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:12.124840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:12.124840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:12.124840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:12.124840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:12.124840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:12.124840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:06:12.124840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:12.124840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 226/443] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:06:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:12.129043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539078f-e49e-43a8-af85-7e4fe35226ec None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:12.147529 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b922c-80bc-4560-a962-1d41ffbeefcc None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:12.198938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e609f-2be3-4edb-a862-6731f392824f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:12.199944 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e609f-2be3-4edb-a862-6731f392824f None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:12.200462 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e609f-2be3-4edb-a862-6731f392824f None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:12.200972 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e609f-2be3-4edb-a862-6731f392824f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:12.202208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e609f-2be3-4edb-a862-6731f392824f None admin] RBAC: Adding query filter params (group.id=73f02e5440a544418afcb8d84f2dfd1e, role.id=a9e6249ed8cd44ce9fac74a4c8155978, scope.project.id=612f86bc1b6c4d8ab8393c2393a01341) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:12.202866 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e609f-2be3-4edb-a862-6731f392824f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:12.205248 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e609f-2be3-4edb-a862-6731f392824f None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:12.214417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 218/444] 10.222.0.83 () {56 vars in 1376 bytes} [Fri Sep 23 01:06:11 2022] GET /identity/v3/role_assignments?group.id=73f02e5440a544418afcb8d84f2dfd1e&scope.project.id=612f86bc1b6c4d8ab8393c2393a01341&role.id=a9e6249ed8cd44ce9fac74a4c8155978 => generated 611 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:12.216857 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e609f-2be3-4edb-a862-6731f392824f None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:12.302845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:12.336783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539078f-e49e-43a8-af85-7e4fe35226ec None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:12.397049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b0e53-c411-4eb1-a452-edb29bc7d55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:12.398458 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b0e53-c411-4eb1-a452-edb29bc7d55e None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:12.399130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b0e53-c411-4eb1-a452-edb29bc7d55e None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:12.399853 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b0e53-c411-4eb1-a452-edb29bc7d55e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:12.417210 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e609f-2be3-4edb-a862-6731f392824f None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:12.420176 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b0e53-c411-4eb1-a452-edb29bc7d55e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:12.431959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-e48b0e53-c411-4eb1-a452-edb29bc7d55e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:06:12.431959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:12.431959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:12.431959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:12.431959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:12.431959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:12.431959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:12.431959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:12.431959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:12.431959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:12.431959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:12.431959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:12.431959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:12.431959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:12.431959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:12.431959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:12.432932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:12.432932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:12.432932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:12.432932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:12.432932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:12.432932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:12.432932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:12.432932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:12.432932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:12.432932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:12.432932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:12.432932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:12.432932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:12.432932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:12.432932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:12.432932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:12.433712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:12.433712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:12.433712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:12.433712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:12.433712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:12.433712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:12.433712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:12.433712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:12.433712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:12.433712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:12.433712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:06:12.433712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:12.434301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 227/445] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:06:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:12.445109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b0e53-c411-4eb1-a452-edb29bc7d55e None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:12.495550 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abe36e-8337-4303-a81b-489e29698828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:12.496494 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abe36e-8337-4303-a81b-489e29698828 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:12.496797 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abe36e-8337-4303-a81b-489e29698828 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:12.497077 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abe36e-8337-4303-a81b-489e29698828 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:12.498072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abe36e-8337-4303-a81b-489e29698828 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:12.498505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abe36e-8337-4303-a81b-489e29698828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:12.500341 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abe36e-8337-4303-a81b-489e29698828 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:12.518716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 219/446] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:06:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:12.525275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abe36e-8337-4303-a81b-489e29698828 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:12.532968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:12.624452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b0e53-c411-4eb1-a452-edb29bc7d55e None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:12.695555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd0c78-f962-4f00-a370-e08bcbce3394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:12.696969 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd0c78-f962-4f00-a370-e08bcbce3394 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:12.697458 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd0c78-f962-4f00-a370-e08bcbce3394 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:12.697951 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd0c78-f962-4f00-a370-e08bcbce3394 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:12.699563 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd0c78-f962-4f00-a370-e08bcbce3394 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:12.700100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd0c78-f962-4f00-a370-e08bcbce3394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:12.703922 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd0c78-f962-4f00-a370-e08bcbce3394 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:12.708898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abe36e-8337-4303-a81b-489e29698828 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:12.710581 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:12.725333 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 228/447] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:06:12.732920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd0c78-f962-4f00-a370-e08bcbce3394 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:12.770561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab587b-dc74-4a2a-bff0-d2400dff3f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:12.771720 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab587b-dc74-4a2a-bff0-d2400dff3f8c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:12.772218 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab587b-dc74-4a2a-bff0-d2400dff3f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:12.772691 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab587b-dc74-4a2a-bff0-d2400dff3f8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:12.894626 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab587b-dc74-4a2a-bff0-d2400dff3f8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:12.896193 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab587b-dc74-4a2a-bff0-d2400dff3f8c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:12.929659 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd0c78-f962-4f00-a370-e08bcbce3394 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:12.950778 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:12.998792 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c37db9-7ef1-4ec0-af8a-184832e46ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:13.000176 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c37db9-7ef1-4ec0-af8a-184832e46ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:13.000681 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c37db9-7ef1-4ec0-af8a-184832e46ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:13.001172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c37db9-7ef1-4ec0-af8a-184832e46ac9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:13.082780 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 220/448] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:06:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:06:13.087522 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab587b-dc74-4a2a-bff0-d2400dff3f8c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:13.091240 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:13.119766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c37db9-7ef1-4ec0-af8a-184832e46ac9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:13.122438 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c37db9-7ef1-4ec0-af8a-184832e46ac9 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:13.274474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab587b-dc74-4a2a-bff0-d2400dff3f8c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:13.289364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 229/449] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:06:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 01:06:13.295158 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c37db9-7ef1-4ec0-af8a-184832e46ac9 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:13.308146 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:13.333351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61d0da-898a-451d-8563-98982ba0eff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:13.334445 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61d0da-898a-451d-8563-98982ba0eff3 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:13.334973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61d0da-898a-451d-8563-98982ba0eff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:13.335459 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61d0da-898a-451d-8563-98982ba0eff3 None admin] PATH_INFO: `/v3/projects/bb2e67cab7234c2983ce58824e8c7d2f` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:13.337642 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61d0da-898a-451d-8563-98982ba0eff3 None admin] RBAC: Authorizing `identity:get_project(project_id=bb2e67cab7234c2983ce58824e8c7d2f)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:13.340560 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61d0da-898a-451d-8563-98982ba0eff3 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:13.343860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 221/450] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:06:13 2022] GET /identity/v3/projects/bb2e67cab7234c2983ce58824e8c7d2f => generated 344 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:06:13.350344 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61d0da-898a-451d-8563-98982ba0eff3 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:13.434681 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c37db9-7ef1-4ec0-af8a-184832e46ac9 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:13.464975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:13.495467 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17340fae-92d4-46de-ab1a-022c07bfb726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:13.496549 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17340fae-92d4-46de-ab1a-022c07bfb726 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:13.531567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17340fae-92d4-46de-ab1a-022c07bfb726 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:13.531567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17340fae-92d4-46de-ab1a-022c07bfb726 None admin] PATH_INFO: `/v3/projects/6d9e32fd96ae4748a30237bde6c1463f` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:13.531567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17340fae-92d4-46de-ab1a-022c07bfb726 None admin] RBAC: Authorizing `identity:get_project(project_id=6d9e32fd96ae4748a30237bde6c1463f)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:13.531567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17340fae-92d4-46de-ab1a-022c07bfb726 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:13.532075 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61d0da-898a-451d-8563-98982ba0eff3 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:13.532203 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 230/451] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:06:13 2022] GET /identity/v3/projects/6d9e32fd96ae4748a30237bde6c1463f => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:06:13.532203 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17340fae-92d4-46de-ab1a-022c07bfb726 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:13.549670 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9306f3-4222-451a-87d1-df1438033a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:13.550833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9306f3-4222-451a-87d1-df1438033a47 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:13.551353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9306f3-4222-451a-87d1-df1438033a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:13.551836 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9306f3-4222-451a-87d1-df1438033a47 None admin] PATH_INFO: `/v3/groups/a41cffb3a2cb44078ecd6c00cccd2943` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:13.554164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9306f3-4222-451a-87d1-df1438033a47 None admin] RBAC: Authorizing `identity:get_group(group_id=a41cffb3a2cb44078ecd6c00cccd2943)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:13.557860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9306f3-4222-451a-87d1-df1438033a47 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:13.562481 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 222/452] 10.222.0.83 () {56 vars in 1180 bytes} [Fri Sep 23 01:06:13 2022] GET /identity/v3/groups/a41cffb3a2cb44078ecd6c00cccd2943 => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:06:13.571136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9306f3-4222-451a-87d1-df1438033a47 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:13.630357 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:13.658457 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17340fae-92d4-46de-ab1a-022c07bfb726 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:13.717781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716d941-bfd5-497c-97d2-8791ec9b65d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:13.718814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716d941-bfd5-497c-97d2-8791ec9b65d6 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:13.719119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716d941-bfd5-497c-97d2-8791ec9b65d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:13.719517 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716d941-bfd5-497c-97d2-8791ec9b65d6 None admin] PATH_INFO: `/v3/groups/73f02e5440a544418afcb8d84f2dfd1e` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:13.721093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716d941-bfd5-497c-97d2-8791ec9b65d6 None admin] RBAC: Authorizing `identity:get_group(group_id=73f02e5440a544418afcb8d84f2dfd1e)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:13.723099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716d941-bfd5-497c-97d2-8791ec9b65d6 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:13.725369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 231/453] 10.222.0.83 () {56 vars in 1180 bytes} [Fri Sep 23 01:06:13 2022] GET /identity/v3/groups/73f02e5440a544418afcb8d84f2dfd1e => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:13.732662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716d941-bfd5-497c-97d2-8791ec9b65d6 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:13.740194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9306f3-4222-451a-87d1-df1438033a47 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:13.805428 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115815c6-5c39-4e87-b826-7722c96052f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:13.806409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115815c6-5c39-4e87-b826-7722c96052f0 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:13.806911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115815c6-5c39-4e87-b826-7722c96052f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:13.807275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115815c6-5c39-4e87-b826-7722c96052f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:13.808159 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115815c6-5c39-4e87-b826-7722c96052f0 None admin] RBAC: Adding query filter params (group.id=a41cffb3a2cb44078ecd6c00cccd2943, role.id=d365054bc34046c5829cd1355f3a31ac, scope.project.id=bb2e67cab7234c2983ce58824e8c7d2f) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:13.808586 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115815c6-5c39-4e87-b826-7722c96052f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:13.810621 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115815c6-5c39-4e87-b826-7722c96052f0 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:13.818229 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 223/454] 10.222.0.83 () {56 vars in 1376 bytes} [Fri Sep 23 01:06:13 2022] GET /identity/v3/role_assignments?group.id=a41cffb3a2cb44078ecd6c00cccd2943&scope.project.id=bb2e67cab7234c2983ce58824e8c7d2f&role.id=d365054bc34046c5829cd1355f3a31ac => generated 611 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:13.897619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716d941-bfd5-497c-97d2-8791ec9b65d6 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:13.947622 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf2258-5977-4a3e-baa4-39304c824a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:13.948335 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf2258-5977-4a3e-baa4-39304c824a95 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:13.948630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf2258-5977-4a3e-baa4-39304c824a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:13.948878 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf2258-5977-4a3e-baa4-39304c824a95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:13.949673 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf2258-5977-4a3e-baa4-39304c824a95 None admin] RBAC: Adding query filter params (group.id=73f02e5440a544418afcb8d84f2dfd1e, role.id=a9e6249ed8cd44ce9fac74a4c8155978, scope.project.id=6d9e32fd96ae4748a30237bde6c1463f) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:13.949984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf2258-5977-4a3e-baa4-39304c824a95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:13.951559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf2258-5977-4a3e-baa4-39304c824a95 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:13.959331 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 232/455] 10.222.0.83 () {56 vars in 1376 bytes} [Fri Sep 23 01:06:13 2022] GET /identity/v3/role_assignments?group.id=73f02e5440a544418afcb8d84f2dfd1e&scope.project.id=6d9e32fd96ae4748a30237bde6c1463f&role.id=a9e6249ed8cd44ce9fac74a4c8155978 => generated 611 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:06:17.718645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118c09c-df71-4d46-a3db-4fca9f7fee41 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:17.719456 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118c09c-df71-4d46-a3db-4fca9f7fee41 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:17.719593 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118c09c-df71-4d46-a3db-4fca9f7fee41 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:17.722631 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 224/456] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:17.731301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af2a56-1e8d-41e6-9b27-8bc88cd99d83 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:17.732079 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af2a56-1e8d-41e6-9b27-8bc88cd99d83 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:17.732243 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af2a56-1e8d-41e6-9b27-8bc88cd99d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:17.774457 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-f5af2a56-1e8d-41e6-9b27-8bc88cd99d83 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:17.776755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f5af2a56-1e8d-41e6-9b27-8bc88cd99d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:17.780678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:17.962875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 233/457] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:18.417774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118c09c-df71-4d46-a3db-4fca9f7fee41 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:18.422917 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:18.439509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a220d2-cedd-4e9f-8263-db94f51a7fa3 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:18.446213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a220d2-cedd-4e9f-8263-db94f51a7fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:18.447157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a220d2-cedd-4e9f-8263-db94f51a7fa3 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:18.450427 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 234/458] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:18 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:18.457472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee560e7-1b4e-4168-936a-d37e33debe6c None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:18.458400 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee560e7-1b4e-4168-936a-d37e33debe6c None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:18.459226 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee560e7-1b4e-4168-936a-d37e33debe6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:18.503556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-6ee560e7-1b4e-4168-936a-d37e33debe6c None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:18.507217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6ee560e7-1b4e-4168-936a-d37e33debe6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:18.596684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118c09c-df71-4d46-a3db-4fca9f7fee41 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:18.641220 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dd1de-6a47-4916-a6e2-571ff38bdb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:18.642165 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dd1de-6a47-4916-a6e2-571ff38bdb24 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:18.642620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dd1de-6a47-4916-a6e2-571ff38bdb24 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:18.643047 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dd1de-6a47-4916-a6e2-571ff38bdb24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:18.655795 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 235/459] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:18.662621 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9dd1de-6a47-4916-a6e2-571ff38bdb24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:18.662865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547412b6-f766-4d72-8a19-8a5f3322d6c2 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:18.662865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547412b6-f766-4d72-8a19-8a5f3322d6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:18.662865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547412b6-f766-4d72-8a19-8a5f3322d6c2 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:18.662865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 236/460] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:18.671300 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9dd1de-6a47-4916-a6e2-571ff38bdb24 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:18.680619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab9ab0-f727-4c57-bbb3-8a208da5e463 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:18.681107 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab9ab0-f727-4c57-bbb3-8a208da5e463 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:18.681598 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab9ab0-f727-4c57-bbb3-8a208da5e463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:18.741777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-3f9dd1de-6a47-4916-a6e2-571ff38bdb24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:18.741777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:18.741777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:18.741777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:18.741777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:18.741777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:18.741777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:18.741777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:18.741777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:18.741777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:18.741777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:18.741777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:18.741777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:18.741777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:18.741777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:18.741777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:18.743500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:18.743500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:18.743500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:18.743500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:18.743500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:18.743500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:18.743500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:18.743500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:18.743500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:18.743500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:18.743500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:18.743500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:18.743500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:18.743500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:18.743500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:18.743500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:18.743500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:18.744786 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:18.744786 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:18.744786 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:18.746625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-84ab9ab0-f727-4c57-bbb3-8a208da5e463 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:18.748444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-84ab9ab0-f727-4c57-bbb3-8a208da5e463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:18.756346 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 225/461] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:06:18.762575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dd1de-6a47-4916-a6e2-571ff38bdb24 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:18.936293 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:18.949022 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:18.961051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 237/462] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:19.018663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dd1de-6a47-4916-a6e2-571ff38bdb24 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:19.079333 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35f213-7952-490d-8a84-3ba185fe8bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:19.080078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35f213-7952-490d-8a84-3ba185fe8bea None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:19.080365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35f213-7952-490d-8a84-3ba185fe8bea None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:19.080631 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35f213-7952-490d-8a84-3ba185fe8bea None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:19.081303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35f213-7952-490d-8a84-3ba185fe8bea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:19.081607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35f213-7952-490d-8a84-3ba185fe8bea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:19.083967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35f213-7952-490d-8a84-3ba185fe8bea None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:19.124672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 226/463] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:06:19.133472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab9ab0-f727-4c57-bbb3-8a208da5e463 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:19.231728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35f213-7952-490d-8a84-3ba185fe8bea None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:19.403253 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab9ab0-f727-4c57-bbb3-8a208da5e463 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:19.469856 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bcbcf-a23c-4044-ab7a-b171348c1007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:19.471217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bcbcf-a23c-4044-ab7a-b171348c1007 None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:19.471856 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bcbcf-a23c-4044-ab7a-b171348c1007 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:19.472516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bcbcf-a23c-4044-ab7a-b171348c1007 None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:19.474389 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bcbcf-a23c-4044-ab7a-b171348c1007 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:19.476901 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bcbcf-a23c-4044-ab7a-b171348c1007 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:19.531604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35f213-7952-490d-8a84-3ba185fe8bea None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:19.550897 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:19.568858 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 238/464] 10.222.0.83 () {60 vars in 1132 bytes} [Fri Sep 23 01:06:19 2022] POST /identity/v3/users => generated 248 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:06:19.571266 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c6987-9a5b-42c2-9d29-d2a74c96e761 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:19.571819 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c6987-9a5b-42c2-9d29-d2a74c96e761 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:19.572388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c6987-9a5b-42c2-9d29-d2a74c96e761 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:19.574027 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 239/465] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:19.578793 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201d94d-3920-403d-84f6-3f7c0fb3b4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:19.578793 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201d94d-3920-403d-84f6-3f7c0fb3b4fc None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:19.578793 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201d94d-3920-403d-84f6-3f7c0fb3b4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:19.578793 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201d94d-3920-403d-84f6-3f7c0fb3b4fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:19.581759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df516a-9523-4d07-afc1-26171e660165 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:19.583124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df516a-9523-4d07-afc1-26171e660165 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:19.583404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df516a-9523-4d07-afc1-26171e660165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:19.599677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201d94d-3920-403d-84f6-3f7c0fb3b4fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:19.603667 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201d94d-3920-403d-84f6-3f7c0fb3b4fc None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:19.621863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-56df516a-9523-4d07-afc1-26171e660165 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:19.624684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-56df516a-9523-4d07-afc1-26171e660165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:19.636975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-9201d94d-3920-403d-84f6-3f7c0fb3b4fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:19.636975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:19.636975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:19.636975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:19.636975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:19.636975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:19.636975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:19.636975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:19.636975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:19.636975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:19.636975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:19.636975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:19.636975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:19.636975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:19.636975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:19.636975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:19.638882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:19.638882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:19.638882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:19.638882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:19.638882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:19.638882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:19.638882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:19.638882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:19.638882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:19.638882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:19.638882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:19.638882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:19.638882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:19.638882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:19.638882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:19.638882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:19.638882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:19.647530 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:19.647530 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:19.647530 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:19.647530 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 227/466] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:06:19.647530 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201d94d-3920-403d-84f6-3f7c0fb3b4fc None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:19.746060 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:19.773007 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 240/467] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:19.780367 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df516a-9523-4d07-afc1-26171e660165 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:19.858131 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201d94d-3920-403d-84f6-3f7c0fb3b4fc None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:19.922526 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cebd07-5e2b-4617-9b61-d897a32a351a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:19.923957 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cebd07-5e2b-4617-9b61-d897a32a351a None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:19.924763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cebd07-5e2b-4617-9b61-d897a32a351a None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:19.925572 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cebd07-5e2b-4617-9b61-d897a32a351a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:19.950826 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cebd07-5e2b-4617-9b61-d897a32a351a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:19.954234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cebd07-5e2b-4617-9b61-d897a32a351a None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:19.963774 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df516a-9523-4d07-afc1-26171e660165 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:19.985264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-37cebd07-5e2b-4617-9b61-d897a32a351a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:19.985264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:19.985264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:19.985264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:19.985264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:19.985264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:19.985264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:19.985264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:19.985264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:19.985264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:19.985264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:19.985264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:19.985264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:19.985264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:19.985264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:19.985264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:19.986856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:19.986856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:19.986856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:19.986856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:19.986856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:19.986856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:19.986856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:19.986856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:19.986856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:19.986856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:19.986856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:19.986856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:19.986856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:19.986856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:19.986856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:19.986856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:19.986856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:19.987736 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:19.987736 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:19.987736 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:19.987736 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 228/468] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:19.989531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d23eed-3c82-48b4-8844-f1254ae76bb2 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:19.989902 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d23eed-3c82-48b4-8844-f1254ae76bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:19.990228 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d23eed-3c82-48b4-8844-f1254ae76bb2 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:19.992523 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 229/469] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:20.000552 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb017d-4ed4-4c5c-9b1e-887ef44db40f None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:20.000552 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb017d-4ed4-4c5c-9b1e-887ef44db40f None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:20.000885 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb017d-4ed4-4c5c-9b1e-887ef44db40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:20.022095 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80325221-642b-4947-be54-e8b01edc6356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:20.022352 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-dbbb017d-4ed4-4c5c-9b1e-887ef44db40f None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:20.022894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80325221-642b-4947-be54-e8b01edc6356 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:20.023185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80325221-642b-4947-be54-e8b01edc6356 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:20.023417 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80325221-642b-4947-be54-e8b01edc6356 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:20.023789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-dbbb017d-4ed4-4c5c-9b1e-887ef44db40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:20.024095 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80325221-642b-4947-be54-e8b01edc6356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:20.024402 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80325221-642b-4947-be54-e8b01edc6356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:20.025840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80325221-642b-4947-be54-e8b01edc6356 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:20.044383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:20.045727 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 241/470] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:20.051604 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80325221-642b-4947-be54-e8b01edc6356 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:20.136043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:20.145607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 230/471] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:20.147060 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb017d-4ed4-4c5c-9b1e-887ef44db40f None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:20.298009 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80325221-642b-4947-be54-e8b01edc6356 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:20.351270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3857ad-f29c-4558-9b54-ebd85ff7a932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:20.351896 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3857ad-f29c-4558-9b54-ebd85ff7a932 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:20.352175 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3857ad-f29c-4558-9b54-ebd85ff7a932 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:20.352445 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3857ad-f29c-4558-9b54-ebd85ff7a932 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:20.353342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3857ad-f29c-4558-9b54-ebd85ff7a932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:20.353651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3857ad-f29c-4558-9b54-ebd85ff7a932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:20.355199 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3857ad-f29c-4558-9b54-ebd85ff7a932 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:20.369632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb017d-4ed4-4c5c-9b1e-887ef44db40f None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:20.386858 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 242/472] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:20.388384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3857ad-f29c-4558-9b54-ebd85ff7a932 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:20.450125 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d8a62-970d-4717-ba9f-21f5bd0acdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:20.451987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d8a62-970d-4717-ba9f-21f5bd0acdfe None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:20.452470 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d8a62-970d-4717-ba9f-21f5bd0acdfe None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:20.452955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d8a62-970d-4717-ba9f-21f5bd0acdfe None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:20.454178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d8a62-970d-4717-ba9f-21f5bd0acdfe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:20.456932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d8a62-970d-4717-ba9f-21f5bd0acdfe None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:20.555311 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 231/473] 10.222.0.83 () {60 vars in 1132 bytes} [Fri Sep 23 01:06:20 2022] POST /identity/v3/users => generated 246 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:06:20.556979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d8a62-970d-4717-ba9f-21f5bd0acdfe None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:20.562946 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:20.614520 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3857ad-f29c-4558-9b54-ebd85ff7a932 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:20.621765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:20.702446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d8dcc-1e00-45da-87e0-67ed15640a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:20.703491 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d8dcc-1e00-45da-87e0-67ed15640a5a None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:20.704002 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d8dcc-1e00-45da-87e0-67ed15640a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:20.704509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d8dcc-1e00-45da-87e0-67ed15640a5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:20.730199 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d8dcc-1e00-45da-87e0-67ed15640a5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:20.733390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d8dcc-1e00-45da-87e0-67ed15640a5a None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:20.764498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-2b0d8dcc-1e00-45da-87e0-67ed15640a5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:20.764498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:20.764498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:20.764498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:20.764498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:20.764498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:20.764498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:20.764498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:20.764498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:20.764498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:20.764498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:20.764498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:20.764498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:20.764498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:20.764498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:20.764498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:20.766262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:20.766262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:20.766262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:20.766262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:20.766262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:20.766262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:20.766262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:20.766262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:20.766262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:20.766262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:20.766262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:20.766262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:20.766262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:20.766262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:20.766262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:20.766262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:20.766262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:20.768555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:20.768555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:20.768555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:20.768555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 243/474] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:20.773964 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d8dcc-1e00-45da-87e0-67ed15640a5a None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:20.785629 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d8a62-970d-4717-ba9f-21f5bd0acdfe None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:20.847424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece724c5-6911-479a-b182-6d216220b67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:20.848713 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece724c5-6911-479a-b182-6d216220b67c None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:20.849010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece724c5-6911-479a-b182-6d216220b67c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:20.849338 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece724c5-6911-479a-b182-6d216220b67c None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:20.850302 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece724c5-6911-479a-b182-6d216220b67c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:20.852942 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece724c5-6911-479a-b182-6d216220b67c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:20.978076 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d8dcc-1e00-45da-87e0-67ed15640a5a None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:20.979190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 232/475] 10.222.0.83 () {60 vars in 1132 bytes} [Fri Sep 23 01:06:20 2022] POST /identity/v3/users => generated 248 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:06:20.980200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece724c5-6911-479a-b182-6d216220b67c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:21.030291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ab14b-695d-46e5-84be-fd8110b67f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:21.031137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ab14b-695d-46e5-84be-fd8110b67f22 None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:21.031422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ab14b-695d-46e5-84be-fd8110b67f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:21.031695 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ab14b-695d-46e5-84be-fd8110b67f22 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:21.033321 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ab14b-695d-46e5-84be-fd8110b67f22 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:21.035717 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ab14b-695d-46e5-84be-fd8110b67f22 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:21.086369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.sql.core [None req-309ab14b-695d-46e5-84be-fd8110b67f22 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 23 01:06:21.086369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 23 01:06:21.086369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [parameters: {'id': '28f3c425ecf44843ae0e0ee9a18e4016', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 23 01:06:21.086369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81923) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 23 01:06:21.108431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-309ab14b-695d-46e5-84be-fd8110b67f22 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 23 01:06:21.108431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:21.108431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 01:06:21.108431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 01:06:21.108431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 01:06:21.108431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 01:06:21.108431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 01:06:21.108431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 01:06:21.108431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 01:06:21.108431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application conn.query(q) Sep 23 01:06:21.108431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 01:06:21.108431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 01:06:21.108431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 01:06:21.108431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application result.read() Sep 23 01:06:21.108431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 01:06:21.110109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 01:06:21.110109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 01:06:21.110109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 01:06:21.110109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 01:06:21.110109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 01:06:21.110109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 01:06:21.110109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 01:06:21.110109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 23 01:06:21.110109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:21.110109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 23 01:06:21.110109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:21.110109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:21.110109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 23 01:06:21.110109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 23 01:06:21.110109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 23 01:06:21.110109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return ref.to_dict() Sep 23 01:06:21.110109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 01:06:21.110109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application next(self.gen) Sep 23 01:06:21.112988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 23 01:06:21.112988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application yield resource Sep 23 01:06:21.112988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 01:06:21.112988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application next(self.gen) Sep 23 01:06:21.112988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 23 01:06:21.112988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self.session.rollback() Sep 23 01:06:21.112988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 01:06:21.112988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self.force_reraise() Sep 23 01:06:21.112988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 01:06:21.112988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise self.value Sep 23 01:06:21.112988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 23 01:06:21.112988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 23 01:06:21.112988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 23 01:06:21.112988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application session.commit() Sep 23 01:06:21.112988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 23 01:06:21.112988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 23 01:06:21.112988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 23 01:06:21.115280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._prepare_impl() Sep 23 01:06:21.115280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 23 01:06:21.115280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self.session.flush() Sep 23 01:06:21.115280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 23 01:06:21.115280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._flush(objects) Sep 23 01:06:21.115280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 23 01:06:21.115280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 23 01:06:21.115280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 23 01:06:21.115280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application compat.raise_( Sep 23 01:06:21.115280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 01:06:21.115280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception Sep 23 01:06:21.115280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 23 01:06:21.115280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application flush_context.execute() Sep 23 01:06:21.115280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 23 01:06:21.115280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rec.execute(self) Sep 23 01:06:21.115280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 23 01:06:21.115280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 23 01:06:21.125535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 23 01:06:21.125535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 23 01:06:21.125535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 23 01:06:21.125535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 23 01:06:21.125535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 23 01:06:21.125535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 23 01:06:21.125535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 23 01:06:21.125535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 23 01:06:21.125535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 23 01:06:21.125535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 23 01:06:21.125535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 23 01:06:21.125535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 23 01:06:21.125535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 23 01:06:21.125535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 23 01:06:21.125535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 01:06:21.125535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception Sep 23 01:06:21.128817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 01:06:21.128817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 01:06:21.128817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 01:06:21.128817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 01:06:21.128817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 01:06:21.128817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 01:06:21.128817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 01:06:21.128817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application conn.query(q) Sep 23 01:06:21.128817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 01:06:21.128817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 01:06:21.128817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 01:06:21.128817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application result.read() Sep 23 01:06:21.128817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 01:06:21.128817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 01:06:21.128817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 01:06:21.128817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 01:06:21.140523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 01:06:21.140523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 01:06:21.140523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 01:06:21.140523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 01:06:21.140523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 23 01:06:21.140523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 23 01:06:21.140523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [parameters: {'id': '28f3c425ecf44843ae0e0ee9a18e4016', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 23 01:06:21.140523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 23 01:06:21.140523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:21.140523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:06:21.140523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:21.140523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:21.140523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:21.140523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:21.140523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:21.140523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:21.143976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:21.143976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:21.143976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:21.143976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:21.143976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:21.143976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:21.143976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 23 01:06:21.143976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 23 01:06:21.143976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:21.143976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:21.143976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 23 01:06:21.143976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 23 01:06:21.143976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 23 01:06:21.143976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 23 01:06:21.143976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 23 01:06:21.143976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:21.147197 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 244/476] 10.222.0.83 () {60 vars in 1131 bytes} [Fri Sep 23 01:06:20 2022] POST /identity/v3/roles => generated 144 bytes in 344 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:21.147197 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ab14b-695d-46e5-84be-fd8110b67f22 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:21.153479 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:21.159373 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:21.267518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ab14b-695d-46e5-84be-fd8110b67f22 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:21.308494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaa4b8-aad1-4d96-b90e-3fdf16863252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:21.309324 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaa4b8-aad1-4d96-b90e-3fdf16863252 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:21.309882 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaa4b8-aad1-4d96-b90e-3fdf16863252 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:21.310251 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaa4b8-aad1-4d96-b90e-3fdf16863252 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:21.321996 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece724c5-6911-479a-b182-6d216220b67c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:21.324846 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaa4b8-aad1-4d96-b90e-3fdf16863252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:21.330364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-5dcaa4b8-aad1-4d96-b90e-3fdf16863252 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:06:21.330364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:21.330364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:21.330364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:21.330364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:21.330364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:21.330364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:21.330364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:21.330364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:21.330364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:21.330364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:21.330364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:21.330364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:21.330364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:21.330364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:21.330364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:21.332250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:21.332250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:21.332250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:21.332250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:21.332250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:21.332250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:21.332250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:21.332250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:21.332250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:21.332250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:21.332250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:21.332250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:21.332250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:21.332250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:21.332250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:21.332250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:21.333968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:21.333968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:21.333968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:21.333968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:21.333968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:21.333968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:21.333968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:21.333968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:21.333968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:21.333968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:21.333968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 01:06:21.333968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:21.338021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 245/477] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:06:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:06:21.341643 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaa4b8-aad1-4d96-b90e-3fdf16863252 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:21.405559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7773b-9e58-46fc-b136-426841d9bc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:21.406650 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7773b-9e58-46fc-b136-426841d9bc0b None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:21.407127 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7773b-9e58-46fc-b136-426841d9bc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:21.407727 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7773b-9e58-46fc-b136-426841d9bc0b None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:21.408918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7773b-9e58-46fc-b136-426841d9bc0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:21.409389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7773b-9e58-46fc-b136-426841d9bc0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:21.411572 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7773b-9e58-46fc-b136-426841d9bc0b None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:21.429176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 233/478] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:21.436438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7773b-9e58-46fc-b136-426841d9bc0b None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:21.454440 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:21.484190 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaa4b8-aad1-4d96-b90e-3fdf16863252 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:21.536376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e91a13-a41e-49e2-9808-d77e9cb75c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:21.537285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e91a13-a41e-49e2-9808-d77e9cb75c25 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:21.537662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e91a13-a41e-49e2-9808-d77e9cb75c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:21.537993 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e91a13-a41e-49e2-9808-d77e9cb75c25 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:21.539530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e91a13-a41e-49e2-9808-d77e9cb75c25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:21.539847 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e91a13-a41e-49e2-9808-d77e9cb75c25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:21.541796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e91a13-a41e-49e2-9808-d77e9cb75c25 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:21.553614 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 246/479] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:06:21.623399 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7773b-9e58-46fc-b136-426841d9bc0b None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:21.661971 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:21.691389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a461463-3ffe-43ca-bdde-17a2881e6bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:21.692163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a461463-3ffe-43ca-bdde-17a2881e6bff None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:21.692726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a461463-3ffe-43ca-bdde-17a2881e6bff None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:21.693205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a461463-3ffe-43ca-bdde-17a2881e6bff None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:21.694190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a461463-3ffe-43ca-bdde-17a2881e6bff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:21.695758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a461463-3ffe-43ca-bdde-17a2881e6bff None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:21.842696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 234/480] 10.222.0.83 () {60 vars in 1132 bytes} [Fri Sep 23 01:06:21 2022] POST /identity/v3/users => generated 249 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:06:23.316414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e37e0-e58f-496b-9f9d-2fa0ad504df5 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:23.317012 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e37e0-e58f-496b-9f9d-2fa0ad504df5 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:23.317012 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e37e0-e58f-496b-9f9d-2fa0ad504df5 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:23.318763 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 247/481] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:23.330647 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07787697-7202-419c-b053-ff9b515f92fe None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:23.331328 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07787697-7202-419c-b053-ff9b515f92fe None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:23.331660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07787697-7202-419c-b053-ff9b515f92fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:23.371335 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-07787697-7202-419c-b053-ff9b515f92fe None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:23.372674 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-07787697-7202-419c-b053-ff9b515f92fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:23.503068 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 235/482] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:24.061520 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119e876-3358-4c6b-a6f7-6ff131a3aabe None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:24.062038 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119e876-3358-4c6b-a6f7-6ff131a3aabe None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:24.062522 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119e876-3358-4c6b-a6f7-6ff131a3aabe None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:24.065776 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 248/483] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:24.078301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a7b74-0cc8-4fce-8a43-b531a5e8f2f4 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:24.078901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a7b74-0cc8-4fce-8a43-b531a5e8f2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:24.079389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a7b74-0cc8-4fce-8a43-b531a5e8f2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:24.117369 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-e10a7b74-0cc8-4fce-8a43-b531a5e8f2f4 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:24.123816 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-e10a7b74-0cc8-4fce-8a43-b531a5e8f2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:24.272961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119e876-3358-4c6b-a6f7-6ff131a3aabe None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:24.399513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 236/484] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:24.506923 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119e876-3358-4c6b-a6f7-6ff131a3aabe None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:24.587895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb32d8c-302f-4d58-a7f6-4c81d0e1aadc None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:24.588618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb32d8c-302f-4d58-a7f6-4c81d0e1aadc None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:24.589088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb32d8c-302f-4d58-a7f6-4c81d0e1aadc None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:24.591279 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 237/485] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:24.597706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42361800-dc09-4bd8-a44d-ddbbc37ab1ed None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:24.598503 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42361800-dc09-4bd8-a44d-ddbbc37ab1ed None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:24.599123 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42361800-dc09-4bd8-a44d-ddbbc37ab1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:24.615886 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03cd80-4de7-462e-8f7f-e9fbdec3ce6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:24.616997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03cd80-4de7-462e-8f7f-e9fbdec3ce6c None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:24.617492 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03cd80-4de7-462e-8f7f-e9fbdec3ce6c None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:24.617977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03cd80-4de7-462e-8f7f-e9fbdec3ce6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:24.628955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-42361800-dc09-4bd8-a44d-ddbbc37ab1ed None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:24.632393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-42361800-dc09-4bd8-a44d-ddbbc37ab1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:24.650261 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03cd80-4de7-462e-8f7f-e9fbdec3ce6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:24.656021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-5b03cd80-4de7-462e-8f7f-e9fbdec3ce6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:24.656021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:24.656021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:24.656021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:24.656021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:24.656021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:24.656021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:24.656021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:24.656021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:24.656021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:24.656021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:24.656021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:24.656021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:24.656021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:24.656021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:24.656021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:24.657291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:24.657291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:24.657291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:24.657291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:24.657291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:24.657291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:24.657291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:24.657291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:24.657291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:24.657291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:24.657291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:24.657291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:24.657291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:24.657291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:24.657291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:24.657291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:24.658325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:24.658325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:24.658325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:24.658325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:24.658325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:24.658325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:24.658325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:24.658325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:24.658325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:24.658325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:24.658325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:24.658325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:24.659437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 249/486] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:06:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:06:24.668396 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03cd80-4de7-462e-8f7f-e9fbdec3ce6c None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:24.675122 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:24.751665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:24.839479 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 238/487] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:06:24.841312 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42361800-dc09-4bd8-a44d-ddbbc37ab1ed None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:24.939494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03cd80-4de7-462e-8f7f-e9fbdec3ce6c None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:25.021844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8660f2-a1aa-4629-8b36-c05172e1d8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:25.022467 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8660f2-a1aa-4629-8b36-c05172e1d8aa None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:25.022765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8660f2-a1aa-4629-8b36-c05172e1d8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:25.023109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8660f2-a1aa-4629-8b36-c05172e1d8aa None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:25.023837 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8660f2-a1aa-4629-8b36-c05172e1d8aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:25.024135 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8660f2-a1aa-4629-8b36-c05172e1d8aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:25.025549 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8660f2-a1aa-4629-8b36-c05172e1d8aa None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:25.036310 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 250/488] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:06:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:25.045955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8660f2-a1aa-4629-8b36-c05172e1d8aa None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:25.139187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42361800-dc09-4bd8-a44d-ddbbc37ab1ed None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:25.196658 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:25.208216 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dda901-583b-4ce7-843d-878f3ebae2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:25.208861 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dda901-583b-4ce7-843d-878f3ebae2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:25.209137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dda901-583b-4ce7-843d-878f3ebae2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:25.210813 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dda901-583b-4ce7-843d-878f3ebae2b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:25.238004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dda901-583b-4ce7-843d-878f3ebae2b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:25.245999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-32dda901-583b-4ce7-843d-878f3ebae2b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:25.245999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:25.245999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:25.245999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:25.245999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:25.245999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:25.245999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:25.245999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:25.245999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:25.245999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:25.245999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:25.245999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:25.245999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:25.245999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:25.245999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:25.245999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:25.247613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:25.247613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:25.247613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:25.247613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:25.247613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:25.247613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:25.247613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:25.247613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:25.247613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:25.247613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:25.247613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:25.247613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:25.247613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:25.247613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:25.247613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:25.247613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:25.249129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:25.249129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:25.249129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:25.249129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:25.249129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:25.249129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:25.249129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:25.249129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:25.249129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:25.249129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:25.249129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:25.249129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:25.249129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 239/489] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:06:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:25.255797 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dda901-583b-4ce7-843d-878f3ebae2b9 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:25.287375 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8660f2-a1aa-4629-8b36-c05172e1d8aa None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:25.323628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:25.390990 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df2c26-2481-46a3-9c94-e980c16d435f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:25.392064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df2c26-2481-46a3-9c94-e980c16d435f None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:25.392557 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df2c26-2481-46a3-9c94-e980c16d435f None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:25.392917 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df2c26-2481-46a3-9c94-e980c16d435f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:25.419537 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df2c26-2481-46a3-9c94-e980c16d435f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:25.422365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df2c26-2481-46a3-9c94-e980c16d435f None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:25.457460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-10df2c26-2481-46a3-9c94-e980c16d435f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:25.457460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:25.457460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:25.457460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:25.457460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:25.457460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:25.457460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:25.457460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:25.457460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:25.457460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:25.457460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:25.457460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:25.457460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:25.457460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:25.457460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:25.457460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:25.459339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:25.459339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:25.459339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:25.459339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:25.459339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:25.459339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:25.459339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:25.459339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:25.459339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:25.459339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:25.459339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:25.459339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:25.459339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:25.459339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:25.459339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:25.459339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:25.459339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:25.461044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:25.461044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:25.461044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:25.461044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 251/490] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:06:25.467437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df2c26-2481-46a3-9c94-e980c16d435f None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:25.537623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dda901-583b-4ce7-843d-878f3ebae2b9 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:25.603073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87005bc-d8e2-4b5f-a380-7b0ed1552d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:25.604025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87005bc-d8e2-4b5f-a380-7b0ed1552d8e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:25.604460 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87005bc-d8e2-4b5f-a380-7b0ed1552d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:25.604898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87005bc-d8e2-4b5f-a380-7b0ed1552d8e None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:25.606793 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87005bc-d8e2-4b5f-a380-7b0ed1552d8e None admin] RBAC: Adding query filter params (name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:25.607619 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87005bc-d8e2-4b5f-a380-7b0ed1552d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:25.611804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87005bc-d8e2-4b5f-a380-7b0ed1552d8e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:25.627587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 240/491] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:06:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:25.629684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87005bc-d8e2-4b5f-a380-7b0ed1552d8e None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:25.678783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df2c26-2481-46a3-9c94-e980c16d435f None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:25.704370 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:25.738975 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3fec2-a420-404e-9864-fe0c9cc5f3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:25.739883 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3fec2-a420-404e-9864-fe0c9cc5f3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:25.740301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3fec2-a420-404e-9864-fe0c9cc5f3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:25.740702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3fec2-a420-404e-9864-fe0c9cc5f3f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:25.742021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3fec2-a420-404e-9864-fe0c9cc5f3f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:25.742996 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3fec2-a420-404e-9864-fe0c9cc5f3f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:25.745795 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3fec2-a420-404e-9864-fe0c9cc5f3f2 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:25.782109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 252/492] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:25.782109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3fec2-a420-404e-9864-fe0c9cc5f3f2 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:25.791058 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:25.806544 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87005bc-d8e2-4b5f-a380-7b0ed1552d8e None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:25.871467 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b3965-d167-4087-b693-0cef58474fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:25.872582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b3965-d167-4087-b693-0cef58474fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:25.873103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b3965-d167-4087-b693-0cef58474fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:25.873547 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b3965-d167-4087-b693-0cef58474fc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:25.894426 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b3965-d167-4087-b693-0cef58474fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:25.905974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-c42b3965-d167-4087-b693-0cef58474fc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:25.905974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:25.905974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:25.905974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:25.905974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:25.905974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:25.905974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:25.905974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:25.905974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:25.905974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:25.905974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:25.905974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:25.905974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:25.905974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:25.905974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:25.905974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:25.907102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:25.907102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:25.907102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:25.907102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:25.907102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:25.907102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:25.907102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:25.907102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:25.907102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:25.907102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:25.907102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:25.907102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:25.907102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:25.907102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:25.907102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:25.907102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:25.907986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:25.907986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:25.907986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:25.907986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:25.907986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:25.907986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:25.907986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:25.907986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:25.907986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:25.907986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:25.907986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:25.907986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:25.908582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 241/493] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:06:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:25.909846 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b3965-d167-4087-b693-0cef58474fc3 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:25.941327 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3fec2-a420-404e-9864-fe0c9cc5f3f2 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:26.012569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e51f2e-6cf5-488b-8940-e08e9f287da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:26.014000 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e51f2e-6cf5-488b-8940-e08e9f287da0 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:26.014529 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e51f2e-6cf5-488b-8940-e08e9f287da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:26.015140 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e51f2e-6cf5-488b-8940-e08e9f287da0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:26.028986 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e51f2e-6cf5-488b-8940-e08e9f287da0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:26.031276 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e51f2e-6cf5-488b-8940-e08e9f287da0 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:26.056422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-79e51f2e-6cf5-488b-8940-e08e9f287da0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:26.056422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:26.056422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:26.056422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:26.056422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:26.056422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:26.056422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:26.056422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:26.056422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:26.056422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:26.056422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:26.056422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:26.056422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:26.056422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:26.056422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:26.056422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:26.057877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:26.057877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:26.057877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:26.057877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:26.057877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:26.057877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:26.057877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:26.057877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:26.057877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:26.057877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:26.057877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:26.057877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:26.057877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:26.057877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:26.057877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:26.057877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:26.057877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:26.058733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:26.058733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:26.058733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:26.065211 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 253/494] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:26.065729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05db184-0ae5-43ae-8793-661da0041041 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:26.066381 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05db184-0ae5-43ae-8793-661da0041041 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:26.067692 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05db184-0ae5-43ae-8793-661da0041041 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:26.071181 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 254/495] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:26.076206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05db184-0ae5-43ae-8793-661da0041041 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:26.105380 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b3965-d167-4087-b693-0cef58474fc3 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:26.131231 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:26.170971 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490a8de-a1b1-4f32-a10d-d0ea65c67f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:26.171856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490a8de-a1b1-4f32-a10d-d0ea65c67f44 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:26.172218 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490a8de-a1b1-4f32-a10d-d0ea65c67f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:26.172507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490a8de-a1b1-4f32-a10d-d0ea65c67f44 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:26.182110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490a8de-a1b1-4f32-a10d-d0ea65c67f44 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:26.183659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490a8de-a1b1-4f32-a10d-d0ea65c67f44 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:26.199925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-e490a8de-a1b1-4f32-a10d-d0ea65c67f44 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 23 01:06:26.199925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:26.199925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:26.199925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:26.199925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:26.199925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:26.199925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:26.199925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:26.199925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:26.199925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:26.199925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:26.199925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:26.199925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:06:26.199925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:06:26.199925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:06:26.199925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:06:26.201775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:26.201775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:26.201775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:06:26.201775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:26.201775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:06:26.201775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:26.201775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:26.201775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:26.201775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:26.201775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:26.201775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:26.201775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:26.201775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:26.201775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:26.201775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:26.201775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:26.201775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:26.201775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:26.205241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:26.205241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:26.205241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:06:26.205241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:06:26.205241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:06:26.205241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:06:26.205241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:06:26.205241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:06:26.205241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 23 01:06:26.205241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:26.205241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 242/496] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:06:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:26.205241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490a8de-a1b1-4f32-a10d-d0ea65c67f44 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:26.232297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:26.260669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05db184-0ae5-43ae-8793-661da0041041 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:26.307015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66684d0-022e-40fa-8af8-f09ddd1a8795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:26.307649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66684d0-022e-40fa-8af8-f09ddd1a8795 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:26.308023 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66684d0-022e-40fa-8af8-f09ddd1a8795 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:26.308344 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66684d0-022e-40fa-8af8-f09ddd1a8795 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:26.308941 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66684d0-022e-40fa-8af8-f09ddd1a8795 None admin] RBAC: Adding query filter params (name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:26.309242 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66684d0-022e-40fa-8af8-f09ddd1a8795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:26.310767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66684d0-022e-40fa-8af8-f09ddd1a8795 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:26.333067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 255/497] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:06:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:26.333067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02ba37-8b68-41d5-8248-aa563ecd98df None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:26.333067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02ba37-8b68-41d5-8248-aa563ecd98df None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:26.333067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02ba37-8b68-41d5-8248-aa563ecd98df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:26.358513 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-2e02ba37-8b68-41d5-8248-aa563ecd98df None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:26.360648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-2e02ba37-8b68-41d5-8248-aa563ecd98df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:26.405461 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490a8de-a1b1-4f32-a10d-d0ea65c67f44 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:26.445269 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d667339-76df-4b5c-8b81-d522b193a235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:26.446219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d667339-76df-4b5c-8b81-d522b193a235 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:26.446651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d667339-76df-4b5c-8b81-d522b193a235 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:26.447004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d667339-76df-4b5c-8b81-d522b193a235 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:26.447679 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d667339-76df-4b5c-8b81-d522b193a235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:26.448011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d667339-76df-4b5c-8b81-d522b193a235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:26.450350 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d667339-76df-4b5c-8b81-d522b193a235 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:26.477128 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 243/498] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:26.477128 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d667339-76df-4b5c-8b81-d522b193a235 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:26.477538 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 256/499] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:26.477538 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02ba37-8b68-41d5-8248-aa563ecd98df None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:26.526448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:26.621132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:26.673078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d667339-76df-4b5c-8b81-d522b193a235 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:26.676591 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02ba37-8b68-41d5-8248-aa563ecd98df None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:26.720625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35329f9-1cb8-4eb2-81c3-bbbc8be0f80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:26.721666 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35329f9-1cb8-4eb2-81c3-bbbc8be0f80f None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:26.721953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35329f9-1cb8-4eb2-81c3-bbbc8be0f80f None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:26.722221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35329f9-1cb8-4eb2-81c3-bbbc8be0f80f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:26.735705 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35329f9-1cb8-4eb2-81c3-bbbc8be0f80f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:26.737386 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35329f9-1cb8-4eb2-81c3-bbbc8be0f80f None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:26.740337 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc549e37-ec5a-4a3a-bcd4-7a6021958f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:26.741392 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc549e37-ec5a-4a3a-bcd4-7a6021958f89 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:26.741853 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc549e37-ec5a-4a3a-bcd4-7a6021958f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:26.742286 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc549e37-ec5a-4a3a-bcd4-7a6021958f89 None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:26.743701 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc549e37-ec5a-4a3a-bcd4-7a6021958f89 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:26.744216 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc549e37-ec5a-4a3a-bcd4-7a6021958f89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:26.747252 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc549e37-ec5a-4a3a-bcd4-7a6021958f89 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:26.757948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-f35329f9-1cb8-4eb2-81c3-bbbc8be0f80f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:26.757948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:26.757948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:26.757948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:26.757948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:26.757948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:26.757948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:26.757948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:26.757948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:26.757948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:26.757948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:26.757948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:26.757948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:26.757948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:26.757948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:26.757948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:26.759943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:26.759943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:26.759943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:26.759943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:26.759943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:26.759943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:26.759943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:26.759943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:26.759943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:26.759943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:26.759943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:26.759943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:26.759943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:26.759943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:26.759943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:26.759943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:26.759943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:26.761569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:26.761569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:26.761569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:26.763048 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 257/500] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:26.765596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f0e0d-4797-416e-b914-3434e7f9ab82 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:26.766181 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f0e0d-4797-416e-b914-3434e7f9ab82 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:26.766817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f0e0d-4797-416e-b914-3434e7f9ab82 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:26.771016 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 258/501] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:26.772332 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f0e0d-4797-416e-b914-3434e7f9ab82 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:26.823062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 244/502] 10.222.0.83 () {56 vars in 1137 bytes} [Fri Sep 23 01:06:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:26.824542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc549e37-ec5a-4a3a-bcd4-7a6021958f89 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:26.875866 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:26.920972 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f0e0d-4797-416e-b914-3434e7f9ab82 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:26.966136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b7bb2-d0df-4bec-a87c-fac9c2aaa955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:26.966815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b7bb2-d0df-4bec-a87c-fac9c2aaa955 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:26.967105 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b7bb2-d0df-4bec-a87c-fac9c2aaa955 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:26.967388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b7bb2-d0df-4bec-a87c-fac9c2aaa955 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:26.976433 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b7bb2-d0df-4bec-a87c-fac9c2aaa955 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:26.981514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b7bb2-d0df-4bec-a87c-fac9c2aaa955 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:26.998953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-968b7bb2-d0df-4bec-a87c-fac9c2aaa955 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 01:06:26.998953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:26.998953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:26.998953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:26.998953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:26.998953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:26.998953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:26.998953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:26.998953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:26.998953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:26.998953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:26.998953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:26.998953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:06:26.998953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:06:26.998953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:06:26.998953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:06:27.000637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:27.000637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:27.000637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:06:27.000637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:27.000637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:06:27.000637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:27.000637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:27.000637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:27.000637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:27.000637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:27.000637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:27.000637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:27.000637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:27.000637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:27.000637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:27.000637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:27.000637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:27.000637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:27.010977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:27.010977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:27.010977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:06:27.010977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:06:27.010977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:06:27.010977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:06:27.010977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:06:27.010977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:06:27.010977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 01:06:27.010977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:27.010977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 259/503] 10.222.0.83 () {56 vars in 1093 bytes} [Fri Sep 23 01:06:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:27.011826 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc549e37-ec5a-4a3a-bcd4-7a6021958f89 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:27.011913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2addc-e02b-4ecf-9eff-22700f5f4473 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:27.011913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2addc-e02b-4ecf-9eff-22700f5f4473 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:27.011913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2addc-e02b-4ecf-9eff-22700f5f4473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:27.028054 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-2ed2addc-e02b-4ecf-9eff-22700f5f4473 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:27.029498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-2ed2addc-e02b-4ecf-9eff-22700f5f4473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:27.051838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:27.061998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87284c-c1c8-4410-87cb-8912f47190f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:27.067509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87284c-c1c8-4410-87cb-8912f47190f0 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:27.067509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87284c-c1c8-4410-87cb-8912f47190f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:27.067509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87284c-c1c8-4410-87cb-8912f47190f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:27.067509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87284c-c1c8-4410-87cb-8912f47190f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:27.067509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87284c-c1c8-4410-87cb-8912f47190f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:27.067509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87284c-c1c8-4410-87cb-8912f47190f0 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:27.080831 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 245/504] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:27.081686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87284c-c1c8-4410-87cb-8912f47190f0 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:27.149269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 260/505] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:27.150575 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2addc-e02b-4ecf-9eff-22700f5f4473 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:27.253022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87284c-c1c8-4410-87cb-8912f47190f0 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:27.262174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:27.311166 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875081c5-7a64-43bd-b755-81175f38e3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:27.311761 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875081c5-7a64-43bd-b755-81175f38e3ab None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:27.312123 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875081c5-7a64-43bd-b755-81175f38e3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:27.312418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875081c5-7a64-43bd-b755-81175f38e3ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:27.327526 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875081c5-7a64-43bd-b755-81175f38e3ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:27.329072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875081c5-7a64-43bd-b755-81175f38e3ab None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:27.329493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2addc-e02b-4ecf-9eff-22700f5f4473 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:27.347079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-875081c5-7a64-43bd-b755-81175f38e3ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:27.347079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:27.347079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:27.347079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:27.347079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:27.347079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:27.347079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:27.347079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:27.347079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:27.347079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:27.347079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:27.347079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:27.347079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:27.347079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:27.347079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:27.347079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:27.351317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:27.351317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:27.351317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:27.351317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:27.351317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:27.351317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:27.351317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:27.351317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:27.351317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:27.351317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:27.351317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:27.351317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:27.351317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:27.351317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:27.351317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:27.351317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:27.351317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:27.359630 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:27.359630 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:27.359630 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:27.359630 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 246/506] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:27.359630 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875081c5-7a64-43bd-b755-81175f38e3ab None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:27.413645 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67e972-baad-4f34-a9c1-a9e42e142add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:27.414375 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67e972-baad-4f34-a9c1-a9e42e142add None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:27.414721 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67e972-baad-4f34-a9c1-a9e42e142add None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:27.415118 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67e972-baad-4f34-a9c1-a9e42e142add None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:27.418704 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:27.516986 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67e972-baad-4f34-a9c1-a9e42e142add None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:27.519821 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67e972-baad-4f34-a9c1-a9e42e142add None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:27.532286 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875081c5-7a64-43bd-b755-81175f38e3ab None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:27.582424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a740e-10de-4165-adac-fc9da0c54788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:27.583091 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a740e-10de-4165-adac-fc9da0c54788 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:27.583430 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a740e-10de-4165-adac-fc9da0c54788 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:27.583708 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a740e-10de-4165-adac-fc9da0c54788 None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:27.584585 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a740e-10de-4165-adac-fc9da0c54788 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:27.584892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a740e-10de-4165-adac-fc9da0c54788 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:27.586377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a740e-10de-4165-adac-fc9da0c54788 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:27.605991 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:27.609522 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 247/507] 10.222.0.83 () {56 vars in 1133 bytes} [Fri Sep 23 01:06:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:27.610682 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a740e-10de-4165-adac-fc9da0c54788 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:27.684261 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 261/508] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:06:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:06:27.686179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67e972-baad-4f34-a9c1-a9e42e142add None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:27.769312 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:27.775992 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a740e-10de-4165-adac-fc9da0c54788 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:27.838521 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87372b-bd58-44fa-bdc4-1e7511a54839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:27.839532 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87372b-bd58-44fa-bdc4-1e7511a54839 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:27.839803 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87372b-bd58-44fa-bdc4-1e7511a54839 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:27.840069 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87372b-bd58-44fa-bdc4-1e7511a54839 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:27.853765 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87372b-bd58-44fa-bdc4-1e7511a54839 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:27.855686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87372b-bd58-44fa-bdc4-1e7511a54839 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:27.865432 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67e972-baad-4f34-a9c1-a9e42e142add None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:27.870418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-7b87372b-bd58-44fa-bdc4-1e7511a54839 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 01:06:27.870418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:27.870418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:27.870418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:27.870418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:27.870418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:27.870418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:27.870418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:27.870418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:27.870418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:27.870418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:27.870418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:27.870418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:06:27.870418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:06:27.870418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:06:27.870418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:06:27.871755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:27.871755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:27.871755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:06:27.871755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:27.871755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:06:27.871755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:27.871755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:27.871755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:27.871755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:27.871755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:27.871755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:27.871755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:27.871755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:27.871755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:27.871755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:27.871755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:27.871755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:27.871755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:27.873161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:27.873161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:27.873161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:06:27.873161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:06:27.873161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:06:27.873161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:06:27.873161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:06:27.873161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:06:27.873161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 01:06:27.873161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:27.873161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 248/509] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:06:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:27.873161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87372b-bd58-44fa-bdc4-1e7511a54839 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:27.916879 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7337d-021f-48a1-b029-f9f9b3864bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:27.917573 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7337d-021f-48a1-b029-f9f9b3864bee None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:27.917855 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7337d-021f-48a1-b029-f9f9b3864bee None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:27.918222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7337d-021f-48a1-b029-f9f9b3864bee None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:27.919040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7337d-021f-48a1-b029-f9f9b3864bee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:27.919342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7337d-021f-48a1-b029-f9f9b3864bee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:27.920749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7337d-021f-48a1-b029-f9f9b3864bee None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:27.934747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 262/510] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:27.936095 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7337d-021f-48a1-b029-f9f9b3864bee None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:27.977331 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:28.014547 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87372b-bd58-44fa-bdc4-1e7511a54839 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:28.074353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f77fd5-650c-4ef5-97a9-bf1819302aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:28.075099 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f77fd5-650c-4ef5-97a9-bf1819302aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:28.075384 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f77fd5-650c-4ef5-97a9-bf1819302aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:28.075658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f77fd5-650c-4ef5-97a9-bf1819302aa3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:28.078971 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7337d-021f-48a1-b029-f9f9b3864bee None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:28.087667 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f77fd5-650c-4ef5-97a9-bf1819302aa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:28.093381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-31f77fd5-650c-4ef5-97a9-bf1819302aa3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:28.093381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:28.093381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:28.093381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:28.093381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:28.093381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:28.093381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:28.093381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:28.093381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:28.093381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:28.093381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:28.093381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:28.093381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:28.093381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:28.093381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:28.093381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:28.095231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:28.095231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:28.095231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:28.095231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:28.095231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:28.095231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:28.095231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:28.095231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:28.095231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:28.095231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:28.095231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:28.095231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:28.095231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:28.095231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:28.095231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:28.095231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:28.096806 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:28.096806 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:28.096806 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:28.096806 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:28.096806 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:28.096806 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:28.096806 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:28.096806 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:28.096806 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:28.096806 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:28.096806 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:28.096806 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:28.096806 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 249/511] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:06:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:28.096806 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f77fd5-650c-4ef5-97a9-bf1819302aa3 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:28.122272 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:28.136505 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdde51-a0b2-4156-b6a5-ebcc11adcaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:28.137566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdde51-a0b2-4156-b6a5-ebcc11adcaf4 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:28.138053 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdde51-a0b2-4156-b6a5-ebcc11adcaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:28.138540 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdde51-a0b2-4156-b6a5-ebcc11adcaf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:28.240396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f77fd5-650c-4ef5-97a9-bf1819302aa3 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:28.259921 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdde51-a0b2-4156-b6a5-ebcc11adcaf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:28.262775 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdde51-a0b2-4156-b6a5-ebcc11adcaf4 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:28.281512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f959664-ba55-42d7-9f0b-3ea8e1a5ff55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:28.282176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f959664-ba55-42d7-9f0b-3ea8e1a5ff55 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:28.282453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f959664-ba55-42d7-9f0b-3ea8e1a5ff55 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:28.282763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f959664-ba55-42d7-9f0b-3ea8e1a5ff55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:28.299469 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f959664-ba55-42d7-9f0b-3ea8e1a5ff55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:28.301952 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f959664-ba55-42d7-9f0b-3ea8e1a5ff55 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:28.310612 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:28.319505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-4f959664-ba55-42d7-9f0b-3ea8e1a5ff55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:28.319505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:28.319505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:28.319505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:28.319505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:28.319505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:28.319505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:28.319505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:28.319505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:28.319505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:28.319505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:28.319505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:28.319505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:28.319505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:28.319505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:28.319505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:28.322808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:28.322808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:28.322808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:28.322808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:28.322808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:28.322808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:28.322808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:28.322808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:28.322808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:28.322808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:28.322808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:28.322808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:28.322808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:28.322808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:28.322808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:28.322808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:28.322808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:28.324508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:28.324508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:28.324508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:28.324508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 250/512] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:28.324508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f959664-ba55-42d7-9f0b-3ea8e1a5ff55 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:28.429176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:28.431753 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 263/513] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:06:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:06:28.432651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdde51-a0b2-4156-b6a5-ebcc11adcaf4 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:28.477742 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f959664-ba55-42d7-9f0b-3ea8e1a5ff55 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:28.522912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d1c62-0c65-4f12-96fc-22f0b949a35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:28.523648 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d1c62-0c65-4f12-96fc-22f0b949a35e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:28.523927 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d1c62-0c65-4f12-96fc-22f0b949a35e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:28.524201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d1c62-0c65-4f12-96fc-22f0b949a35e None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:28.524954 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d1c62-0c65-4f12-96fc-22f0b949a35e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:28.525257 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d1c62-0c65-4f12-96fc-22f0b949a35e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:28.526793 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d1c62-0c65-4f12-96fc-22f0b949a35e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:28.551754 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 251/514] 10.222.0.83 () {56 vars in 1137 bytes} [Fri Sep 23 01:06:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:28.553199 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d1c62-0c65-4f12-96fc-22f0b949a35e None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:28.588579 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdde51-a0b2-4156-b6a5-ebcc11adcaf4 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:28.623583 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:28.638518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5e5df-7ca6-4bda-9912-217db184bf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:28.640804 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5e5df-7ca6-4bda-9912-217db184bf60 None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:28.640804 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5e5df-7ca6-4bda-9912-217db184bf60 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:28.640804 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5e5df-7ca6-4bda-9912-217db184bf60 None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:28.641213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5e5df-7ca6-4bda-9912-217db184bf60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:28.643013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5e5df-7ca6-4bda-9912-217db184bf60 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:28.694461 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d1c62-0c65-4f12-96fc-22f0b949a35e None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:28.726832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:28.737855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acaeb26-23a5-4779-ba7e-196c24025dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:28.739094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaeb26-23a5-4779-ba7e-196c24025dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:28.739375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaeb26-23a5-4779-ba7e-196c24025dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:28.739703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaeb26-23a5-4779-ba7e-196c24025dd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:28.740404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acaeb26-23a5-4779-ba7e-196c24025dd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:28.740705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acaeb26-23a5-4779-ba7e-196c24025dd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:28.742320 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acaeb26-23a5-4779-ba7e-196c24025dd9 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:28.752742 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 252/515] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:06:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:28.753702 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acaeb26-23a5-4779-ba7e-196c24025dd9 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:28.760487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 264/516] 10.222.0.83 () {60 vars in 1132 bytes} [Fri Sep 23 01:06:28 2022] POST /identity/v3/users => generated 247 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:06:28.762120 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5e5df-7ca6-4bda-9912-217db184bf60 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:28.937241 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5e5df-7ca6-4bda-9912-217db184bf60 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:28.939076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acaeb26-23a5-4779-ba7e-196c24025dd9 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:28.996924 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486bffd-c006-4cc9-9dcc-8f9a0dac354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:28.997320 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf3d1c-02ca-4f0d-b0b7-bb58924000b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:28.997895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486bffd-c006-4cc9-9dcc-8f9a0dac354c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:28.998272 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf3d1c-02ca-4f0d-b0b7-bb58924000b8 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:28.998458 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486bffd-c006-4cc9-9dcc-8f9a0dac354c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:28.998759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf3d1c-02ca-4f0d-b0b7-bb58924000b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:28.998909 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486bffd-c006-4cc9-9dcc-8f9a0dac354c None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:28.999202 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf3d1c-02ca-4f0d-b0b7-bb58924000b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:28.999856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486bffd-c006-4cc9-9dcc-8f9a0dac354c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:29.000349 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486bffd-c006-4cc9-9dcc-8f9a0dac354c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:29.002734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486bffd-c006-4cc9-9dcc-8f9a0dac354c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:29.023625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 253/517] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:29.024294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf3d1c-02ca-4f0d-b0b7-bb58924000b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:29.025190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486bffd-c006-4cc9-9dcc-8f9a0dac354c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:29.027079 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf3d1c-02ca-4f0d-b0b7-bb58924000b8 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:29.051404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-dfbf3d1c-02ca-4f0d-b0b7-bb58924000b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:29.051404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:29.051404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:29.051404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:29.051404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:29.051404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:29.051404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:29.051404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:29.051404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:29.051404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:29.051404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:29.051404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:29.051404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:29.051404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:29.051404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:29.051404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:29.052472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:29.052472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:29.052472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:29.052472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:29.052472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:29.052472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:29.052472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:29.052472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:29.052472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:29.052472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:29.052472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:29.052472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:29.052472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:29.052472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:29.052472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:29.052472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:29.052472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:29.053506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:29.053506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:29.053506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:29.055621 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 265/518] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:29.056779 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf3d1c-02ca-4f0d-b0b7-bb58924000b8 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:29.108030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:29.116700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:29.189676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486bffd-c006-4cc9-9dcc-8f9a0dac354c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:29.249059 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a5fb3-9f7a-4cef-a191-4adc819665e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:29.249721 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf3d1c-02ca-4f0d-b0b7-bb58924000b8 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:29.249912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a5fb3-9f7a-4cef-a191-4adc819665e5 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:29.250176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a5fb3-9f7a-4cef-a191-4adc819665e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:29.250435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a5fb3-9f7a-4cef-a191-4adc819665e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:29.305677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25eb05-0f80-4a3d-a237-154463b12bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:29.306482 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25eb05-0f80-4a3d-a237-154463b12bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:29.306876 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25eb05-0f80-4a3d-a237-154463b12bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:29.307150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25eb05-0f80-4a3d-a237-154463b12bc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:29.320718 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25eb05-0f80-4a3d-a237-154463b12bc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:29.323644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25eb05-0f80-4a3d-a237-154463b12bc9 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:29.347005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-9b25eb05-0f80-4a3d-a237-154463b12bc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:29.347005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:29.347005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:29.347005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:29.347005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:29.347005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:29.347005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:29.347005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:29.347005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:29.347005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:29.347005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:29.347005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:29.347005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:29.347005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:29.347005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:29.347005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:29.348968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:29.348968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:29.348968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:29.348968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:29.348968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:29.348968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:29.348968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:29.348968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:29.348968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:29.348968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:29.348968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:29.348968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:29.348968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:29.348968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:29.348968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:29.348968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:29.348968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:29.350654 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:29.350654 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:29.350654 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:29.354839 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 266/519] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:29.356502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25eb05-0f80-4a3d-a237-154463b12bc9 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:29.373052 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a5fb3-9f7a-4cef-a191-4adc819665e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:29.376125 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a5fb3-9f7a-4cef-a191-4adc819665e5 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:29.470292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:29.474660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:29.497668 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25eb05-0f80-4a3d-a237-154463b12bc9 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:29.551935 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c6ed6-43be-4523-95c5-7919253c89cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:29.552804 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c6ed6-43be-4523-95c5-7919253c89cd None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:29.553268 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c6ed6-43be-4523-95c5-7919253c89cd None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:29.553696 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c6ed6-43be-4523-95c5-7919253c89cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:29.558800 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 254/520] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:06:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:06:29.560844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a5fb3-9f7a-4cef-a191-4adc819665e5 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:29.564841 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4c6ed6-43be-4523-95c5-7919253c89cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:29.568112 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4c6ed6-43be-4523-95c5-7919253c89cd None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:29.586528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-dd4c6ed6-43be-4523-95c5-7919253c89cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:29.586528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:29.586528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:29.586528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:29.586528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:29.586528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:29.586528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:29.586528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:29.586528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:29.586528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:29.586528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:29.586528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:29.586528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:06:29.586528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:06:29.586528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:06:29.587825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:06:29.587825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:29.587825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:29.587825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:29.587825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:29.587825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:29.587825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:29.587825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:29.587825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:29.587825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:29.587825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:29.587825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:29.587825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:29.587825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:29.587825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:29.587825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:29.587825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:29.590940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:06:29.590940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:06:29.590940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:06:29.590940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:06:29.590940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:06:29.590940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:06:29.590940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:29.590940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:29.590940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 267/521] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:29.590940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c6ed6-43be-4523-95c5-7919253c89cd None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:29.722009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a5fb3-9f7a-4cef-a191-4adc819665e5 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:29.729586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c6ed6-43be-4523-95c5-7919253c89cd None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:29.770766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b6255-7daf-4ed6-9b2c-7f9c24b905f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:29.772010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b6255-7daf-4ed6-9b2c-7f9c24b905f8 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:29.772241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b6255-7daf-4ed6-9b2c-7f9c24b905f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:29.772521 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b6255-7daf-4ed6-9b2c-7f9c24b905f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:29.773261 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b6255-7daf-4ed6-9b2c-7f9c24b905f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:29.773574 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b6255-7daf-4ed6-9b2c-7f9c24b905f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:29.775241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b6255-7daf-4ed6-9b2c-7f9c24b905f8 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:29.783964 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a13c7-7fde-4a1e-bda8-3079bbe4c743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:29.784784 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a13c7-7fde-4a1e-bda8-3079bbe4c743 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:29.785221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a13c7-7fde-4a1e-bda8-3079bbe4c743 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:29.785633 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a13c7-7fde-4a1e-bda8-3079bbe4c743 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:29.786491 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a13c7-7fde-4a1e-bda8-3079bbe4c743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:29.786965 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a13c7-7fde-4a1e-bda8-3079bbe4c743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:29.794501 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 255/522] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:29.794765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a13c7-7fde-4a1e-bda8-3079bbe4c743 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:29.794902 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b6255-7daf-4ed6-9b2c-7f9c24b905f8 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:29.805876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:29.813615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 268/523] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:29.813615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a13c7-7fde-4a1e-bda8-3079bbe4c743 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:29.817267 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:29.943909 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b6255-7daf-4ed6-9b2c-7f9c24b905f8 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:29.990025 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a13c7-7fde-4a1e-bda8-3079bbe4c743 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:30.000090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecbc58-76a2-4916-8588-8b3acecfe647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:30.001892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecbc58-76a2-4916-8588-8b3acecfe647 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:30.002413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecbc58-76a2-4916-8588-8b3acecfe647 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:30.003445 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecbc58-76a2-4916-8588-8b3acecfe647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:30.020346 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecbc58-76a2-4916-8588-8b3acecfe647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:30.022209 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecbc58-76a2-4916-8588-8b3acecfe647 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:30.040579 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603f4e7-e734-41b3-9164-831b88feb0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:30.041204 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603f4e7-e734-41b3-9164-831b88feb0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:30.041451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-e0ecbc58-76a2-4916-8588-8b3acecfe647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:30.041451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:30.041451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:30.041451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:30.041451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:30.041451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:30.041451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:30.041451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:30.041451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:30.041451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:30.041451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:30.041451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:30.041451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:30.041451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:30.041451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:30.041451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:30.043174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:30.043174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:30.043174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:30.043174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:30.043174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:30.043174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:30.043174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:30.043174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:30.043174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:30.043174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:30.043174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:30.043174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:30.043174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:30.043174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:30.043174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:30.043174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:30.043174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:30.044791 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:30.044791 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:30.044791 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:30.045832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603f4e7-e734-41b3-9164-831b88feb0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:30.045832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603f4e7-e734-41b3-9164-831b88feb0c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:30.045832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603f4e7-e734-41b3-9164-831b88feb0c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:30.045832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603f4e7-e734-41b3-9164-831b88feb0c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:30.045832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603f4e7-e734-41b3-9164-831b88feb0c7 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:30.050696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 256/524] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:30.051869 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecbc58-76a2-4916-8588-8b3acecfe647 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:30.083636 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 269/525] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:06:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:30.083636 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603f4e7-e734-41b3-9164-831b88feb0c7 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:30.164951 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:30.203811 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:30.238797 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecbc58-76a2-4916-8588-8b3acecfe647 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:30.274424 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603f4e7-e734-41b3-9164-831b88feb0c7 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:30.295996 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b49571-731d-470d-a23e-37e46fdd49f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:30.297000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b49571-731d-470d-a23e-37e46fdd49f0 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:30.297427 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b49571-731d-470d-a23e-37e46fdd49f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:30.297876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b49571-731d-470d-a23e-37e46fdd49f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:30.306762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b49571-731d-470d-a23e-37e46fdd49f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:30.309000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b49571-731d-470d-a23e-37e46fdd49f0 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:30.325088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-63b49571-731d-470d-a23e-37e46fdd49f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:30.325088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:30.325088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:30.325088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:30.325088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:30.325088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:30.325088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:30.325088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:30.325088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:30.325088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:30.325088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:30.325088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:30.325088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:06:30.325088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:06:30.325088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:06:30.326815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:06:30.326815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:30.326815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:30.326815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:30.326815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:30.326815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:30.326815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:30.326815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:30.326815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:30.326815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:30.326815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:30.326815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:30.326815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:30.326815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:30.326815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:30.326815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:30.326815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:30.328512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:06:30.328512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:06:30.328512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:06:30.328512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:06:30.328512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:06:30.328512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:06:30.328512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:30.328512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:30.328512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 257/526] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:30.331178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b49571-731d-470d-a23e-37e46fdd49f0 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:30.339207 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef035e7-0c28-446e-90a5-e1ef5fa9af3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:30.339868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef035e7-0c28-446e-90a5-e1ef5fa9af3d None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:30.340125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef035e7-0c28-446e-90a5-e1ef5fa9af3d None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:30.340398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef035e7-0c28-446e-90a5-e1ef5fa9af3d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:30.350641 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef035e7-0c28-446e-90a5-e1ef5fa9af3d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:30.352368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef035e7-0c28-446e-90a5-e1ef5fa9af3d None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:30.365929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-3ef035e7-0c28-446e-90a5-e1ef5fa9af3d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 01:06:30.365929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:30.365929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:30.365929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:30.365929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:30.365929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:30.365929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:30.365929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:30.365929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:30.365929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:30.365929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:30.365929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:30.365929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:06:30.365929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:06:30.365929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:06:30.365929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:06:30.367555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:30.367555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:30.367555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:06:30.367555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:30.367555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:06:30.367555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:30.367555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:30.367555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:30.367555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:30.367555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:30.367555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:30.367555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:30.367555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:30.367555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:30.367555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:30.367555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:30.367555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:30.367555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:30.368449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:30.368449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:30.368449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:06:30.368449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:06:30.368449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:06:30.368449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:06:30.368449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:06:30.368449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:06:30.368449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 01:06:30.368449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:30.372072 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 270/527] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:06:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:30.373082 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef035e7-0c28-446e-90a5-e1ef5fa9af3d None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:30.475358 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b49571-731d-470d-a23e-37e46fdd49f0 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:30.515548 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:30.533858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b66aef-552a-49ee-996f-d0c8582c2e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:30.534559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b66aef-552a-49ee-996f-d0c8582c2e3a None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:30.534940 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b66aef-552a-49ee-996f-d0c8582c2e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:30.535325 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b66aef-552a-49ee-996f-d0c8582c2e3a None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:30.536051 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b66aef-552a-49ee-996f-d0c8582c2e3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:30.536616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b66aef-552a-49ee-996f-d0c8582c2e3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:30.538061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b66aef-552a-49ee-996f-d0c8582c2e3a None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:30.538750 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef035e7-0c28-446e-90a5-e1ef5fa9af3d None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:30.557112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 258/528] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:30.557112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b66aef-552a-49ee-996f-d0c8582c2e3a None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:30.588159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:30.620449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33fab9-ae4d-434a-9d9a-c7b652f17d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:30.621566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33fab9-ae4d-434a-9d9a-c7b652f17d9b None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:30.626203 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33fab9-ae4d-434a-9d9a-c7b652f17d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:30.626985 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33fab9-ae4d-434a-9d9a-c7b652f17d9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:30.628266 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33fab9-ae4d-434a-9d9a-c7b652f17d9b None admin] RBAC: Adding query filter params (role.id=2e8d92bd39634bbdad03d67d3fc439f0, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=f5b3a7a9a08e40718980143d7c4880ff) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:30.628904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33fab9-ae4d-434a-9d9a-c7b652f17d9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:30.631791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33fab9-ae4d-434a-9d9a-c7b652f17d9b None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:30.650635 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 271/529] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:06:30 2022] GET /identity/v3/role_assignments?user.id=f5b3a7a9a08e40718980143d7c4880ff&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=2e8d92bd39634bbdad03d67d3fc439f0 => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:30.650635 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33fab9-ae4d-434a-9d9a-c7b652f17d9b None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:30.756338 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b66aef-552a-49ee-996f-d0c8582c2e3a None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:30.839669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee0fb3-e377-4f1f-99f4-b51f4b527ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:30.840651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee0fb3-e377-4f1f-99f4-b51f4b527ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:30.841150 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee0fb3-e377-4f1f-99f4-b51f4b527ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:30.841825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee0fb3-e377-4f1f-99f4-b51f4b527ad5 None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:30.843207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee0fb3-e377-4f1f-99f4-b51f4b527ad5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:30.843762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee0fb3-e377-4f1f-99f4-b51f4b527ad5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:30.846783 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee0fb3-e377-4f1f-99f4-b51f4b527ad5 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:30.876420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33fab9-ae4d-434a-9d9a-c7b652f17d9b None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:30.884676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 259/530] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:06:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:30.886330 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee0fb3-e377-4f1f-99f4-b51f4b527ad5 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:30.954314 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4650e-96d4-4d8c-bcf0-a9c8ab5fe192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:30.955568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4650e-96d4-4d8c-bcf0-a9c8ab5fe192 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:30.956174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4650e-96d4-4d8c-bcf0-a9c8ab5fe192 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:30.956759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4650e-96d4-4d8c-bcf0-a9c8ab5fe192 None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:30.959243 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4650e-96d4-4d8c-bcf0-a9c8ab5fe192 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:30.961344 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4650e-96d4-4d8c-bcf0-a9c8ab5fe192 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:30.964238 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4650e-96d4-4d8c-bcf0-a9c8ab5fe192 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:30.976775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:31.060677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 272/531] 10.222.0.83 () {56 vars in 1139 bytes} [Fri Sep 23 01:06:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:31.062373 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4650e-96d4-4d8c-bcf0-a9c8ab5fe192 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:31.100867 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee0fb3-e377-4f1f-99f4-b51f4b527ad5 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:31.156036 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:31.167079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c9d61-50ad-42e9-a38e-78f1dc02c172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:31.168507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c9d61-50ad-42e9-a38e-78f1dc02c172 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:31.169205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c9d61-50ad-42e9-a38e-78f1dc02c172 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:31.169896 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c9d61-50ad-42e9-a38e-78f1dc02c172 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:31.185225 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c9d61-50ad-42e9-a38e-78f1dc02c172 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:31.188325 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c9d61-50ad-42e9-a38e-78f1dc02c172 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:31.212448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-1f0c9d61-50ad-42e9-a38e-78f1dc02c172 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:31.212448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:31.212448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:31.212448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:31.212448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:31.212448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:31.212448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:31.212448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:31.212448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:31.212448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:31.212448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:31.212448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:31.212448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:06:31.212448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:06:31.212448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:06:31.214214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:06:31.214214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:31.214214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:31.214214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:31.214214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:31.214214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:31.214214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:31.214214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:31.214214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:31.214214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:31.214214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:31.214214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:31.214214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:31.214214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:31.214214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:31.214214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:31.214214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:31.216105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:06:31.216105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:06:31.216105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:06:31.216105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:06:31.216105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:06:31.216105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:06:31.216105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:31.216105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:31.219434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 260/532] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:31.221279 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c9d61-50ad-42e9-a38e-78f1dc02c172 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:31.276291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4650e-96d4-4d8c-bcf0-a9c8ab5fe192 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:31.348264 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7233c2-5f8a-4037-8023-a0a46d7ae0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:31.349441 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7233c2-5f8a-4037-8023-a0a46d7ae0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:31.350226 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7233c2-5f8a-4037-8023-a0a46d7ae0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:31.350832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7233c2-5f8a-4037-8023-a0a46d7ae0c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:31.352995 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7233c2-5f8a-4037-8023-a0a46d7ae0c1 None admin] RBAC: Adding query filter params (role.id=2e8d92bd39634bbdad03d67d3fc439f0, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=824648d693af4b44ae5df853a3d258f5) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:31.353677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7233c2-5f8a-4037-8023-a0a46d7ae0c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:31.356472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7233c2-5f8a-4037-8023-a0a46d7ae0c1 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:31.367167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 273/533] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:06:31 2022] GET /identity/v3/role_assignments?user.id=824648d693af4b44ae5df853a3d258f5&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=2e8d92bd39634bbdad03d67d3fc439f0 => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:31.368869 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7233c2-5f8a-4037-8023-a0a46d7ae0c1 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:31.473842 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c9d61-50ad-42e9-a38e-78f1dc02c172 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:31.479048 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:31.566084 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be625ad0-083e-4e18-a60a-474901416048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:31.567156 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be625ad0-083e-4e18-a60a-474901416048 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:31.567622 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be625ad0-083e-4e18-a60a-474901416048 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:31.568078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be625ad0-083e-4e18-a60a-474901416048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:31.671059 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7233c2-5f8a-4037-8023-a0a46d7ae0c1 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:31.690382 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:31.738020 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285025b-3dbd-4979-aef1-867dc9d135a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:31.739653 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285025b-3dbd-4979-aef1-867dc9d135a0 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:31.740397 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285025b-3dbd-4979-aef1-867dc9d135a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:31.741112 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285025b-3dbd-4979-aef1-867dc9d135a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:31.742899 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285025b-3dbd-4979-aef1-867dc9d135a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:31.743973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285025b-3dbd-4979-aef1-867dc9d135a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:31.746990 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285025b-3dbd-4979-aef1-867dc9d135a0 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:31.783138 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 274/534] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:06:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:31.789558 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be625ad0-083e-4e18-a60a-474901416048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:31.792344 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be625ad0-083e-4e18-a60a-474901416048 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:31.794369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285025b-3dbd-4979-aef1-867dc9d135a0 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:31.971053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:31.982622 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 261/535] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:06:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 758 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:06:31.991812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be625ad0-083e-4e18-a60a-474901416048 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:32.030163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285025b-3dbd-4979-aef1-867dc9d135a0 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:32.103567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8256ab0-a7b1-4315-9e12-23985ace7dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:32.107002 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8256ab0-a7b1-4315-9e12-23985ace7dcd None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:32.107905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8256ab0-a7b1-4315-9e12-23985ace7dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:32.109005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8256ab0-a7b1-4315-9e12-23985ace7dcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:32.110891 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8256ab0-a7b1-4315-9e12-23985ace7dcd None admin] RBAC: Adding query filter params (role.id=2e8d92bd39634bbdad03d67d3fc439f0, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=9f71db705b08460996a729a88c82bb63) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:32.112061 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8256ab0-a7b1-4315-9e12-23985ace7dcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:32.115701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8256ab0-a7b1-4315-9e12-23985ace7dcd None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:32.128084 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 275/536] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:06:31 2022] GET /identity/v3/role_assignments?user.id=9f71db705b08460996a729a88c82bb63&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=2e8d92bd39634bbdad03d67d3fc439f0 => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:32.277810 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127541f4-b23d-4dee-ac77-39b18a020ed3 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:32.278283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127541f4-b23d-4dee-ac77-39b18a020ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:32.278793 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127541f4-b23d-4dee-ac77-39b18a020ed3 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:32.281824 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 276/537] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:06:32.291028 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200f6a4-9166-4567-a71b-3f92bceabd7c None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:32.291504 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200f6a4-9166-4567-a71b-3f92bceabd7c None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:32.291907 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200f6a4-9166-4567-a71b-3f92bceabd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:32.341592 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-1200f6a4-9166-4567-a71b-3f92bceabd7c None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:32.345548 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-1200f6a4-9166-4567-a71b-3f92bceabd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:32.352966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be625ad0-083e-4e18-a60a-474901416048 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:32.459138 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:32.473318 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19892b-aa89-42e4-b671-1ae481cedff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:32.474367 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19892b-aa89-42e4-b671-1ae481cedff3 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:32.474878 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19892b-aa89-42e4-b671-1ae481cedff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:32.475350 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19892b-aa89-42e4-b671-1ae481cedff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:32.513575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19892b-aa89-42e4-b671-1ae481cedff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:32.516502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19892b-aa89-42e4-b671-1ae481cedff3 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:32.570506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-7b19892b-aa89-42e4-b671-1ae481cedff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:32.570506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:32.570506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:32.570506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:32.570506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:32.570506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:32.570506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:32.570506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:32.570506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:32.570506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:32.570506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:32.570506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:32.570506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:32.570506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:32.570506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:32.570506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:32.572536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:32.572536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:32.572536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:32.572536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:32.572536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:32.572536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:32.572536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:32.572536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:32.572536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:32.572536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:32.572536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:32.572536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:32.572536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:32.572536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:32.572536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:32.572536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:32.572536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:32.574222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:32.574222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:32.574222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:32.574222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 262/538] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 582 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:32.583461 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19892b-aa89-42e4-b671-1ae481cedff3 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:32.609024 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 277/539] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:06:32.704352 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:32.776951 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19892b-aa89-42e4-b671-1ae481cedff3 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:32.831492 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3800f-2cef-45e8-986b-04f6bf9f7bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:32.832102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3800f-2cef-45e8-986b-04f6bf9f7bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:32.832427 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3800f-2cef-45e8-986b-04f6bf9f7bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:32.832697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3800f-2cef-45e8-986b-04f6bf9f7bf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:32.833368 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3800f-2cef-45e8-986b-04f6bf9f7bf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:32.833670 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3800f-2cef-45e8-986b-04f6bf9f7bf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:32.835117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3800f-2cef-45e8-986b-04f6bf9f7bf6 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:32.860612 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 263/540] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:06:32.866784 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200f6a4-9166-4567-a71b-3f92bceabd7c None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:33.080613 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200f6a4-9166-4567-a71b-3f92bceabd7c None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:33.117703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3800f-2cef-45e8-986b-04f6bf9f7bf6 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:33.141206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a214d-790b-4b59-a6e8-88d6e44de433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:33.143171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a214d-790b-4b59-a6e8-88d6e44de433 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:33.144034 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a214d-790b-4b59-a6e8-88d6e44de433 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:33.145346 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a214d-790b-4b59-a6e8-88d6e44de433 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:33.161253 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a214d-790b-4b59-a6e8-88d6e44de433 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:33.165615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a214d-790b-4b59-a6e8-88d6e44de433 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:33.205530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-181a214d-790b-4b59-a6e8-88d6e44de433 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:33.205530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:33.205530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:33.205530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:33.205530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:33.205530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:33.205530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:33.205530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:33.205530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:33.205530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:33.205530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:33.205530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:33.205530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:06:33.205530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:06:33.205530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:06:33.207735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:06:33.207735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:33.207735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:33.207735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:33.207735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:33.207735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:33.207735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:33.207735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:33.207735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:33.207735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:33.207735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:33.207735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:33.207735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:33.207735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:33.207735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:33.207735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:33.207735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:33.209248 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:06:33.209248 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:06:33.209248 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:06:33.209248 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:06:33.209248 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:06:33.209248 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:06:33.209248 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:33.209248 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:33.214498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 278/541] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:33.220528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a214d-790b-4b59-a6e8-88d6e44de433 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:33.287002 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:33.384461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a214d-790b-4b59-a6e8-88d6e44de433 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:33.435437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11f05a-b242-4c75-b09a-4b442984f407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:33.436493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11f05a-b242-4c75-b09a-4b442984f407 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:33.436955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11f05a-b242-4c75-b09a-4b442984f407 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:33.437282 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11f05a-b242-4c75-b09a-4b442984f407 None admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:33.438578 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11f05a-b242-4c75-b09a-4b442984f407 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:33.439156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11f05a-b242-4c75-b09a-4b442984f407 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:33.441802 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11f05a-b242-4c75-b09a-4b442984f407 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:33.453233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3800f-2cef-45e8-986b-04f6bf9f7bf6 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:33.489927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 279/542] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:06:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:33.499109 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:33.504407 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11f05a-b242-4c75-b09a-4b442984f407 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:33.524542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa1a8b-fad8-4a21-8b8c-f2cbf4b3e08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:33.525192 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa1a8b-fad8-4a21-8b8c-f2cbf4b3e08f None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:33.525477 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa1a8b-fad8-4a21-8b8c-f2cbf4b3e08f None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:33.525749 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa1a8b-fad8-4a21-8b8c-f2cbf4b3e08f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:33.539974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa1a8b-fad8-4a21-8b8c-f2cbf4b3e08f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:33.546663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-61fa1a8b-fad8-4a21-8b8c-f2cbf4b3e08f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:33.546663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:33.546663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:33.546663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:33.546663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:33.546663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:33.546663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:33.546663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:33.546663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:33.546663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:33.546663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:33.546663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:33.546663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:33.546663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:33.546663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:33.546663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:33.548766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:33.548766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:33.548766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:33.548766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:33.548766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:33.548766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:33.548766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:33.548766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:33.548766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:33.548766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:33.548766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:33.548766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:33.548766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:33.548766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:33.548766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:33.548766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:33.551438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:33.551438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:33.551438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:33.551438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:33.551438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:33.551438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:33.551438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:33.551438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:33.551438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:33.551438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:33.551438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:33.551438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:33.551438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 264/543] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:06:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:33.557636 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa1a8b-fad8-4a21-8b8c-f2cbf4b3e08f None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:33.730333 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11f05a-b242-4c75-b09a-4b442984f407 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:33.739217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:33.768981 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0edc21-3656-4635-84c0-8adcb6d01827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:33.770211 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0edc21-3656-4635-84c0-8adcb6d01827 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:33.770516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0edc21-3656-4635-84c0-8adcb6d01827 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:33.770839 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0edc21-3656-4635-84c0-8adcb6d01827 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:33.771592 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0edc21-3656-4635-84c0-8adcb6d01827 None admin] RBAC: Adding query filter params (role.id=2e8d92bd39634bbdad03d67d3fc439f0, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=be2b2806686c4a15b1ace8b6245c4e28) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:33.771898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0edc21-3656-4635-84c0-8adcb6d01827 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:33.773430 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0edc21-3656-4635-84c0-8adcb6d01827 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:33.780259 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 280/544] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:06:33 2022] GET /identity/v3/role_assignments?user.id=be2b2806686c4a15b1ace8b6245c4e28&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=2e8d92bd39634bbdad03d67d3fc439f0 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:33.859983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa1a8b-fad8-4a21-8b8c-f2cbf4b3e08f None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:33.929274 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eddec0-d630-42ba-80c1-9ea1b4f4ba30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:33.930295 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eddec0-d630-42ba-80c1-9ea1b4f4ba30 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:33.930913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eddec0-d630-42ba-80c1-9ea1b4f4ba30 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:33.931391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eddec0-d630-42ba-80c1-9ea1b4f4ba30 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:33.932449 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eddec0-d630-42ba-80c1-9ea1b4f4ba30 None admin] RBAC: Adding query filter params (name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:33.932918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eddec0-d630-42ba-80c1-9ea1b4f4ba30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:33.935284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eddec0-d630-42ba-80c1-9ea1b4f4ba30 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:33.952771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 265/545] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:06:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:06:33.963874 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0edc21-3656-4635-84c0-8adcb6d01827 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:34.266052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0edc21-3656-4635-84c0-8adcb6d01827 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:34.320425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6405b89-fbe1-47f4-889b-38eaed37e8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:34.321744 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6405b89-fbe1-47f4-889b-38eaed37e8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:34.322228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6405b89-fbe1-47f4-889b-38eaed37e8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:34.322729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6405b89-fbe1-47f4-889b-38eaed37e8d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:34.343566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6405b89-fbe1-47f4-889b-38eaed37e8d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:34.346257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6405b89-fbe1-47f4-889b-38eaed37e8d8 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:34.362286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:34.375137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-a6405b89-fbe1-47f4-889b-38eaed37e8d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:34.375137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:34.375137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:34.375137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:34.375137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:34.375137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:34.375137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:34.375137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:34.375137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:34.375137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:34.375137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:34.375137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:34.375137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:34.375137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:34.375137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:34.375137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:34.376217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:34.376217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:34.376217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:34.376217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:34.376217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:34.376217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:34.376217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:34.376217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:34.376217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:34.376217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:34.376217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:34.376217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:34.376217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:34.376217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:34.376217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:34.376217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:34.376217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:34.377065 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:34.377065 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:34.377065 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:34.377652 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 281/546] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:34.387763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eddec0-d630-42ba-80c1-9ea1b4f4ba30 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:34.427140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:34.525627 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eddec0-d630-42ba-80c1-9ea1b4f4ba30 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:34.581769 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73112ba3-359d-45e3-8691-0fd71c96c563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:34.583123 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73112ba3-359d-45e3-8691-0fd71c96c563 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:34.583401 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73112ba3-359d-45e3-8691-0fd71c96c563 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:34.583710 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73112ba3-359d-45e3-8691-0fd71c96c563 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:34.584392 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73112ba3-359d-45e3-8691-0fd71c96c563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:34.584695 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73112ba3-359d-45e3-8691-0fd71c96c563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:34.586168 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73112ba3-359d-45e3-8691-0fd71c96c563 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:34.602982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 266/547] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:34.609231 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6405b89-fbe1-47f4-889b-38eaed37e8d8 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:34.796089 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6405b89-fbe1-47f4-889b-38eaed37e8d8 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:34.862800 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441381ac-4c97-4517-bc9b-56b1aee0439c None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:34.863330 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441381ac-4c97-4517-bc9b-56b1aee0439c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:34.864122 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441381ac-4c97-4517-bc9b-56b1aee0439c None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:34.871145 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 267/548] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:34.880021 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f929b-316f-4013-ac16-dda2cbe99e2b None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:34.887650 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0376ef-de30-4643-866c-28b6521e40ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:34.888532 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f929b-316f-4013-ac16-dda2cbe99e2b None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:34.889525 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0376ef-de30-4643-866c-28b6521e40ce None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:34.890177 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f929b-316f-4013-ac16-dda2cbe99e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:34.890792 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0376ef-de30-4643-866c-28b6521e40ce None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:34.891682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0376ef-de30-4643-866c-28b6521e40ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:34.918668 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0376ef-de30-4643-866c-28b6521e40ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:34.926082 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0376ef-de30-4643-866c-28b6521e40ce None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:34.936787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-6e5f929b-316f-4013-ac16-dda2cbe99e2b None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:34.943403 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-6e5f929b-316f-4013-ac16-dda2cbe99e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:34.952232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-0a0376ef-de30-4643-866c-28b6521e40ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 01:06:34.952232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:34.952232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:34.952232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:34.952232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:34.952232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:34.952232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:34.952232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:34.952232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:34.952232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:34.952232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:34.952232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:34.952232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:06:34.952232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:06:34.952232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:06:34.952232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:06:34.953213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:34.953213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:34.953213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:06:34.953213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:34.953213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:06:34.953213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:34.953213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:34.953213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:34.953213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:34.953213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:34.953213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:34.953213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:34.953213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:34.953213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:34.953213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:34.953213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:34.953213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:34.953213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:34.954125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:34.954125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:34.954125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:06:34.954125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:06:34.954125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:06:34.954125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:06:34.954125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:06:34.954125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:06:34.954125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 23 01:06:34.954125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:34.964176 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 282/549] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:06:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:34.973162 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0376ef-de30-4643-866c-28b6521e40ce None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:35.104021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:35.107777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 268/550] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:06:35.109232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea5f65-a2a0-4030-bdf1-3237f29ccaaa None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:35.109551 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea5f65-a2a0-4030-bdf1-3237f29ccaaa None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:35.109836 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea5f65-a2a0-4030-bdf1-3237f29ccaaa None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:35.115837 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 269/551] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:35.123486 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d16a1d-db7c-4708-a9a4-166f5d0900d9 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:35.125373 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d16a1d-db7c-4708-a9a4-166f5d0900d9 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:35.125373 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d16a1d-db7c-4708-a9a4-166f5d0900d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:35.172828 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-39d16a1d-db7c-4708-a9a4-166f5d0900d9 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:35.175514 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-39d16a1d-db7c-4708-a9a4-166f5d0900d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:35.203364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0376ef-de30-4643-866c-28b6521e40ce None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:35.247863 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:35.290672 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307245d3-c71d-41f9-8c91-92f1bb8a20f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:35.291575 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307245d3-c71d-41f9-8c91-92f1bb8a20f3 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:35.291995 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307245d3-c71d-41f9-8c91-92f1bb8a20f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:35.292332 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307245d3-c71d-41f9-8c91-92f1bb8a20f3 None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:35.293162 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307245d3-c71d-41f9-8c91-92f1bb8a20f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:35.293464 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307245d3-c71d-41f9-8c91-92f1bb8a20f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:35.296168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307245d3-c71d-41f9-8c91-92f1bb8a20f3 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:35.332967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 283/552] 10.222.0.83 () {56 vars in 1135 bytes} [Fri Sep 23 01:06:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:35.332967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539809b6-22e1-4738-a5c4-0d1fa9ab64af None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:35.332967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539809b6-22e1-4738-a5c4-0d1fa9ab64af None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:35.332967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539809b6-22e1-4738-a5c4-0d1fa9ab64af None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:35.336346 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 284/553] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:35.337404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539809b6-22e1-4738-a5c4-0d1fa9ab64af None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:35.350095 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 270/554] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:06:35.356238 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00850580-3bcc-429f-aea1-d425f86d82ed None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:35.356238 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00850580-3bcc-429f-aea1-d425f86d82ed None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:35.356238 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00850580-3bcc-429f-aea1-d425f86d82ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:35.391202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-00850580-3bcc-429f-aea1-d425f86d82ed None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:35.392411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-00850580-3bcc-429f-aea1-d425f86d82ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:35.537282 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 271/555] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:35.557055 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00850580-3bcc-429f-aea1-d425f86d82ed None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:35.619274 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539809b6-22e1-4738-a5c4-0d1fa9ab64af None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:35.665449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:35.691551 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:35.698979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00850580-3bcc-429f-aea1-d425f86d82ed None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:35.705337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcf8fd-7807-4a06-a22e-1f30e035143b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:35.706949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcf8fd-7807-4a06-a22e-1f30e035143b None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:35.707741 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcf8fd-7807-4a06-a22e-1f30e035143b None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:35.708598 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcf8fd-7807-4a06-a22e-1f30e035143b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:35.742395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62118b6c-81ea-4888-b70f-9e66e1bfc99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:35.743868 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62118b6c-81ea-4888-b70f-9e66e1bfc99a None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:35.744329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62118b6c-81ea-4888-b70f-9e66e1bfc99a None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:35.745046 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62118b6c-81ea-4888-b70f-9e66e1bfc99a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:35.769201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62118b6c-81ea-4888-b70f-9e66e1bfc99a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:35.776757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-62118b6c-81ea-4888-b70f-9e66e1bfc99a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:35.776757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:35.776757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:35.776757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:35.776757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:35.776757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:35.776757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:35.776757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:35.776757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:35.776757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:35.776757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:35.776757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:35.776757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:35.776757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:35.776757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:35.776757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:35.778013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:35.778013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:35.778013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:35.778013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:35.778013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:35.778013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:35.778013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:35.778013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:35.778013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:35.778013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:35.778013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:35.778013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:35.778013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:35.778013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:35.778013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:35.778013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:35.779018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:35.779018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:35.779018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:35.779018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:35.779018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:35.779018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:35.779018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:35.779018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:35.779018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:35.779018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:35.779018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:35.779018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:35.782985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 272/556] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:06:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:06:35.784199 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62118b6c-81ea-4888-b70f-9e66e1bfc99a None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:35.851394 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcf8fd-7807-4a06-a22e-1f30e035143b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:35.855539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcf8fd-7807-4a06-a22e-1f30e035143b None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:35.934926 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62118b6c-81ea-4888-b70f-9e66e1bfc99a None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:35.982968 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b34a0-200e-4e48-8f79-ec781e70ab5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:35.983850 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b34a0-200e-4e48-8f79-ec781e70ab5b None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:35.984163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b34a0-200e-4e48-8f79-ec781e70ab5b None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:35.984402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b34a0-200e-4e48-8f79-ec781e70ab5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:35.998982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b34a0-200e-4e48-8f79-ec781e70ab5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:36.006639 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 285/557] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:06:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:06:36.007116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-412b34a0-200e-4e48-8f79-ec781e70ab5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:36.007116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:36.007116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:36.007116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:36.007116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:36.007116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:36.007116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:36.007116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:36.007116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:36.007116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:36.007116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:36.007116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:36.007116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:36.007116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:36.007116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:36.007116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:36.008107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:36.008107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:36.008107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:36.008107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:36.008107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:36.008107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:36.008107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:36.008107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:36.008107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:36.008107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:36.008107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:36.008107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:36.008107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:36.008107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:36.008107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:36.008107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:36.008959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:36.008959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:36.008959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:36.008959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:36.008959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:36.008959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:36.008959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:36.008959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:36.008959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:36.008959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:36.008959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:36.008959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:36.008959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 273/558] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:06:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:36.009703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b34a0-200e-4e48-8f79-ec781e70ab5b None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:36.011585 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcf8fd-7807-4a06-a22e-1f30e035143b None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:36.013668 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:36.035709 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:36.196319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcf8fd-7807-4a06-a22e-1f30e035143b None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:36.196790 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b34a0-200e-4e48-8f79-ec781e70ab5b None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:36.251427 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cde00-a4a2-470e-a90a-acad71626323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:36.252625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cde00-a4a2-470e-a90a-acad71626323 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:36.253392 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cde00-a4a2-470e-a90a-acad71626323 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:36.253392 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cde00-a4a2-470e-a90a-acad71626323 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:36.270354 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1b25c-0350-4772-beb9-6d9f3c68a4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:36.271059 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1b25c-0350-4772-beb9-6d9f3c68a4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:36.271510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1b25c-0350-4772-beb9-6d9f3c68a4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:36.271696 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1b25c-0350-4772-beb9-6d9f3c68a4b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:36.273076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0cde00-a4a2-470e-a90a-acad71626323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:36.273302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1b25c-0350-4772-beb9-6d9f3c68a4b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:36.273764 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1b25c-0350-4772-beb9-6d9f3c68a4b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:36.276117 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1b25c-0350-4772-beb9-6d9f3c68a4b5 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:36.280297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-3e0cde00-a4a2-470e-a90a-acad71626323 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:36.280297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:36.280297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:36.280297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:36.280297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:36.280297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:36.280297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:36.280297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:36.280297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:36.280297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:36.280297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:36.280297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:36.280297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:36.280297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:36.280297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:36.280297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:36.282402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:36.282402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:36.282402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:36.282402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:36.282402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:36.282402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:36.282402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:36.282402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:36.282402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:36.282402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:36.282402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:36.282402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:36.282402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:36.282402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:36.282402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:36.282402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:36.286053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:36.286053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:36.286053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:36.286053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:36.286053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:36.286053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:36.286053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:36.286053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:36.286053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:36.286053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:36.286053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:36.286053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:36.289107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 274/559] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:06:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:36.290118 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cde00-a4a2-470e-a90a-acad71626323 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:36.306729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 286/560] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:06:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:36.306729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1b25c-0350-4772-beb9-6d9f3c68a4b5 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:36.406146 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:36.444931 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:36.473509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cde00-a4a2-470e-a90a-acad71626323 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:36.502846 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1b25c-0350-4772-beb9-6d9f3c68a4b5 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:36.531222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17cf38-a20b-4905-9900-d055ee0ddef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:36.532389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17cf38-a20b-4905-9900-d055ee0ddef4 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:36.532697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17cf38-a20b-4905-9900-d055ee0ddef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:36.544498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17cf38-a20b-4905-9900-d055ee0ddef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:36.544634 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1635f8-5b81-4546-8580-7f43799da77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:36.544634 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1635f8-5b81-4546-8580-7f43799da77b None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:36.544788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1635f8-5b81-4546-8580-7f43799da77b None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:36.545121 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1635f8-5b81-4546-8580-7f43799da77b None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:36.545642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1635f8-5b81-4546-8580-7f43799da77b None admin] RBAC: Adding query filter params (name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:36.545950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1635f8-5b81-4546-8580-7f43799da77b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:36.547367 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17cf38-a20b-4905-9900-d055ee0ddef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:36.547493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1635f8-5b81-4546-8580-7f43799da77b None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:36.549933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17cf38-a20b-4905-9900-d055ee0ddef4 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:36.556947 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 287/561] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:06:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:36.557910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1635f8-5b81-4546-8580-7f43799da77b None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:36.573404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-cf17cf38-a20b-4905-9900-d055ee0ddef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:36.573404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:36.573404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:36.573404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:36.573404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:36.573404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:36.573404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:36.573404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:36.573404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:36.573404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:36.573404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:36.573404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:36.573404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:36.573404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:36.573404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:36.573404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:36.574575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:36.574575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:36.574575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:36.574575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:36.574575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:36.574575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:36.574575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:36.574575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:36.574575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:36.574575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:36.574575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:36.574575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:36.574575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:36.574575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:36.574575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:36.574575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:36.574575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:36.576497 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:36.576497 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:36.576497 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:36.579859 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 275/562] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:36.581163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17cf38-a20b-4905-9900-d055ee0ddef4 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:36.686564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1635f8-5b81-4546-8580-7f43799da77b None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:36.715354 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17cf38-a20b-4905-9900-d055ee0ddef4 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:36.746636 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e769c9a-7387-4f24-9c7f-f9eff6e7aaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:36.747802 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e769c9a-7387-4f24-9c7f-f9eff6e7aaa0 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:36.747802 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e769c9a-7387-4f24-9c7f-f9eff6e7aaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:36.748150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e769c9a-7387-4f24-9c7f-f9eff6e7aaa0 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:36.749051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e769c9a-7387-4f24-9c7f-f9eff6e7aaa0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:36.749479 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e769c9a-7387-4f24-9c7f-f9eff6e7aaa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:36.751236 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e769c9a-7387-4f24-9c7f-f9eff6e7aaa0 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:36.765343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 288/563] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:06:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:36.766453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980ff32-f42a-463a-9fa2-b2cf45d40f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:36.766826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e769c9a-7387-4f24-9c7f-f9eff6e7aaa0 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:36.767722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980ff32-f42a-463a-9fa2-b2cf45d40f68 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:36.768022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980ff32-f42a-463a-9fa2-b2cf45d40f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:36.768401 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980ff32-f42a-463a-9fa2-b2cf45d40f68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:36.782752 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980ff32-f42a-463a-9fa2-b2cf45d40f68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:36.784232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980ff32-f42a-463a-9fa2-b2cf45d40f68 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:36.799901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-a980ff32-f42a-463a-9fa2-b2cf45d40f68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:36.799901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:36.799901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:36.799901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:36.799901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:36.799901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:36.799901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:36.799901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:36.799901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:36.799901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:36.799901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:36.799901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:36.799901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:36.799901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:36.799901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:36.799901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:36.801774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:36.801774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:36.801774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:36.801774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:36.801774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:36.801774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:36.801774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:36.801774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:36.801774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:36.801774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:36.801774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:36.801774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:36.801774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:36.801774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:36.801774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:36.801774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:36.801774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:36.803247 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:36.803247 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:36.803247 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:36.806486 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 276/564] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:36.807473 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980ff32-f42a-463a-9fa2-b2cf45d40f68 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:36.913020 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e769c9a-7387-4f24-9c7f-f9eff6e7aaa0 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:36.919566 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:36.961937 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf9123-01db-4b59-a1bb-941ac34724cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:36.962339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf9123-01db-4b59-a1bb-941ac34724cf None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:36.962999 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf9123-01db-4b59-a1bb-941ac34724cf None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:36.963296 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf9123-01db-4b59-a1bb-941ac34724cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:36.969745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980ff32-f42a-463a-9fa2-b2cf45d40f68 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:36.979830 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf9123-01db-4b59-a1bb-941ac34724cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:36.982669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf9123-01db-4b59-a1bb-941ac34724cf None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:37.008376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-59bf9123-01db-4b59-a1bb-941ac34724cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:37.008376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:37.008376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:37.008376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:37.008376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:37.008376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:37.008376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:37.008376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:37.008376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:37.008376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:37.008376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:37.008376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:37.008376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:37.008376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:37.008376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:37.008376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:37.009690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:37.009690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:37.009690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:37.009690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:37.009690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:37.009690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:37.009690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:37.009690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:37.009690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:37.009690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:37.009690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:37.009690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:37.009690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:37.009690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:37.009690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:37.009690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:37.009690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:37.010633 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:37.010633 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:37.010633 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:37.010633 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 289/565] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:37.011557 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf9123-01db-4b59-a1bb-941ac34724cf None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:37.030636 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e8352-9383-40e2-a7fc-8680caf7f337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:37.031509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e8352-9383-40e2-a7fc-8680caf7f337 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:37.031967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e8352-9383-40e2-a7fc-8680caf7f337 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:37.032449 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e8352-9383-40e2-a7fc-8680caf7f337 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:37.033638 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e8352-9383-40e2-a7fc-8680caf7f337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:37.034176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e8352-9383-40e2-a7fc-8680caf7f337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:37.037163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e8352-9383-40e2-a7fc-8680caf7f337 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:37.059640 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 277/566] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:37.060887 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e8352-9383-40e2-a7fc-8680caf7f337 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:37.112409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:37.168369 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:37.176625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf9123-01db-4b59-a1bb-941ac34724cf None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:37.210010 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:37.217755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e8352-9383-40e2-a7fc-8680caf7f337 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:37.239058 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c261a99-f7a0-4540-930c-749e637a39fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:37.239775 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c261a99-f7a0-4540-930c-749e637a39fb None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:37.240099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c261a99-f7a0-4540-930c-749e637a39fb None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:37.240560 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c261a99-f7a0-4540-930c-749e637a39fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:37.264489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c261a99-f7a0-4540-930c-749e637a39fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:37.264489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c261a99-f7a0-4540-930c-749e637a39fb None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:37.266363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f9094-3ee6-41e8-8b01-8782b6d6470e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:37.267234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f9094-3ee6-41e8-8b01-8782b6d6470e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:37.267666 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f9094-3ee6-41e8-8b01-8782b6d6470e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:37.268032 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f9094-3ee6-41e8-8b01-8782b6d6470e None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:37.268914 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f9094-3ee6-41e8-8b01-8782b6d6470e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:37.269340 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f9094-3ee6-41e8-8b01-8782b6d6470e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:37.271022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f9094-3ee6-41e8-8b01-8782b6d6470e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:37.284735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-4c261a99-f7a0-4540-930c-749e637a39fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:37.284735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:37.284735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:37.284735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:37.284735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:37.284735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:37.284735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:37.284735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:37.284735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:37.284735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:37.284735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:37.284735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:37.284735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:37.284735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:37.284735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:37.284735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:37.287342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:37.287342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:37.287342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:37.287342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:37.287342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:37.287342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:37.287342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:37.287342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:37.287342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:37.287342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:37.287342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:37.287342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:37.287342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:37.287342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:37.287342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:37.287342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:37.287342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:37.289050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:37.289050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:37.289050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:37.289050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 290/567] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:37.289470 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 278/568] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:37.289888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f9094-3ee6-41e8-8b01-8782b6d6470e None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:37.291988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728bb10-fa3d-43a6-85c6-8d2cde0e4aba None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:37.292477 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728bb10-fa3d-43a6-85c6-8d2cde0e4aba None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:37.292953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728bb10-fa3d-43a6-85c6-8d2cde0e4aba None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:37.296553 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 291/569] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:37.297842 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728bb10-fa3d-43a6-85c6-8d2cde0e4aba None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:37.426089 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:37.444266 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f9094-3ee6-41e8-8b01-8782b6d6470e None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:37.487025 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728bb10-fa3d-43a6-85c6-8d2cde0e4aba None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:37.492144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17ddce-d161-4b42-8e2b-63eb4bf96980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:37.493173 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17ddce-d161-4b42-8e2b-63eb4bf96980 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:37.493658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17ddce-d161-4b42-8e2b-63eb4bf96980 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:37.494144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17ddce-d161-4b42-8e2b-63eb4bf96980 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:37.495359 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17ddce-d161-4b42-8e2b-63eb4bf96980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:37.495910 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17ddce-d161-4b42-8e2b-63eb4bf96980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:37.498094 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:37.498515 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17ddce-d161-4b42-8e2b-63eb4bf96980 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:37.522088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 279/570] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:37.522876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17ddce-d161-4b42-8e2b-63eb4bf96980 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:37.535683 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f62d5-c44c-4c99-a8ea-71b58ef10c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:37.536650 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f62d5-c44c-4c99-a8ea-71b58ef10c12 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:37.537107 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f62d5-c44c-4c99-a8ea-71b58ef10c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:37.537996 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f62d5-c44c-4c99-a8ea-71b58ef10c12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:37.548690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f62d5-c44c-4c99-a8ea-71b58ef10c12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:37.549864 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f62d5-c44c-4c99-a8ea-71b58ef10c12 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:37.570220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-1c0f62d5-c44c-4c99-a8ea-71b58ef10c12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:37.570220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:37.570220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:37.570220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:37.570220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:37.570220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:37.570220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:37.570220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:37.570220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:37.570220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:37.570220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:37.570220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:37.570220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:06:37.570220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:06:37.570220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:06:37.571719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:06:37.571719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:37.571719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:37.571719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:37.571719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:37.571719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:37.571719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:37.571719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:37.571719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:37.571719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:37.571719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:37.571719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:37.571719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:37.571719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:37.571719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:37.571719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:37.571719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:37.572787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:06:37.572787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:06:37.572787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:06:37.572787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:06:37.572787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:06:37.572787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:06:37.572787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:37.572787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:37.573345 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 292/571] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:37.574110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f62d5-c44c-4c99-a8ea-71b58ef10c12 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:37.686772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17ddce-d161-4b42-8e2b-63eb4bf96980 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:37.722305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f62d5-c44c-4c99-a8ea-71b58ef10c12 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:37.738748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7322a-6bac-4aa7-966b-9f284252deab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:37.739751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7322a-6bac-4aa7-966b-9f284252deab None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:37.740194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7322a-6bac-4aa7-966b-9f284252deab None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:37.740639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7322a-6bac-4aa7-966b-9f284252deab None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:37.741546 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7322a-6bac-4aa7-966b-9f284252deab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:37.742041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7322a-6bac-4aa7-966b-9f284252deab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:37.744390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7322a-6bac-4aa7-966b-9f284252deab None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:37.765863 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 280/572] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:37.767489 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629348f2-c3e3-4ee5-a364-013c5d2ce24a None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:37.767865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629348f2-c3e3-4ee5-a364-013c5d2ce24a None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:37.768197 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629348f2-c3e3-4ee5-a364-013c5d2ce24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:37.789801 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0377c-9f54-48e6-9c17-ea92b8c39c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:37.790360 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0377c-9f54-48e6-9c17-ea92b8c39c5f None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:37.790696 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0377c-9f54-48e6-9c17-ea92b8c39c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:37.790942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0377c-9f54-48e6-9c17-ea92b8c39c5f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:37.791726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-629348f2-c3e3-4ee5-a364-013c5d2ce24a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:37.793583 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-629348f2-c3e3-4ee5-a364-013c5d2ce24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:37.797626 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:37.799879 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0377c-9f54-48e6-9c17-ea92b8c39c5f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:37.801996 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0377c-9f54-48e6-9c17-ea92b8c39c5f None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:37.826989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-bef0377c-9f54-48e6-9c17-ea92b8c39c5f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 23 01:06:37.826989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:37.826989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:37.826989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:37.826989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:37.826989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:37.826989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:37.826989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:37.826989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:37.826989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:37.826989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:37.826989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:37.826989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:06:37.826989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:06:37.826989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:06:37.826989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:06:37.828920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:37.828920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:37.828920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:06:37.828920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:37.828920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:06:37.828920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:37.828920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:37.828920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:37.828920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:37.828920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:37.828920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:37.828920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:37.828920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:37.828920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:37.828920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:37.828920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:37.828920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:37.828920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:37.832790 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:37.832790 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:37.832790 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:06:37.832790 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:06:37.832790 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:06:37.832790 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:06:37.832790 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:06:37.832790 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:06:37.832790 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 23 01:06:37.832790 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:37.832790 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 293/573] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:06:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:37.832790 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0377c-9f54-48e6-9c17-ea92b8c39c5f None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:37.886753 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:37.908894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 281/574] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:37.910867 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629348f2-c3e3-4ee5-a364-013c5d2ce24a None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:38.049044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0377c-9f54-48e6-9c17-ea92b8c39c5f None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:38.113766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629348f2-c3e3-4ee5-a364-013c5d2ce24a None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:38.119201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97c89e-ae5a-4502-840e-30d70c824d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:38.120038 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97c89e-ae5a-4502-840e-30d70c824d89 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:38.120394 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97c89e-ae5a-4502-840e-30d70c824d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:38.120805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97c89e-ae5a-4502-840e-30d70c824d89 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:38.133027 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97c89e-ae5a-4502-840e-30d70c824d89 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:38.135055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97c89e-ae5a-4502-840e-30d70c824d89 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:38.150235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-af97c89e-ae5a-4502-840e-30d70c824d89 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 01:06:38.150235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:38.150235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:38.150235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:38.150235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:38.150235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:38.150235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:38.150235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:38.150235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:38.150235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:38.150235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:38.150235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:38.150235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:06:38.150235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:06:38.150235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:06:38.150235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:06:38.152315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:38.152315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:38.152315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:06:38.152315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:38.152315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:06:38.152315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:38.152315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:38.152315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:38.152315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:38.152315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:38.152315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:38.152315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:38.152315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:38.152315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:38.152315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:38.152315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:38.152315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:38.152315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:38.154119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:38.154119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:38.154119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:06:38.154119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:06:38.154119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:06:38.154119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:06:38.154119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:06:38.154119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:06:38.154119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 01:06:38.154119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:38.158899 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 294/575] 10.222.0.83 () {56 vars in 1093 bytes} [Fri Sep 23 01:06:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:38.160102 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97c89e-ae5a-4502-840e-30d70c824d89 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:38.183708 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcb5a7-436f-417c-81b1-f7bc78cffd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:38.184781 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcb5a7-436f-417c-81b1-f7bc78cffd50 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:38.185273 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcb5a7-436f-417c-81b1-f7bc78cffd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:38.185746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcb5a7-436f-417c-81b1-f7bc78cffd50 None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:38.187095 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcb5a7-436f-417c-81b1-f7bc78cffd50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:38.187643 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcb5a7-436f-417c-81b1-f7bc78cffd50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:38.190462 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcb5a7-436f-417c-81b1-f7bc78cffd50 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:38.204712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:38.221863 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 282/576] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:06:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:38.221863 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcb5a7-436f-417c-81b1-f7bc78cffd50 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:38.321355 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:38.344012 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97c89e-ae5a-4502-840e-30d70c824d89 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:38.393024 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12411bb-9638-4f52-8f9b-8c0f61a25f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:38.394052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12411bb-9638-4f52-8f9b-8c0f61a25f24 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:38.395101 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12411bb-9638-4f52-8f9b-8c0f61a25f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:38.395590 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12411bb-9638-4f52-8f9b-8c0f61a25f24 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:38.408991 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12411bb-9638-4f52-8f9b-8c0f61a25f24 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:38.411518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcb5a7-436f-417c-81b1-f7bc78cffd50 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:38.412271 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12411bb-9638-4f52-8f9b-8c0f61a25f24 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:38.432184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-a12411bb-9638-4f52-8f9b-8c0f61a25f24 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 01:06:38.432184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:38.432184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:38.432184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:38.432184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:38.432184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:38.432184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:38.432184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:38.432184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:38.432184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:38.432184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:38.432184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:38.432184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:06:38.432184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:06:38.432184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:06:38.432184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:06:38.434045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:38.434045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:38.434045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:06:38.434045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:38.434045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:06:38.434045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:38.434045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:38.434045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:38.434045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:38.434045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:38.434045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:38.434045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:38.434045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:38.434045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:38.434045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:38.434045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:38.434045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:38.434045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:38.435667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:38.435667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:38.435667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:06:38.435667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:06:38.435667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:06:38.435667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:06:38.435667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:06:38.435667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:06:38.435667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 01:06:38.435667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:38.438841 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 295/577] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:06:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:38.440762 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12411bb-9638-4f52-8f9b-8c0f61a25f24 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:38.479655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffbd49-7799-4bbf-9861-66aa52d33f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:38.480762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffbd49-7799-4bbf-9861-66aa52d33f01 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:38.481268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffbd49-7799-4bbf-9861-66aa52d33f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:38.481750 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffbd49-7799-4bbf-9861-66aa52d33f01 None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:38.483164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffbd49-7799-4bbf-9861-66aa52d33f01 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:38.483725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffbd49-7799-4bbf-9861-66aa52d33f01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:38.486466 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffbd49-7799-4bbf-9861-66aa52d33f01 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:38.515812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 283/578] 10.222.0.83 () {56 vars in 1137 bytes} [Fri Sep 23 01:06:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:38.516748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffbd49-7799-4bbf-9861-66aa52d33f01 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:38.593803 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:38.617381 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12411bb-9638-4f52-8f9b-8c0f61a25f24 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:38.659942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69278a42-53f5-4844-93c6-7c959cb82d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:38.660854 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69278a42-53f5-4844-93c6-7c959cb82d5e None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:38.660854 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69278a42-53f5-4844-93c6-7c959cb82d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:38.661096 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69278a42-53f5-4844-93c6-7c959cb82d5e None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:38.661834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69278a42-53f5-4844-93c6-7c959cb82d5e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:38.662133 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69278a42-53f5-4844-93c6-7c959cb82d5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:38.663637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69278a42-53f5-4844-93c6-7c959cb82d5e None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:38.676190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffbd49-7799-4bbf-9861-66aa52d33f01 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:38.689739 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 296/579] 10.222.0.83 () {56 vars in 1133 bytes} [Fri Sep 23 01:06:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:38.691826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69278a42-53f5-4844-93c6-7c959cb82d5e None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:38.699688 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:38.736137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f165e0d-ce50-4ed7-98e2-f583adb6723b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:38.736762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f165e0d-ce50-4ed7-98e2-f583adb6723b None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:38.737043 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f165e0d-ce50-4ed7-98e2-f583adb6723b None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:38.737364 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f165e0d-ce50-4ed7-98e2-f583adb6723b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:38.738860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f165e0d-ce50-4ed7-98e2-f583adb6723b None admin] RBAC: Adding query filter params (role.id=2e8d92bd39634bbdad03d67d3fc439f0, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=c526c7ad227943d1a2bba7b5e2e039e0) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:38.739181 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f165e0d-ce50-4ed7-98e2-f583adb6723b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:38.740666 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f165e0d-ce50-4ed7-98e2-f583adb6723b None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:38.748927 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 284/580] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:06:38 2022] GET /identity/v3/role_assignments?user.id=c526c7ad227943d1a2bba7b5e2e039e0&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=2e8d92bd39634bbdad03d67d3fc439f0 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:38.749843 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f165e0d-ce50-4ed7-98e2-f583adb6723b None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:38.838535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69278a42-53f5-4844-93c6-7c959cb82d5e None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:38.901672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f165e0d-ce50-4ed7-98e2-f583adb6723b None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:38.907110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3eaf7-f98e-4f4b-8ef5-74b87a2e7186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:38.908433 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3eaf7-f98e-4f4b-8ef5-74b87a2e7186 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:38.908897 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3eaf7-f98e-4f4b-8ef5-74b87a2e7186 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:38.909374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3eaf7-f98e-4f4b-8ef5-74b87a2e7186 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:38.931009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:38.931228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3eaf7-f98e-4f4b-8ef5-74b87a2e7186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:38.942170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-34d3eaf7-f98e-4f4b-8ef5-74b87a2e7186 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:38.942170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:38.942170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:38.942170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:38.942170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:38.942170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:38.942170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:38.942170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:38.942170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:38.942170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:38.942170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:38.942170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:38.942170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:38.942170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:38.942170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:38.942170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:38.945148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:38.945148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:38.945148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:38.945148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:38.945148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:38.945148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:38.945148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:38.945148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:38.945148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:38.945148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:38.945148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:38.945148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:38.945148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:38.945148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:38.945148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:38.945148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:38.946984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:38.946984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:38.946984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:38.946984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:38.946984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:38.946984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:38.946984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:38.946984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:38.946984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:38.946984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:38.946984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:38.946984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:38.946984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 297/581] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:06:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:38.946984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3eaf7-f98e-4f4b-8ef5-74b87a2e7186 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:38.966386 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8de28-1733-4c98-b302-261643d3756c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:38.967542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8de28-1733-4c98-b302-261643d3756c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:38.971028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8de28-1733-4c98-b302-261643d3756c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:38.971028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8de28-1733-4c98-b302-261643d3756c None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:38.971028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8de28-1733-4c98-b302-261643d3756c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:38.971028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8de28-1733-4c98-b302-261643d3756c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:38.973476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8de28-1733-4c98-b302-261643d3756c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:39.020598 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 285/582] 10.222.0.83 () {56 vars in 1137 bytes} [Fri Sep 23 01:06:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:39.022208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8de28-1733-4c98-b302-261643d3756c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:39.072544 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:39.129940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3eaf7-f98e-4f4b-8ef5-74b87a2e7186 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:39.169831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc92e1-0bdc-437b-a4cc-9dbbfd8b1390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:39.170441 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc92e1-0bdc-437b-a4cc-9dbbfd8b1390 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:39.170864 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc92e1-0bdc-437b-a4cc-9dbbfd8b1390 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:39.171221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc92e1-0bdc-437b-a4cc-9dbbfd8b1390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:39.193476 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc92e1-0bdc-437b-a4cc-9dbbfd8b1390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:39.195129 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc92e1-0bdc-437b-a4cc-9dbbfd8b1390 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:39.197767 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8de28-1733-4c98-b302-261643d3756c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:39.217865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-addc92e1-0bdc-437b-a4cc-9dbbfd8b1390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:39.217865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:39.217865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:39.217865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:39.217865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:39.217865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:39.217865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:39.217865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:39.217865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:39.217865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:39.217865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:39.217865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:39.217865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:39.217865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:39.217865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:39.217865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:39.219116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:39.219116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:39.219116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:39.219116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:39.219116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:39.219116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:39.219116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:39.219116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:39.219116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:39.219116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:39.219116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:39.219116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:39.219116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:39.219116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:39.219116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:39.219116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:39.219116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:39.220032 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:39.220032 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:39.220032 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:39.225998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 298/583] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:39.225998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc92e1-0bdc-437b-a4cc-9dbbfd8b1390 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:39.255493 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78be3a-9277-4c38-93d0-141973b59e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:39.256185 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78be3a-9277-4c38-93d0-141973b59e32 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:39.256497 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78be3a-9277-4c38-93d0-141973b59e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:39.256815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78be3a-9277-4c38-93d0-141973b59e32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:39.270254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78be3a-9277-4c38-93d0-141973b59e32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:39.271841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78be3a-9277-4c38-93d0-141973b59e32 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:39.301584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-ff78be3a-9277-4c38-93d0-141973b59e32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:39.301584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:39.301584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:39.301584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:39.301584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:39.301584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:39.301584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:39.301584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:39.301584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:39.301584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:39.301584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:39.301584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:39.301584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:39.301584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:39.301584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:39.301584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:39.314031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:39.314031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:39.314031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:39.314031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:39.314031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:39.314031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:39.314031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:39.314031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:39.314031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:39.314031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:39.314031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:39.314031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:39.314031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:39.314031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:39.314031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:39.314031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:39.314031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:39.315133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:39.315133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:39.315133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:39.315133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 286/584] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:39.315133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78be3a-9277-4c38-93d0-141973b59e32 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:39.355849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:39.419360 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc92e1-0bdc-437b-a4cc-9dbbfd8b1390 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:39.453452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:39.470531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78be3a-9277-4c38-93d0-141973b59e32 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:39.486661 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d757cb-0909-41df-a5a6-55382fdda6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:39.487455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d757cb-0909-41df-a5a6-55382fdda6bb None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:39.487885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d757cb-0909-41df-a5a6-55382fdda6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:39.488415 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d757cb-0909-41df-a5a6-55382fdda6bb None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:39.489548 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d757cb-0909-41df-a5a6-55382fdda6bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:39.490041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d757cb-0909-41df-a5a6-55382fdda6bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:39.492262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d757cb-0909-41df-a5a6-55382fdda6bb None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:39.508469 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 299/585] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:06:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:39.516883 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d757cb-0909-41df-a5a6-55382fdda6bb None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:39.535477 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3474bd7-2991-4f8a-9414-a2ac44c50dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:39.536501 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3474bd7-2991-4f8a-9414-a2ac44c50dbf None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:39.536924 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3474bd7-2991-4f8a-9414-a2ac44c50dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:39.537336 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3474bd7-2991-4f8a-9414-a2ac44c50dbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:39.557288 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3474bd7-2991-4f8a-9414-a2ac44c50dbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:39.559986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3474bd7-2991-4f8a-9414-a2ac44c50dbf None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:39.586820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-d3474bd7-2991-4f8a-9414-a2ac44c50dbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:39.586820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:39.586820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:39.586820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:39.586820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:39.586820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:39.586820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:39.586820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:39.586820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:39.586820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:39.586820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:39.586820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:39.586820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:39.586820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:39.586820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:39.586820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:39.588575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:39.588575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:39.588575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:39.588575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:39.588575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:39.588575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:39.588575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:39.588575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:39.588575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:39.588575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:39.588575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:39.588575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:39.588575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:39.588575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:39.588575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:39.588575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:39.588575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:39.591426 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:39.591426 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:39.591426 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:39.591426 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 287/586] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:39.591426 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3474bd7-2991-4f8a-9414-a2ac44c50dbf None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:39.699107 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d757cb-0909-41df-a5a6-55382fdda6bb None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:39.750569 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:39.763415 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874fe16-1620-4de6-ace8-c41e91c42570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:39.764386 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874fe16-1620-4de6-ace8-c41e91c42570 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:39.764856 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874fe16-1620-4de6-ace8-c41e91c42570 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:39.765308 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874fe16-1620-4de6-ace8-c41e91c42570 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:39.766482 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874fe16-1620-4de6-ace8-c41e91c42570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:39.766937 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874fe16-1620-4de6-ace8-c41e91c42570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:39.770095 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874fe16-1620-4de6-ace8-c41e91c42570 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:39.792363 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 300/587] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:39.792363 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874fe16-1620-4de6-ace8-c41e91c42570 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:39.799631 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3474bd7-2991-4f8a-9414-a2ac44c50dbf None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:39.856976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3e82d-0cec-435f-8225-0b9169da35a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:39.858052 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3e82d-0cec-435f-8225-0b9169da35a5 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:39.858517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3e82d-0cec-435f-8225-0b9169da35a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:39.859025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3e82d-0cec-435f-8225-0b9169da35a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:39.860253 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3e82d-0cec-435f-8225-0b9169da35a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:39.860813 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3e82d-0cec-435f-8225-0b9169da35a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:39.863563 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3e82d-0cec-435f-8225-0b9169da35a5 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:39.868036 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:39.893697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 288/588] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:39.895642 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3e82d-0cec-435f-8225-0b9169da35a5 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:39.977515 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874fe16-1620-4de6-ace8-c41e91c42570 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:40.049271 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540de56-41ca-4db4-ba54-986c29f8371e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:40.050219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540de56-41ca-4db4-ba54-986c29f8371e None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:40.051301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540de56-41ca-4db4-ba54-986c29f8371e None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:40.051777 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540de56-41ca-4db4-ba54-986c29f8371e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:40.075634 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540de56-41ca-4db4-ba54-986c29f8371e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:40.078435 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540de56-41ca-4db4-ba54-986c29f8371e None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:40.107794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-9540de56-41ca-4db4-ba54-986c29f8371e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:40.107794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:40.107794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:40.107794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:40.107794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:40.107794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:40.107794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:40.107794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:40.107794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:40.107794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:40.107794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:40.107794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:40.107794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:40.107794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:40.107794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:40.107794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:40.109064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:40.109064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:40.109064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:40.109064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:40.109064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:40.109064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:40.109064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:40.109064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:40.109064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:40.109064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:40.109064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:40.109064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:40.109064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:40.109064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:40.109064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:40.109064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:40.109064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:40.110401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:40.110401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:40.110401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:40.110688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3e82d-0cec-435f-8225-0b9169da35a5 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:40.112595 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 301/589] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:40.114236 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540de56-41ca-4db4-ba54-986c29f8371e None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:40.185227 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91ace1-6b12-4cbe-84f9-04a62a8d7f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:40.186127 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91ace1-6b12-4cbe-84f9-04a62a8d7f9c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:40.186543 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91ace1-6b12-4cbe-84f9-04a62a8d7f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:40.187035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91ace1-6b12-4cbe-84f9-04a62a8d7f9c None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:40.188141 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91ace1-6b12-4cbe-84f9-04a62a8d7f9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:40.188584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91ace1-6b12-4cbe-84f9-04a62a8d7f9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:40.190725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91ace1-6b12-4cbe-84f9-04a62a8d7f9c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:40.218636 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 289/590] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:40.218636 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91ace1-6b12-4cbe-84f9-04a62a8d7f9c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:40.222487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:40.298949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:40.319258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540de56-41ca-4db4-ba54-986c29f8371e None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:40.401982 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221dd17-43fe-4e07-ae04-846d6ba31f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:40.403284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221dd17-43fe-4e07-ae04-846d6ba31f04 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:40.403776 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221dd17-43fe-4e07-ae04-846d6ba31f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:40.404284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221dd17-43fe-4e07-ae04-846d6ba31f04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:40.410826 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91ace1-6b12-4cbe-84f9-04a62a8d7f9c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:40.429111 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221dd17-43fe-4e07-ae04-846d6ba31f04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:40.432042 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221dd17-43fe-4e07-ae04-846d6ba31f04 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:40.455584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-7221dd17-43fe-4e07-ae04-846d6ba31f04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:40.455584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:40.455584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:40.455584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:40.455584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:40.455584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:40.455584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:40.455584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:40.455584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:40.455584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:40.455584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:40.455584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:40.455584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:06:40.455584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:06:40.455584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:06:40.458269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:06:40.458269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:40.458269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:40.458269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:40.458269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:40.458269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:40.458269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:40.458269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:40.458269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:40.458269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:40.458269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:40.458269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:40.458269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:40.458269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:40.458269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:40.458269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:40.458269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:40.460263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:06:40.460263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:06:40.460263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:06:40.460263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:06:40.460263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:06:40.460263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:06:40.460263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:40.460263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:40.460263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 302/591] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:40.465359 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221dd17-43fe-4e07-ae04-846d6ba31f04 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:40.499381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ccfe7-eb0a-47cb-b7aa-0e1b904eff72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:40.500408 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ccfe7-eb0a-47cb-b7aa-0e1b904eff72 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:40.500857 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ccfe7-eb0a-47cb-b7aa-0e1b904eff72 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:40.501407 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ccfe7-eb0a-47cb-b7aa-0e1b904eff72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:40.514389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ccfe7-eb0a-47cb-b7aa-0e1b904eff72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:40.516977 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ccfe7-eb0a-47cb-b7aa-0e1b904eff72 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:40.538409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-640ccfe7-eb0a-47cb-b7aa-0e1b904eff72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:40.538409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:40.538409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:40.538409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:40.538409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:40.538409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:40.538409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:40.538409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:40.538409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:40.538409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:40.538409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:40.538409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:40.538409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:06:40.538409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:06:40.538409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:06:40.540023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:06:40.540023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:40.540023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:40.540023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:40.540023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:40.540023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:40.540023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:40.540023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:40.540023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:40.540023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:40.540023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:40.540023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:40.540023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:40.540023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:40.540023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:40.540023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:40.540023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:40.541026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:06:40.541026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:06:40.541026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:06:40.541026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:06:40.541026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:06:40.541026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:06:40.541026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:40.541026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:40.541026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 290/592] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:40.543360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ccfe7-eb0a-47cb-b7aa-0e1b904eff72 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:40.662926 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:40.665994 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221dd17-43fe-4e07-ae04-846d6ba31f04 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:40.737097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ce8c4-720f-4c54-ab3a-1e823c72b57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:40.738292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ce8c4-720f-4c54-ab3a-1e823c72b57c None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:40.738731 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ce8c4-720f-4c54-ab3a-1e823c72b57c None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:40.739251 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ce8c4-720f-4c54-ab3a-1e823c72b57c None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:40.740453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ce8c4-720f-4c54-ab3a-1e823c72b57c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:40.740996 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ce8c4-720f-4c54-ab3a-1e823c72b57c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:40.741622 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ccfe7-eb0a-47cb-b7aa-0e1b904eff72 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:40.743426 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ce8c4-720f-4c54-ab3a-1e823c72b57c None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:40.777155 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 303/593] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:40.777155 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ce8c4-720f-4c54-ab3a-1e823c72b57c None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:40.797645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098b0a9-00b6-42e7-822d-2073b21ff514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:40.798578 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098b0a9-00b6-42e7-822d-2073b21ff514 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:40.798924 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098b0a9-00b6-42e7-822d-2073b21ff514 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:40.799174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098b0a9-00b6-42e7-822d-2073b21ff514 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:40.800555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:40.809366 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098b0a9-00b6-42e7-822d-2073b21ff514 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:40.811759 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098b0a9-00b6-42e7-822d-2073b21ff514 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:40.828911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-6098b0a9-00b6-42e7-822d-2073b21ff514 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:40.828911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:40.828911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:40.828911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:40.828911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:40.828911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:40.828911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:40.828911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:40.828911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:40.828911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:40.828911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:40.828911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:40.828911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:06:40.828911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:06:40.828911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:06:40.830730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:06:40.830730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:40.830730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:40.830730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:40.830730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:40.830730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:40.830730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:40.830730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:40.830730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:40.830730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:40.830730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:40.830730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:40.830730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:40.830730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:40.830730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:40.830730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:40.830730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:40.833133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:06:40.833133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:06:40.833133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:06:40.833133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:06:40.833133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:06:40.833133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:06:40.833133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:40.833133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:40.833133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 291/594] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:40.833133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098b0a9-00b6-42e7-822d-2073b21ff514 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:40.976998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ce8c4-720f-4c54-ab3a-1e823c72b57c None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:41.006894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098b0a9-00b6-42e7-822d-2073b21ff514 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:41.023316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f622dd7-f367-4b37-85bd-b638d3293568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:41.024192 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f622dd7-f367-4b37-85bd-b638d3293568 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:41.024667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f622dd7-f367-4b37-85bd-b638d3293568 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:41.024969 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f622dd7-f367-4b37-85bd-b638d3293568 None admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:41.025862 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f622dd7-f367-4b37-85bd-b638d3293568 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:41.026380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f622dd7-f367-4b37-85bd-b638d3293568 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:41.028596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f622dd7-f367-4b37-85bd-b638d3293568 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:41.045185 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:41.057093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 304/595] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:06:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:41.057093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f622dd7-f367-4b37-85bd-b638d3293568 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:41.065063 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966cba0-4071-49a6-8ac0-0cc919673de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:41.066670 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966cba0-4071-49a6-8ac0-0cc919673de0 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:41.067065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966cba0-4071-49a6-8ac0-0cc919673de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:41.067398 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966cba0-4071-49a6-8ac0-0cc919673de0 None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:41.068383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966cba0-4071-49a6-8ac0-0cc919673de0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:41.068873 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966cba0-4071-49a6-8ac0-0cc919673de0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:41.070720 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966cba0-4071-49a6-8ac0-0cc919673de0 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:41.090903 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 292/596] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:06:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:41.091625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966cba0-4071-49a6-8ac0-0cc919673de0 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:41.193597 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:41.248734 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f622dd7-f367-4b37-85bd-b638d3293568 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:41.258769 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966cba0-4071-49a6-8ac0-0cc919673de0 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:41.297730 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466c6a0-8744-4f6e-b1a6-1f4e8cd44bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:41.298818 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466c6a0-8744-4f6e-b1a6-1f4e8cd44bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:41.299312 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466c6a0-8744-4f6e-b1a6-1f4e8cd44bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:41.299700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466c6a0-8744-4f6e-b1a6-1f4e8cd44bd1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:41.313958 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d519a-8120-49bf-bc0e-0fe20d9d9b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:41.315775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d519a-8120-49bf-bc0e-0fe20d9d9b9c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:41.315960 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466c6a0-8744-4f6e-b1a6-1f4e8cd44bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:41.316188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d519a-8120-49bf-bc0e-0fe20d9d9b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:41.316188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d519a-8120-49bf-bc0e-0fe20d9d9b9c None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:41.316188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d519a-8120-49bf-bc0e-0fe20d9d9b9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:41.317272 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d519a-8120-49bf-bc0e-0fe20d9d9b9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:41.318319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466c6a0-8744-4f6e-b1a6-1f4e8cd44bd1 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:41.319293 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d519a-8120-49bf-bc0e-0fe20d9d9b9c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:41.335619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-8466c6a0-8744-4f6e-b1a6-1f4e8cd44bd1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 01:06:41.335619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:41.335619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:41.335619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:41.335619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:41.335619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:41.335619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:41.335619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:41.335619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:41.335619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:41.335619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:41.335619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:41.335619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:06:41.335619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:06:41.335619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:06:41.335619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:06:41.344749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:41.344749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:41.344749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:06:41.344749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:41.344749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:06:41.344749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:41.344749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:41.344749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:41.344749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:41.344749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:41.344749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:41.344749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:41.344749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:41.344749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:41.344749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:41.344749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:41.344749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:41.344749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:41.346767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:41.346767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:41.346767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:06:41.346767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:06:41.346767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:06:41.346767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:06:41.346767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:06:41.346767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:06:41.346767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 01:06:41.346767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:41.347926 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 293/597] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:06:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:41.348073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 305/598] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:06:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:41.348232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d519a-8120-49bf-bc0e-0fe20d9d9b9c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:41.348377 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466c6a0-8744-4f6e-b1a6-1f4e8cd44bd1 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:41.419854 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:41.533492 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466c6a0-8744-4f6e-b1a6-1f4e8cd44bd1 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:41.536676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d519a-8120-49bf-bc0e-0fe20d9d9b9c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:41.576240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:41.584675 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b72107-1958-4237-8ded-f56c2d6f81c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:41.585723 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b72107-1958-4237-8ded-f56c2d6f81c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:41.586121 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b72107-1958-4237-8ded-f56c2d6f81c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:41.586505 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b72107-1958-4237-8ded-f56c2d6f81c6 None admin] PATH_INFO: `/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/824648d693af4b44ae5df853a3d258f5/roles/2e8d92bd39634bbdad03d67d3fc439f0` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:41.605904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b72107-1958-4237-8ded-f56c2d6f81c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=78d0895fea004a02b1d8338f5fb0250c, user_id=824648d693af4b44ae5df853a3d258f5, role_id=2e8d92bd39634bbdad03d67d3fc439f0)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:41.607348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309df834-13ae-4010-bb69-676a9c43c7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:41.608105 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b72107-1958-4237-8ded-f56c2d6f81c6 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:41.608482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309df834-13ae-4010-bb69-676a9c43c7ed None admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:41.608803 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309df834-13ae-4010-bb69-676a9c43c7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:41.609244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309df834-13ae-4010-bb69-676a9c43c7ed None admin] PATH_INFO: `/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/f5b3a7a9a08e40718980143d7c4880ff/roles/2e8d92bd39634bbdad03d67d3fc439f0` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:41.632038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309df834-13ae-4010-bb69-676a9c43c7ed None admin] RBAC: Authorizing `identity:create_grant(project_id=78d0895fea004a02b1d8338f5fb0250c, user_id=f5b3a7a9a08e40718980143d7c4880ff, role_id=2e8d92bd39634bbdad03d67d3fc439f0)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:41.633769 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309df834-13ae-4010-bb69-676a9c43c7ed None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:41.687662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 306/599] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:06:41 2022] PUT /identity/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/824648d693af4b44ae5df853a3d258f5/roles/2e8d92bd39634bbdad03d67d3fc439f0 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:06:41.688546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b72107-1958-4237-8ded-f56c2d6f81c6 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:41.746644 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 294/600] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:06:41 2022] PUT /identity/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/f5b3a7a9a08e40718980143d7c4880ff/roles/2e8d92bd39634bbdad03d67d3fc439f0 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:06:41.746644 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309df834-13ae-4010-bb69-676a9c43c7ed None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:41.926064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b72107-1958-4237-8ded-f56c2d6f81c6 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:41.966330 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:41.992995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309df834-13ae-4010-bb69-676a9c43c7ed None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:42.022040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61916116-9a70-4555-ae67-ad591db38e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:42.023111 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61916116-9a70-4555-ae67-ad591db38e26 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:42.023622 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61916116-9a70-4555-ae67-ad591db38e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:42.024115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61916116-9a70-4555-ae67-ad591db38e26 None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:42.025592 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61916116-9a70-4555-ae67-ad591db38e26 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:42.026156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61916116-9a70-4555-ae67-ad591db38e26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:42.029066 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61916116-9a70-4555-ae67-ad591db38e26 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:42.062393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f938be-b82a-45f8-9cfe-314726173be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:42.063189 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f938be-b82a-45f8-9cfe-314726173be8 None admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:42.063464 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f938be-b82a-45f8-9cfe-314726173be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:42.063734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f938be-b82a-45f8-9cfe-314726173be8 None admin] PATH_INFO: `/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/9f71db705b08460996a729a88c82bb63/roles/2e8d92bd39634bbdad03d67d3fc439f0` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:42.064541 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 307/601] 10.222.0.83 () {56 vars in 1139 bytes} [Fri Sep 23 01:06:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:42.070801 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18992364-7944-4745-882e-f6246d462f31 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:42.070801 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18992364-7944-4745-882e-f6246d462f31 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:42.070801 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18992364-7944-4745-882e-f6246d462f31 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:42.070801 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 308/602] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:42.074782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18992364-7944-4745-882e-f6246d462f31 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:42.110149 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f938be-b82a-45f8-9cfe-314726173be8 None admin] RBAC: Authorizing `identity:create_grant(project_id=78d0895fea004a02b1d8338f5fb0250c, user_id=9f71db705b08460996a729a88c82bb63, role_id=2e8d92bd39634bbdad03d67d3fc439f0)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:42.113933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f938be-b82a-45f8-9cfe-314726173be8 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:42.130629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:42.230709 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18992364-7944-4745-882e-f6246d462f31 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:42.260385 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 295/603] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:06:41 2022] PUT /identity/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/9f71db705b08460996a729a88c82bb63/roles/2e8d92bd39634bbdad03d67d3fc439f0 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:06:42.262030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ebeeb-bee3-4f55-b548-c6adb1e2c3ca None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:42.262310 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ebeeb-bee3-4f55-b548-c6adb1e2c3ca None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:42.262662 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ebeeb-bee3-4f55-b548-c6adb1e2c3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:42.291548 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-580ebeeb-bee3-4f55-b548-c6adb1e2c3ca None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:42.292914 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-580ebeeb-bee3-4f55-b548-c6adb1e2c3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:42.296753 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a2d23-2543-4337-91cc-862e31c41735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:42.297979 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a2d23-2543-4337-91cc-862e31c41735 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:42.298551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a2d23-2543-4337-91cc-862e31c41735 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:42.299132 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a2d23-2543-4337-91cc-862e31c41735 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:42.320422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a2d23-2543-4337-91cc-862e31c41735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:42.323683 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a2d23-2543-4337-91cc-862e31c41735 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:42.355677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-9f8a2d23-2543-4337-91cc-862e31c41735 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:42.355677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:42.355677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:42.355677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:42.355677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:42.355677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:42.355677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:42.355677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:42.355677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:42.355677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:42.355677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:42.355677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:42.355677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:42.355677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:42.355677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:42.355677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:42.357019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:42.357019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:42.357019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:42.357019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:42.357019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:42.357019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:42.357019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:42.357019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:42.357019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:42.357019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:42.357019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:42.357019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:42.357019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:42.357019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:42.357019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:42.357019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:42.357019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:42.358220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:42.358220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:42.358220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:42.360729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 309/604] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:06:42.368201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a2d23-2543-4337-91cc-862e31c41735 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:42.460202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 296/605] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:42.587027 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:42.612209 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a2d23-2543-4337-91cc-862e31c41735 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:42.684553 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a202f-8f0d-4255-8c2b-637b5459c73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:42.685662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a202f-8f0d-4255-8c2b-637b5459c73e None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:42.686151 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a202f-8f0d-4255-8c2b-637b5459c73e None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:42.686661 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a202f-8f0d-4255-8c2b-637b5459c73e None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:42.687819 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a202f-8f0d-4255-8c2b-637b5459c73e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:42.688347 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a202f-8f0d-4255-8c2b-637b5459c73e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:42.691079 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a202f-8f0d-4255-8c2b-637b5459c73e None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:42.715861 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 310/606] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:06:42.721996 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ebeeb-bee3-4f55-b548-c6adb1e2c3ca None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:42.841251 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:42.891243 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ebeeb-bee3-4f55-b548-c6adb1e2c3ca None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:42.899060 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a202f-8f0d-4255-8c2b-637b5459c73e None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:42.976627 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb083777-cd65-49e8-b5fc-e34173b27793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:42.977123 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb083777-cd65-49e8-b5fc-e34173b27793 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:42.977387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb083777-cd65-49e8-b5fc-e34173b27793 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:42.977649 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb083777-cd65-49e8-b5fc-e34173b27793 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:42.993056 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb083777-cd65-49e8-b5fc-e34173b27793 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:42.994646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb083777-cd65-49e8-b5fc-e34173b27793 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:43.025504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-fb083777-cd65-49e8-b5fc-e34173b27793 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:43.025504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:43.025504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:43.025504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:43.025504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:43.025504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:43.025504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:43.025504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:43.025504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:43.025504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:43.025504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:43.025504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:43.025504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:06:43.025504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:06:43.025504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:06:43.027700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:06:43.027700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:43.027700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:43.027700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:43.027700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:43.027700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:43.027700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:43.027700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:43.027700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:43.027700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:43.027700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:43.027700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:43.027700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:43.027700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:43.027700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:43.027700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:43.027700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:43.029698 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:06:43.029698 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:06:43.029698 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:06:43.029698 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:06:43.029698 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:06:43.029698 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:06:43.029698 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:43.029698 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:43.029698 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 297/607] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:43.033684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb083777-cd65-49e8-b5fc-e34173b27793 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:43.136594 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a202f-8f0d-4255-8c2b-637b5459c73e None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:43.221016 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd69b1d-3856-4e0d-9763-5724ee9e4142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:43.221669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd69b1d-3856-4e0d-9763-5724ee9e4142 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:43.221981 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd69b1d-3856-4e0d-9763-5724ee9e4142 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:43.222813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd69b1d-3856-4e0d-9763-5724ee9e4142 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:43.244545 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd69b1d-3856-4e0d-9763-5724ee9e4142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:43.250487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-9bd69b1d-3856-4e0d-9763-5724ee9e4142 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:43.250487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:43.250487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:43.250487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:43.250487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:43.250487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:43.250487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:43.250487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:43.250487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:43.250487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:43.250487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:43.250487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:43.250487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:43.250487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:43.250487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:43.250487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:43.252361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:43.252361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:43.252361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:43.252361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:43.252361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:43.252361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:43.252361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:43.252361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:43.252361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:43.252361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:43.252361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:43.252361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:43.252361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:43.252361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:43.252361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:43.252361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:43.254501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:43.254501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:43.254501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:43.254501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:43.254501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:43.254501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:43.254501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:43.254501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:43.254501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:43.254501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:43.254501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:43.254501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:43.262468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 311/608] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:06:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:43.270956 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd69b1d-3856-4e0d-9763-5724ee9e4142 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:43.280145 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb083777-cd65-49e8-b5fc-e34173b27793 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:43.295831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:43.377531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:43.400211 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd69b1d-3856-4e0d-9763-5724ee9e4142 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:43.401745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d043a9-3a97-4286-976b-8ddadce44d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:43.402929 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d043a9-3a97-4286-976b-8ddadce44d30 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:43.403480 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d043a9-3a97-4286-976b-8ddadce44d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:43.404573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d043a9-3a97-4286-976b-8ddadce44d30 None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:43.405396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d043a9-3a97-4286-976b-8ddadce44d30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:43.406009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d043a9-3a97-4286-976b-8ddadce44d30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:43.408899 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d043a9-3a97-4286-976b-8ddadce44d30 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:43.443693 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61831e00-b78e-4067-8ba2-1f528dc20509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:43.444653 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61831e00-b78e-4067-8ba2-1f528dc20509 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:43.445147 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61831e00-b78e-4067-8ba2-1f528dc20509 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:43.445655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61831e00-b78e-4067-8ba2-1f528dc20509 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:43.447010 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61831e00-b78e-4067-8ba2-1f528dc20509 None admin] RBAC: Adding query filter params (name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:43.447537 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61831e00-b78e-4067-8ba2-1f528dc20509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:43.449150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61831e00-b78e-4067-8ba2-1f528dc20509 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:43.461037 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 298/609] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:06:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:43.465382 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 312/610] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:06:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:06:43.472711 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d043a9-3a97-4286-976b-8ddadce44d30 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:43.473169 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61831e00-b78e-4067-8ba2-1f528dc20509 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:43.604385 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d043a9-3a97-4286-976b-8ddadce44d30 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:43.650878 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:43.659038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb53cbd-49c1-4892-81a5-e3dd8200d6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:43.659736 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb53cbd-49c1-4892-81a5-e3dd8200d6fb None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:43.660122 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb53cbd-49c1-4892-81a5-e3dd8200d6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:43.660395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb53cbd-49c1-4892-81a5-e3dd8200d6fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:43.687528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb53cbd-49c1-4892-81a5-e3dd8200d6fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:43.687974 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61831e00-b78e-4067-8ba2-1f528dc20509 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:43.689800 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb53cbd-49c1-4892-81a5-e3dd8200d6fb None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:43.723639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-5fb53cbd-49c1-4892-81a5-e3dd8200d6fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:43.723639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:43.723639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:43.723639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:43.723639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:43.723639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:43.723639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:43.723639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:43.723639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:43.723639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:43.723639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:43.723639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:43.723639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:43.723639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:43.723639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:43.723639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:43.725498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:43.725498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:43.725498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:43.725498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:43.725498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:43.725498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:43.725498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:43.725498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:43.725498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:43.725498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:43.725498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:43.725498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:43.725498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:43.725498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:43.725498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:43.725498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:43.725498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:43.726552 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:43.726552 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:43.726552 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:43.732614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 299/611] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:43.735970 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f235a1e-9b74-4241-925a-6f64624f79e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:43.736655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f235a1e-9b74-4241-925a-6f64624f79e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:43.736939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f235a1e-9b74-4241-925a-6f64624f79e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:43.737212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f235a1e-9b74-4241-925a-6f64624f79e8 None admin] PATH_INFO: `/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/be2b2806686c4a15b1ace8b6245c4e28/roles/2e8d92bd39634bbdad03d67d3fc439f0` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:43.739269 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb53cbd-49c1-4892-81a5-e3dd8200d6fb None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:43.773401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f235a1e-9b74-4241-925a-6f64624f79e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=78d0895fea004a02b1d8338f5fb0250c, user_id=be2b2806686c4a15b1ace8b6245c4e28, role_id=2e8d92bd39634bbdad03d67d3fc439f0)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:43.775050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f235a1e-9b74-4241-925a-6f64624f79e8 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:43.820662 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:43.877851 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 313/612] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:06:43 2022] PUT /identity/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/be2b2806686c4a15b1ace8b6245c4e28/roles/2e8d92bd39634bbdad03d67d3fc439f0 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:06:43.967853 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb53cbd-49c1-4892-81a5-e3dd8200d6fb None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:44.053559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb4306-62b6-4191-aac9-36f9fd734a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:44.054652 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb4306-62b6-4191-aac9-36f9fd734a37 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:44.055140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb4306-62b6-4191-aac9-36f9fd734a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:44.055575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb4306-62b6-4191-aac9-36f9fd734a37 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:44.056734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb4306-62b6-4191-aac9-36f9fd734a37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:44.057280 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb4306-62b6-4191-aac9-36f9fd734a37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:44.060017 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb4306-62b6-4191-aac9-36f9fd734a37 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:44.092881 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 300/613] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:44.101895 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f235a1e-9b74-4241-925a-6f64624f79e8 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:44.304840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f235a1e-9b74-4241-925a-6f64624f79e8 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:44.350606 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:44.370523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2282d-efc6-4f69-8509-a99608ef305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:44.371589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2282d-efc6-4f69-8509-a99608ef305b None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:44.372070 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2282d-efc6-4f69-8509-a99608ef305b None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:44.373744 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2282d-efc6-4f69-8509-a99608ef305b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:44.387513 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2282d-efc6-4f69-8509-a99608ef305b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:44.390311 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2282d-efc6-4f69-8509-a99608ef305b None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:44.416037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-87e2282d-efc6-4f69-8509-a99608ef305b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 01:06:44.416037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:44.416037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:44.416037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:44.416037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:44.416037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:44.416037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:44.416037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:44.416037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:44.416037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:44.416037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:44.416037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:44.416037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:06:44.416037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:06:44.416037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:06:44.416037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:06:44.420328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:44.420328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:44.420328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:06:44.420328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:44.420328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:06:44.420328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:44.420328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:44.420328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:44.420328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:44.420328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:44.420328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:44.420328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:44.420328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:44.420328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:44.420328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:44.420328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:44.420328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:44.420328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:44.421463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:44.421463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:44.421463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:06:44.421463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:06:44.421463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:06:44.421463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:06:44.421463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:06:44.421463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:06:44.421463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 23 01:06:44.421463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:44.421463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 314/614] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:06:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:44.426895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb4306-62b6-4191-aac9-36f9fd734a37 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:44.606511 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb4306-62b6-4191-aac9-36f9fd734a37 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:44.612192 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:44.662201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50452dc6-0903-4c6d-84a3-21ed9437dd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:44.662867 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50452dc6-0903-4c6d-84a3-21ed9437dd4b None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:44.663236 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50452dc6-0903-4c6d-84a3-21ed9437dd4b None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:44.663509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50452dc6-0903-4c6d-84a3-21ed9437dd4b None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:44.664369 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50452dc6-0903-4c6d-84a3-21ed9437dd4b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:44.664677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50452dc6-0903-4c6d-84a3-21ed9437dd4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:44.666202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50452dc6-0903-4c6d-84a3-21ed9437dd4b None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:44.694612 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 301/615] 10.222.0.83 () {56 vars in 1135 bytes} [Fri Sep 23 01:06:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:44.702850 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2282d-efc6-4f69-8509-a99608ef305b None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:44.896785 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2282d-efc6-4f69-8509-a99608ef305b None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:44.965767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d19e2-f0b2-412e-999b-20c0e0ee3669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:44.967094 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d19e2-f0b2-412e-999b-20c0e0ee3669 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:44.967601 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d19e2-f0b2-412e-999b-20c0e0ee3669 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:44.968535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d19e2-f0b2-412e-999b-20c0e0ee3669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:44.995935 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d19e2-f0b2-412e-999b-20c0e0ee3669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:44.999265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d19e2-f0b2-412e-999b-20c0e0ee3669 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:45.027772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-fe8d19e2-f0b2-412e-999b-20c0e0ee3669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:45.027772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:45.027772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:45.027772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:45.027772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:45.027772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:45.027772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:45.027772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:45.027772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:45.027772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:45.027772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:45.027772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:45.027772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:45.027772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:45.027772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:45.027772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:45.029292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:45.029292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:45.029292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:45.029292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:45.029292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:45.029292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:45.029292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:45.029292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:45.029292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:45.029292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:45.029292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:45.029292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:45.029292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:45.029292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:45.029292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:45.029292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:45.029292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:45.031112 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:45.031112 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:45.031112 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:45.035355 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 315/616] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:06:45.041862 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50452dc6-0903-4c6d-84a3-21ed9437dd4b None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:45.102073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf8d5e-b4df-4193-b472-5773de573fe9 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:45.103182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf8d5e-b4df-4193-b472-5773de573fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:45.104046 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf8d5e-b4df-4193-b472-5773de573fe9 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:45.111204 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 316/617] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:45 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:45.118350 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8929991-a622-41ed-a917-6d440db4aea7 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:45.119476 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8929991-a622-41ed-a917-6d440db4aea7 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:45.120240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8929991-a622-41ed-a917-6d440db4aea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:45.164099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-a8929991-a622-41ed-a917-6d440db4aea7 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:45.165230 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a8929991-a622-41ed-a917-6d440db4aea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:45.188370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50452dc6-0903-4c6d-84a3-21ed9437dd4b None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:45.214779 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:45.273241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa47399-6bdb-4df4-b18c-f4957217bbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:45.273859 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa47399-6bdb-4df4-b18c-f4957217bbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:45.274930 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa47399-6bdb-4df4-b18c-f4957217bbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:45.275237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa47399-6bdb-4df4-b18c-f4957217bbf1 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:45.275918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa47399-6bdb-4df4-b18c-f4957217bbf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:45.276220 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa47399-6bdb-4df4-b18c-f4957217bbf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:45.277735 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa47399-6bdb-4df4-b18c-f4957217bbf1 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:45.297603 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 317/618] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:06:45.301252 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 302/619] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:06:45.307359 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8929991-a622-41ed-a917-6d440db4aea7 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:45.328343 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d89286-db12-4a9c-b6fc-1deba6f9531d None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:45.328772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d89286-db12-4a9c-b6fc-1deba6f9531d None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:45.329141 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d89286-db12-4a9c-b6fc-1deba6f9531d None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:45.336006 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 303/620] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:45.337820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718828d-f4ce-47c2-badd-2523878c442a None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:45.338285 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718828d-f4ce-47c2-badd-2523878c442a None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:45.338744 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718828d-f4ce-47c2-badd-2523878c442a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:45.360239 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-d718828d-f4ce-47c2-badd-2523878c442a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:45.361689 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d718828d-f4ce-47c2-badd-2523878c442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:45.388494 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:45.524468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8929991-a622-41ed-a917-6d440db4aea7 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:45.573587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 304/621] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:45.608024 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb8f5c-60b1-46fa-91de-533659884d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:45.609308 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb8f5c-60b1-46fa-91de-533659884d56 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:45.609849 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb8f5c-60b1-46fa-91de-533659884d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:45.610369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb8f5c-60b1-46fa-91de-533659884d56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:45.625307 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb8f5c-60b1-46fa-91de-533659884d56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:45.626842 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb8f5c-60b1-46fa-91de-533659884d56 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:45.640507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-75cb8f5c-60b1-46fa-91de-533659884d56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:45.640507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:45.640507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:45.640507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:45.640507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:45.640507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:45.640507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:45.640507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:45.640507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:45.640507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:45.640507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:45.640507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:45.640507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:06:45.640507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:06:45.640507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:06:45.642234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:06:45.642234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:45.642234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:45.642234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:45.642234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:45.642234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:45.642234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:45.642234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:45.642234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:45.642234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:45.642234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:45.642234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:45.642234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:45.642234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:45.642234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:45.642234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:45.642234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:45.644015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:06:45.644015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:06:45.644015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:06:45.644015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:06:45.644015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:06:45.644015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:06:45.644015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:45.644015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:45.644015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 318/622] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:45.648954 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718828d-f4ce-47c2-badd-2523878c442a None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:45.672390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b21ea7-265c-468c-9460-7d23e0abcfa5 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:45.672753 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b21ea7-265c-468c-9460-7d23e0abcfa5 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:45.672954 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b21ea7-265c-468c-9460-7d23e0abcfa5 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:45.674511 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 319/623] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:06:45.681774 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a83f61-2439-4800-ab0d-10e39d99642e None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:45.681774 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a83f61-2439-4800-ab0d-10e39d99642e None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:45.681774 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a83f61-2439-4800-ab0d-10e39d99642e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:45.705445 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-93a83f61-2439-4800-ab0d-10e39d99642e None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:45.707109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-93a83f61-2439-4800-ab0d-10e39d99642e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:45.728918 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:45.846720 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 320/624] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:06:45.846720 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a83f61-2439-4800-ab0d-10e39d99642e None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:45.935157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718828d-f4ce-47c2-badd-2523878c442a None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:46.022142 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48667d89-356c-45b4-a72b-f468684cae2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:46.022786 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48667d89-356c-45b4-a72b-f468684cae2d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:46.023075 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48667d89-356c-45b4-a72b-f468684cae2d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:46.023314 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48667d89-356c-45b4-a72b-f468684cae2d None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:46.024015 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48667d89-356c-45b4-a72b-f468684cae2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:46.024322 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48667d89-356c-45b4-a72b-f468684cae2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:46.025786 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48667d89-356c-45b4-a72b-f468684cae2d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:46.052756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 305/625] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:06:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:46.061475 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48667d89-356c-45b4-a72b-f468684cae2d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:46.072071 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a83f61-2439-4800-ab0d-10e39d99642e None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:46.113741 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:46.117902 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025e92d-b7db-473a-8de0-3286f7b4ec31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:46.119452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025e92d-b7db-473a-8de0-3286f7b4ec31 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:46.119767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025e92d-b7db-473a-8de0-3286f7b4ec31 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:46.120035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025e92d-b7db-473a-8de0-3286f7b4ec31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:46.149814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025e92d-b7db-473a-8de0-3286f7b4ec31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:46.156193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-4025e92d-b7db-473a-8de0-3286f7b4ec31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:46.156193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:46.156193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:46.156193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:46.156193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:46.156193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:46.156193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:46.156193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:46.156193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:46.156193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:46.156193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:46.156193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:46.156193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:46.156193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:46.156193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:46.156193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:46.157660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:46.157660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:46.157660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:46.157660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:46.157660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:46.157660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:46.157660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:46.157660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:46.157660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:46.157660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:46.157660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:46.157660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:46.157660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:46.157660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:46.157660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:46.157660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:46.160215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:46.160215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:46.160215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:46.160215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:46.160215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:46.160215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:46.160215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:46.160215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:46.160215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:46.160215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:46.160215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:46.160215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:46.160215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 321/626] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:06:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:46.175533 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025e92d-b7db-473a-8de0-3286f7b4ec31 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:46.202229 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:46.267133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48667d89-356c-45b4-a72b-f468684cae2d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:46.318171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025e92d-b7db-473a-8de0-3286f7b4ec31 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:46.326574 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a932b-2ef9-434e-b19c-1957485fe896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:46.328864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a932b-2ef9-434e-b19c-1957485fe896 None admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:46.329817 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a932b-2ef9-434e-b19c-1957485fe896 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:46.330421 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a932b-2ef9-434e-b19c-1957485fe896 None admin] PATH_INFO: `/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/c526c7ad227943d1a2bba7b5e2e039e0/roles/2e8d92bd39634bbdad03d67d3fc439f0` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:46.356742 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a932b-2ef9-434e-b19c-1957485fe896 None admin] RBAC: Authorizing `identity:create_grant(project_id=78d0895fea004a02b1d8338f5fb0250c, user_id=c526c7ad227943d1a2bba7b5e2e039e0, role_id=2e8d92bd39634bbdad03d67d3fc439f0)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:46.358996 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a932b-2ef9-434e-b19c-1957485fe896 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:46.372355 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb01fa-eee4-4ad1-9766-190232121c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:46.373958 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb01fa-eee4-4ad1-9766-190232121c8d None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:46.374970 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb01fa-eee4-4ad1-9766-190232121c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:46.375764 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb01fa-eee4-4ad1-9766-190232121c8d None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:46.383638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb01fa-eee4-4ad1-9766-190232121c8d None admin] RBAC: Adding query filter params (name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:46.383638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb01fa-eee4-4ad1-9766-190232121c8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:46.383638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb01fa-eee4-4ad1-9766-190232121c8d None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:46.397741 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 322/627] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:06:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:06:46.399280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb01fa-eee4-4ad1-9766-190232121c8d None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:46.465054 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 306/628] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:06:46 2022] PUT /identity/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/c526c7ad227943d1a2bba7b5e2e039e0/roles/2e8d92bd39634bbdad03d67d3fc439f0 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:06:46.466000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a932b-2ef9-434e-b19c-1957485fe896 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:46.556460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:46.563886 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:46.601317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb01fa-eee4-4ad1-9766-190232121c8d None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:46.613419 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a932b-2ef9-434e-b19c-1957485fe896 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:46.658465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ceb50a-5883-43f6-9ec2-0728fc8efc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:46.659302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ceb50a-5883-43f6-9ec2-0728fc8efc07 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:46.659773 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ceb50a-5883-43f6-9ec2-0728fc8efc07 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:46.660224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ceb50a-5883-43f6-9ec2-0728fc8efc07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:46.664660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9377c-e137-4371-924c-772d26c3fd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:46.665758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9377c-e137-4371-924c-772d26c3fd51 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:46.666228 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9377c-e137-4371-924c-772d26c3fd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:46.666909 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9377c-e137-4371-924c-772d26c3fd51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:46.676554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ceb50a-5883-43f6-9ec2-0728fc8efc07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:46.683966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9377c-e137-4371-924c-772d26c3fd51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:46.684172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-d2ceb50a-5883-43f6-9ec2-0728fc8efc07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:46.684172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:46.684172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:46.684172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:46.684172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:46.684172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:46.684172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:46.684172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:46.684172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:46.684172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:46.684172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:46.684172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:46.684172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:46.684172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:46.684172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:46.684172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:46.685471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:46.685471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:46.685471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:46.685471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:46.685471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:46.685471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:46.685471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:46.685471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:46.685471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:46.685471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:46.685471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:46.685471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:46.685471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:46.685471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:46.685471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:46.685471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:46.686662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:46.686662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:46.686662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:46.686662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:46.686662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:46.686662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:46.686662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:46.686662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:46.686662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:46.686662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:46.686662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:46.686662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:46.692293 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 323/629] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:06:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:46.692855 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ceb50a-5883-43f6-9ec2-0728fc8efc07 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:46.695582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-e8f9377c-e137-4371-924c-772d26c3fd51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:46.695582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:46.695582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:46.695582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:46.695582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:46.695582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:46.695582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:46.695582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:46.695582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:46.695582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:46.695582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:46.695582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:46.695582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:46.695582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:46.695582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:46.695582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:46.697130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:46.697130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:46.697130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:46.697130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:46.697130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:46.697130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:46.697130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:46.697130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:46.697130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:46.697130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:46.697130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:46.697130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:46.697130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:46.697130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:46.697130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:46.697130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:46.698016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:46.698016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:46.698016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:46.698016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:46.698016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:46.698016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:46.698016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:46.698016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:46.698016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:46.698016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:46.698016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:46.698016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:46.701534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 307/630] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:06:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:46.702859 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9377c-e137-4371-924c-772d26c3fd51 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:46.848767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ceb50a-5883-43f6-9ec2-0728fc8efc07 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:46.871390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9377c-e137-4371-924c-772d26c3fd51 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:46.904633 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4accb970-e807-4e78-878f-0c25eae8a85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:46.905471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accb970-e807-4e78-878f-0c25eae8a85a None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:46.905675 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accb970-e807-4e78-878f-0c25eae8a85a None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:46.906001 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accb970-e807-4e78-878f-0c25eae8a85a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:46.910579 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:46.919513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:46.921168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4accb970-e807-4e78-878f-0c25eae8a85a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:46.922703 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4accb970-e807-4e78-878f-0c25eae8a85a None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:46.938168 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f8cf0-60d1-45d2-a874-bd311b1e92a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:46.939041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f8cf0-60d1-45d2-a874-bd311b1e92a1 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:46.939497 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f8cf0-60d1-45d2-a874-bd311b1e92a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:46.939938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f8cf0-60d1-45d2-a874-bd311b1e92a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:46.941074 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f8cf0-60d1-45d2-a874-bd311b1e92a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:46.941576 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f8cf0-60d1-45d2-a874-bd311b1e92a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:46.944027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f8cf0-60d1-45d2-a874-bd311b1e92a1 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:46.947699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-4accb970-e807-4e78-878f-0c25eae8a85a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:46.947699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:46.947699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:46.947699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:46.947699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:46.947699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:46.947699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:46.947699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:46.947699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:46.947699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:46.947699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:46.947699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:46.947699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:46.947699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:46.947699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:46.947699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:46.949423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:46.949423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:46.949423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:46.949423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:46.949423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:46.949423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:46.949423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:46.949423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:46.949423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:46.949423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:46.949423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:46.949423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:46.949423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:46.949423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:46.949423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:46.949423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:46.949423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:46.952638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:46.952638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:46.952638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:46.952638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 324/631] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:46.952638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4accb970-e807-4e78-878f-0c25eae8a85a None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:46.958686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 308/632] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:06:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:46.959840 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f3fe5-f3db-4f68-8bc2-3703711b7609 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:46.960126 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f3fe5-f3db-4f68-8bc2-3703711b7609 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:46.960392 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f3fe5-f3db-4f68-8bc2-3703711b7609 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:46.965778 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 309/633] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:46.965778 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f3fe5-f3db-4f68-8bc2-3703711b7609 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:47.095421 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4accb970-e807-4e78-878f-0c25eae8a85a None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:47.121376 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f3fe5-f3db-4f68-8bc2-3703711b7609 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:47.159152 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa3a99-77a7-4dff-917c-d8202fb82b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:47.160882 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa3a99-77a7-4dff-917c-d8202fb82b16 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:47.161284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa3a99-77a7-4dff-917c-d8202fb82b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:47.161784 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa3a99-77a7-4dff-917c-d8202fb82b16 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:47.163104 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa3a99-77a7-4dff-917c-d8202fb82b16 None admin] RBAC: Adding query filter params (name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:47.163602 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa3a99-77a7-4dff-917c-d8202fb82b16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:47.166613 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa3a99-77a7-4dff-917c-d8202fb82b16 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:47.182244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f3c66-2b23-4e8f-a02f-972c9d44325d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:47.183237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f3c66-2b23-4e8f-a02f-972c9d44325d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:47.183702 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f3c66-2b23-4e8f-a02f-972c9d44325d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:47.184151 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f3c66-2b23-4e8f-a02f-972c9d44325d None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:47.184457 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 325/634] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:06:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:47.185360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f3c66-2b23-4e8f-a02f-972c9d44325d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:47.185887 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f3c66-2b23-4e8f-a02f-972c9d44325d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:47.186935 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767d30c-c2a3-4666-8a84-2769d3ba17f5 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:47.187443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767d30c-c2a3-4666-8a84-2769d3ba17f5 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:47.187918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f3c66-2b23-4e8f-a02f-972c9d44325d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:47.188053 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767d30c-c2a3-4666-8a84-2769d3ba17f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:47.209966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 310/635] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:47.211732 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f3c66-2b23-4e8f-a02f-972c9d44325d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:47.225036 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-4767d30c-c2a3-4666-8a84-2769d3ba17f5 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:47.227261 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4767d30c-c2a3-4666-8a84-2769d3ba17f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:47.308368 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:47.316590 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:47.356083 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 326/636] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:47.357056 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767d30c-c2a3-4666-8a84-2769d3ba17f5 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:47.388066 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f3c66-2b23-4e8f-a02f-972c9d44325d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:47.434406 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619b859-b378-40ba-9030-2e089325cf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:47.435193 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619b859-b378-40ba-9030-2e089325cf60 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:47.435305 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619b859-b378-40ba-9030-2e089325cf60 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:47.435511 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619b859-b378-40ba-9030-2e089325cf60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:47.453957 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619b859-b378-40ba-9030-2e089325cf60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:47.456409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619b859-b378-40ba-9030-2e089325cf60 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:47.482144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-5619b859-b378-40ba-9030-2e089325cf60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:47.482144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:47.482144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:47.482144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:47.482144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:47.482144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:47.482144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:47.482144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:47.482144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:47.482144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:47.482144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:47.482144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:47.482144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:47.482144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:47.482144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:47.482144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:47.483254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:47.483254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:47.483254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:47.483254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:47.483254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:47.483254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:47.483254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:47.483254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:47.483254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:47.483254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:47.483254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:47.483254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:47.483254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:47.483254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:47.483254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:47.483254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:47.483254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:47.484190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:47.484190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:47.484190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:47.484190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 311/637] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:47.484850 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619b859-b378-40ba-9030-2e089325cf60 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:47.528264 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767d30c-c2a3-4666-8a84-2769d3ba17f5 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:47.577413 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4b269-9844-43ad-99e4-7fd7f802cdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:47.579013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4b269-9844-43ad-99e4-7fd7f802cdcb None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:47.579977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4b269-9844-43ad-99e4-7fd7f802cdcb None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:47.580472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4b269-9844-43ad-99e4-7fd7f802cdcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:47.597085 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4b269-9844-43ad-99e4-7fd7f802cdcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:47.599316 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:47.600924 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4b269-9844-43ad-99e4-7fd7f802cdcb None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:47.606956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619b859-b378-40ba-9030-2e089325cf60 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:47.622868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-4fb4b269-9844-43ad-99e4-7fd7f802cdcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:47.622868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:47.622868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:47.622868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:47.622868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:47.622868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:47.622868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:47.622868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:47.622868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:47.622868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:47.622868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:47.622868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:47.622868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:47.622868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:47.622868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:47.622868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:47.624040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:47.624040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:47.624040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:47.624040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:47.624040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:47.624040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:47.624040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:47.624040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:47.624040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:47.624040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:47.624040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:47.624040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:47.624040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:47.624040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:47.624040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:47.624040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:47.624040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:47.625311 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:47.625311 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:47.625311 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:47.633486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 327/638] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:47.634975 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4b269-9844-43ad-99e4-7fd7f802cdcb None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:47.671654 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdf2b3-2f03-4f98-9bc9-bc2c4553fc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:47.672828 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdf2b3-2f03-4f98-9bc9-bc2c4553fc1c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:47.673329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdf2b3-2f03-4f98-9bc9-bc2c4553fc1c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:47.673724 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdf2b3-2f03-4f98-9bc9-bc2c4553fc1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:47.680602 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:47.696717 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdf2b3-2f03-4f98-9bc9-bc2c4553fc1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:47.696717 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdf2b3-2f03-4f98-9bc9-bc2c4553fc1c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:47.719417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-81fdf2b3-2f03-4f98-9bc9-bc2c4553fc1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 01:06:47.719417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:47.719417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:47.719417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:47.719417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:47.719417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:47.719417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:47.719417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:47.719417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:47.719417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:47.719417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:47.719417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:47.719417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:06:47.719417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:06:47.719417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:06:47.719417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:06:47.720444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:47.720444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:47.720444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:06:47.720444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:47.720444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:06:47.720444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:47.720444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:47.720444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:47.720444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:47.720444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:47.720444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:47.720444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:47.720444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:47.720444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:47.720444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:47.720444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:47.720444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:47.720444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:47.721393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:47.721393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:47.721393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:06:47.721393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:06:47.721393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:06:47.721393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:06:47.721393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:06:47.721393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:06:47.721393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 01:06:47.721393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:47.725925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 312/639] 10.222.0.83 () {56 vars in 1093 bytes} [Fri Sep 23 01:06:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:47.727289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdf2b3-2f03-4f98-9bc9-bc2c4553fc1c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:47.778287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4b269-9844-43ad-99e4-7fd7f802cdcb None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:47.825226 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a1eb9-8519-4a31-a38d-6bef3dbe1c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:47.826514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a1eb9-8519-4a31-a38d-6bef3dbe1c19 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:47.827063 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a1eb9-8519-4a31-a38d-6bef3dbe1c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:47.827811 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a1eb9-8519-4a31-a38d-6bef3dbe1c19 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:47.829146 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a1eb9-8519-4a31-a38d-6bef3dbe1c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:47.829671 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a1eb9-8519-4a31-a38d-6bef3dbe1c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:47.831291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a1eb9-8519-4a31-a38d-6bef3dbe1c19 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:47.850295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 328/640] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:47.851822 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a1eb9-8519-4a31-a38d-6bef3dbe1c19 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:47.891778 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdf2b3-2f03-4f98-9bc9-bc2c4553fc1c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:47.939910 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776b954-d84f-455c-83a3-2cf9ecc4c42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:47.940789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776b954-d84f-455c-83a3-2cf9ecc4c42c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:47.940789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776b954-d84f-455c-83a3-2cf9ecc4c42c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:47.941751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776b954-d84f-455c-83a3-2cf9ecc4c42c None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:47.942979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776b954-d84f-455c-83a3-2cf9ecc4c42c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:47.943488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776b954-d84f-455c-83a3-2cf9ecc4c42c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:47.945378 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776b954-d84f-455c-83a3-2cf9ecc4c42c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:47.959179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 313/641] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:47.960017 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776b954-d84f-455c-83a3-2cf9ecc4c42c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:47.994154 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:47.998165 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:48.006538 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a1eb9-8519-4a31-a38d-6bef3dbe1c19 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:48.063386 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cca3e-eda0-455e-8842-4b8e13d4f1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:48.063949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cca3e-eda0-455e-8842-4b8e13d4f1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:48.064231 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cca3e-eda0-455e-8842-4b8e13d4f1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:48.064495 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cca3e-eda0-455e-8842-4b8e13d4f1b3 None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:48.065232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cca3e-eda0-455e-8842-4b8e13d4f1b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:48.065571 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cca3e-eda0-455e-8842-4b8e13d4f1b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:48.067765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cca3e-eda0-455e-8842-4b8e13d4f1b3 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:48.096523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 329/642] 10.222.0.83 () {56 vars in 1133 bytes} [Fri Sep 23 01:06:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:48.098330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cca3e-eda0-455e-8842-4b8e13d4f1b3 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:48.152194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776b954-d84f-455c-83a3-2cf9ecc4c42c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:48.218651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58aabcb-4d91-41c0-bc09-29cae54d9a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:48.219212 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aabcb-4d91-41c0-bc09-29cae54d9a5b None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:48.219490 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aabcb-4d91-41c0-bc09-29cae54d9a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:48.219759 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aabcb-4d91-41c0-bc09-29cae54d9a5b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:48.229126 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58aabcb-4d91-41c0-bc09-29cae54d9a5b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:48.230699 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58aabcb-4d91-41c0-bc09-29cae54d9a5b None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:48.245745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-b58aabcb-4d91-41c0-bc09-29cae54d9a5b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 23 01:06:48.245745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:48.245745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:48.245745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:48.245745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:48.245745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:48.245745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:48.245745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:48.245745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:48.245745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:48.245745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:48.245745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:48.245745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:06:48.245745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:06:48.245745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:06:48.245745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:06:48.247973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:48.247973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:48.247973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:06:48.247973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:48.247973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:06:48.247973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:48.247973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:48.247973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:48.247973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:48.247973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:48.247973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:48.247973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:48.247973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:48.247973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:48.247973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:48.247973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:48.247973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:48.247973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:48.250453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:48.250453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:48.250453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:06:48.250453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:06:48.250453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:06:48.250453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:06:48.250453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:06:48.250453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:06:48.250453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 23 01:06:48.250453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:48.250453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 314/643] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:06:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:48.250453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58aabcb-4d91-41c0-bc09-29cae54d9a5b None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:48.293848 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cca3e-eda0-455e-8842-4b8e13d4f1b3 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:48.351864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:48.358571 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd9254-bd9a-4344-8656-07c1ea733239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:48.359633 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd9254-bd9a-4344-8656-07c1ea733239 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:48.360128 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd9254-bd9a-4344-8656-07c1ea733239 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:48.360514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd9254-bd9a-4344-8656-07c1ea733239 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:48.375665 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd9254-bd9a-4344-8656-07c1ea733239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:48.381536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-43bd9254-bd9a-4344-8656-07c1ea733239 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:48.381536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:48.381536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:48.381536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:48.381536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:48.381536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:48.381536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:48.381536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:48.381536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:48.381536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:48.381536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:48.381536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:48.381536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:48.381536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:48.381536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:48.381536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:48.383420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:48.383420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:48.383420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:48.383420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:48.383420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:48.383420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:48.383420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:48.383420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:48.383420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:48.383420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:48.383420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:48.383420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:48.383420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:48.383420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:48.383420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:48.383420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:48.385224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:48.385224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:48.385224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:48.385224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:48.385224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:48.385224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:48.385224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:48.385224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:48.385224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:48.385224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:48.385224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:48.385224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:48.387589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 330/644] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:06:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:48.388596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd9254-bd9a-4344-8656-07c1ea733239 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:48.399101 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58aabcb-4d91-41c0-bc09-29cae54d9a5b None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:48.413896 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:48.467034 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff302c-e455-4836-97ae-9668a1f05b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:48.468244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff302c-e455-4836-97ae-9668a1f05b0a None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:48.468754 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff302c-e455-4836-97ae-9668a1f05b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:48.469186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff302c-e455-4836-97ae-9668a1f05b0a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:48.482731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff302c-e455-4836-97ae-9668a1f05b0a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:48.484352 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff302c-e455-4836-97ae-9668a1f05b0a None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:48.499339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-9eff302c-e455-4836-97ae-9668a1f05b0a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 01:06:48.499339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:48.499339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:48.499339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:48.499339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:48.499339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:48.499339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:48.499339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:48.499339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:48.499339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:48.499339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:48.499339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:48.499339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:06:48.499339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:06:48.499339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:06:48.499339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:06:48.500387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:48.500387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:48.500387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:06:48.500387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:48.500387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:06:48.500387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:48.500387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:48.500387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:48.500387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:48.500387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:48.500387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:48.500387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:48.500387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:48.500387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:48.500387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:48.500387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:48.500387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:48.500387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:48.501390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:48.501390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:48.501390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:06:48.501390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:06:48.501390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:06:48.501390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:06:48.501390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:06:48.501390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:06:48.501390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 01:06:48.501390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:48.501390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 315/645] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:06:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:48.501980 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff302c-e455-4836-97ae-9668a1f05b0a None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:48.550923 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd9254-bd9a-4344-8656-07c1ea733239 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:48.602260 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c78de3-ca3c-4bc6-b80f-be274b3ad628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:48.602883 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c78de3-ca3c-4bc6-b80f-be274b3ad628 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:48.603163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c78de3-ca3c-4bc6-b80f-be274b3ad628 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:48.603436 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c78de3-ca3c-4bc6-b80f-be274b3ad628 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:48.650087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff302c-e455-4836-97ae-9668a1f05b0a None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:48.692843 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d08127-bdd0-4ab1-b975-35bffcd9fc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:48.693841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d08127-bdd0-4ab1-b975-35bffcd9fc9d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:48.694337 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d08127-bdd0-4ab1-b975-35bffcd9fc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:48.694872 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d08127-bdd0-4ab1-b975-35bffcd9fc9d None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:48.695918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d08127-bdd0-4ab1-b975-35bffcd9fc9d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:48.696647 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d08127-bdd0-4ab1-b975-35bffcd9fc9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:48.698652 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d08127-bdd0-4ab1-b975-35bffcd9fc9d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:48.702439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c78de3-ca3c-4bc6-b80f-be274b3ad628 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:48.702922 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:48.705226 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c78de3-ca3c-4bc6-b80f-be274b3ad628 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:48.760795 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 316/646] 10.222.0.83 () {56 vars in 1137 bytes} [Fri Sep 23 01:06:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:48.760795 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d08127-bdd0-4ab1-b975-35bffcd9fc9d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:48.761078 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:48.852748 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 331/647] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:06:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:06:48.858929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c78de3-ca3c-4bc6-b80f-be274b3ad628 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:48.879033 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d08127-bdd0-4ab1-b975-35bffcd9fc9d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:48.927636 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60680fe4-60a9-44a3-a8cc-6020bdf79241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:48.928604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60680fe4-60a9-44a3-a8cc-6020bdf79241 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:48.929103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60680fe4-60a9-44a3-a8cc-6020bdf79241 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:48.929599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60680fe4-60a9-44a3-a8cc-6020bdf79241 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:48.930677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60680fe4-60a9-44a3-a8cc-6020bdf79241 None admin] RBAC: Adding query filter params (name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:48.930990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60680fe4-60a9-44a3-a8cc-6020bdf79241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:48.933600 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60680fe4-60a9-44a3-a8cc-6020bdf79241 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:48.952725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 317/648] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:06:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:48.952725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60680fe4-60a9-44a3-a8cc-6020bdf79241 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:49.024009 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c78de3-ca3c-4bc6-b80f-be274b3ad628 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:49.044503 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:49.058089 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:49.083950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8424722-6f21-45c5-be10-f0d08a511328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:49.084765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8424722-6f21-45c5-be10-f0d08a511328 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:49.085226 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8424722-6f21-45c5-be10-f0d08a511328 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:49.085672 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8424722-6f21-45c5-be10-f0d08a511328 None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:49.086630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8424722-6f21-45c5-be10-f0d08a511328 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:49.087105 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8424722-6f21-45c5-be10-f0d08a511328 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:49.089094 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8424722-6f21-45c5-be10-f0d08a511328 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:49.124194 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 332/649] 10.222.0.83 () {56 vars in 1137 bytes} [Fri Sep 23 01:06:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:49.124514 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60680fe4-60a9-44a3-a8cc-6020bdf79241 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:49.124649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8424722-6f21-45c5-be10-f0d08a511328 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:49.170520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090a291-9e7b-4b35-8e86-52d0d69c3003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:49.171681 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090a291-9e7b-4b35-8e86-52d0d69c3003 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:49.172103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090a291-9e7b-4b35-8e86-52d0d69c3003 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:49.172331 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090a291-9e7b-4b35-8e86-52d0d69c3003 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:49.261537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090a291-9e7b-4b35-8e86-52d0d69c3003 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:49.263072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090a291-9e7b-4b35-8e86-52d0d69c3003 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:49.267817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8424722-6f21-45c5-be10-f0d08a511328 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:49.325734 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048882e-6888-44ea-8c12-9f12a394f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:49.326694 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048882e-6888-44ea-8c12-9f12a394f6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:49.327155 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048882e-6888-44ea-8c12-9f12a394f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:49.327635 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048882e-6888-44ea-8c12-9f12a394f6d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:49.329540 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:49.346185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048882e-6888-44ea-8c12-9f12a394f6d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:49.350234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048882e-6888-44ea-8c12-9f12a394f6d7 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:49.373518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-f048882e-6888-44ea-8c12-9f12a394f6d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:49.373518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:49.373518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:49.373518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:49.373518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:49.373518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:49.373518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:49.373518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:49.373518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:49.373518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:49.373518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:49.373518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:49.373518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:49.373518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:49.373518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:49.373518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:49.375201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:49.375201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:49.375201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:49.375201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:49.375201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:49.375201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:49.375201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:49.375201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:49.375201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:49.375201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:49.375201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:49.375201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:49.375201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:49.375201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:49.375201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:49.375201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:49.375201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:49.376274 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:49.376274 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:49.376274 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:49.376274 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 333/650] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:49.376274 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048882e-6888-44ea-8c12-9f12a394f6d7 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:49.388224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 318/651] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:06:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:06:49.389461 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090a291-9e7b-4b35-8e86-52d0d69c3003 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:49.405983 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:49.503776 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048882e-6888-44ea-8c12-9f12a394f6d7 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:49.536997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090a291-9e7b-4b35-8e86-52d0d69c3003 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:49.558244 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4f7d3-a0f3-4c87-bee9-6cd8ee7a175a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:49.559335 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4f7d3-a0f3-4c87-bee9-6cd8ee7a175a None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:49.559825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4f7d3-a0f3-4c87-bee9-6cd8ee7a175a None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:49.560374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4f7d3-a0f3-4c87-bee9-6cd8ee7a175a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:49.577694 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4f7d3-a0f3-4c87-bee9-6cd8ee7a175a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:49.579382 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4f7d3-a0f3-4c87-bee9-6cd8ee7a175a None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:49.580034 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153d063-50c1-4a23-ba7e-d56deda3467a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:49.580708 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153d063-50c1-4a23-ba7e-d56deda3467a None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:49.580987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153d063-50c1-4a23-ba7e-d56deda3467a None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:49.581256 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153d063-50c1-4a23-ba7e-d56deda3467a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:49.596944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-fcb4f7d3-a0f3-4c87-bee9-6cd8ee7a175a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:49.596944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:49.596944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:49.596944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:49.596944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:49.596944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:49.596944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:49.596944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:49.596944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:49.596944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:49.596944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:49.596944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:49.596944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:49.596944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:49.596944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:49.596944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:49.605026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:49.605026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:49.605026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:49.605026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:49.605026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:49.605026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:49.605026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:49.605026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:49.605026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:49.605026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:49.605026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:49.605026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:49.605026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:49.605026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:49.605026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:49.605026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:49.605026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:49.607273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:49.607273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:49.607273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:49.607273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 334/652] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:49.607273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d692b23-d521-499e-9e54-88f30f92264e None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:49.607273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d692b23-d521-499e-9e54-88f30f92264e None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:49.607273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d692b23-d521-499e-9e54-88f30f92264e None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:49.607273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 335/653] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:49.607273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d692b23-d521-499e-9e54-88f30f92264e None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:49.618796 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:49.669347 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153d063-50c1-4a23-ba7e-d56deda3467a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:49.672064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153d063-50c1-4a23-ba7e-d56deda3467a None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:49.688471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:49.738071 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d692b23-d521-499e-9e54-88f30f92264e None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:49.788038 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475c097-0103-4303-ae37-255434437fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:49.788671 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475c097-0103-4303-ae37-255434437fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:49.788948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475c097-0103-4303-ae37-255434437fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:49.789222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475c097-0103-4303-ae37-255434437fd6 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:49.789898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475c097-0103-4303-ae37-255434437fd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:49.790204 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475c097-0103-4303-ae37-255434437fd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:49.791713 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475c097-0103-4303-ae37-255434437fd6 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:49.809479 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 336/654] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:49.811100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475c097-0103-4303-ae37-255434437fd6 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:49.818223 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 319/655] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:06:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:06:49.820029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153d063-50c1-4a23-ba7e-d56deda3467a None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:49.915019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:49.967607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153d063-50c1-4a23-ba7e-d56deda3467a None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:49.985306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475c097-0103-4303-ae37-255434437fd6 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:50.016295 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404158a-dfd5-4dbd-b457-66d375486aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:50.016914 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404158a-dfd5-4dbd-b457-66d375486aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:50.017202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404158a-dfd5-4dbd-b457-66d375486aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:50.017452 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404158a-dfd5-4dbd-b457-66d375486aa8 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:50.018169 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404158a-dfd5-4dbd-b457-66d375486aa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:50.018474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404158a-dfd5-4dbd-b457-66d375486aa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:50.020471 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404158a-dfd5-4dbd-b457-66d375486aa8 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:50.033259 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 320/656] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:50.034534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653af438-0887-40fe-b922-5cfde600a7b7 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:50.035532 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653af438-0887-40fe-b922-5cfde600a7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:50.036005 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653af438-0887-40fe-b922-5cfde600a7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:50.038339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:50.044927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01607b71-c038-47b0-8c00-c099c046571c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:50.045700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01607b71-c038-47b0-8c00-c099c046571c None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:50.046067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01607b71-c038-47b0-8c00-c099c046571c None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:50.046447 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01607b71-c038-47b0-8c00-c099c046571c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:50.057694 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-653af438-0887-40fe-b922-5cfde600a7b7 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:50.058924 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-653af438-0887-40fe-b922-5cfde600a7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:50.059640 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01607b71-c038-47b0-8c00-c099c046571c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:50.061343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01607b71-c038-47b0-8c00-c099c046571c None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:50.089299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-01607b71-c038-47b0-8c00-c099c046571c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:50.089299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:50.089299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:50.089299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:50.089299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:50.089299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:50.089299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:50.089299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:50.089299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:50.089299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:50.089299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:50.089299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:50.089299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:50.089299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:50.089299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:50.089299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:50.091409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:50.091409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:50.091409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:50.091409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:50.091409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:50.091409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:50.091409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:50.091409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:50.091409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:50.091409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:50.091409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:50.091409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:50.091409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:50.091409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:50.091409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:50.091409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:50.091409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:50.093184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:50.093184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:50.093184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:50.093184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 337/657] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:50.093184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01607b71-c038-47b0-8c00-c099c046571c None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:50.166874 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 321/658] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:50.168061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653af438-0887-40fe-b922-5cfde600a7b7 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:50.241234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:50.243638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01607b71-c038-47b0-8c00-c099c046571c None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:50.287326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905d4ed-32b8-40c0-9930-b8d8c3a514d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:50.288192 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905d4ed-32b8-40c0-9930-b8d8c3a514d2 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:50.288468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905d4ed-32b8-40c0-9930-b8d8c3a514d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:50.288744 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905d4ed-32b8-40c0-9930-b8d8c3a514d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:50.296878 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905d4ed-32b8-40c0-9930-b8d8c3a514d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:50.298384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905d4ed-32b8-40c0-9930-b8d8c3a514d2 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:50.312214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-1905d4ed-32b8-40c0-9930-b8d8c3a514d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:50.312214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:50.312214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:50.312214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:50.312214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:50.312214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:50.312214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:50.312214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:50.312214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:50.312214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:50.312214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:50.312214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:50.312214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:06:50.312214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:06:50.312214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:06:50.314249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:06:50.314249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:50.314249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:50.314249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:50.314249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:50.314249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:50.314249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:50.314249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:50.314249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:50.314249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:50.314249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:50.314249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:50.314249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:50.314249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:50.314249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:50.314249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:50.314249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:50.316813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:06:50.316813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:06:50.316813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:06:50.316813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:06:50.316813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:06:50.316813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:06:50.316813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:50.316813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:50.318939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 338/659] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:50.320117 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905d4ed-32b8-40c0-9930-b8d8c3a514d2 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:50.336052 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653af438-0887-40fe-b922-5cfde600a7b7 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:50.377396 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:50.393856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2e8cc-7db9-4e7f-8e9c-1d64ab1c6ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:50.399805 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2e8cc-7db9-4e7f-8e9c-1d64ab1c6ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:50.399805 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2e8cc-7db9-4e7f-8e9c-1d64ab1c6ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:50.399805 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2e8cc-7db9-4e7f-8e9c-1d64ab1c6ae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:50.414980 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2e8cc-7db9-4e7f-8e9c-1d64ab1c6ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:50.416743 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2e8cc-7db9-4e7f-8e9c-1d64ab1c6ae6 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:50.435587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-63d2e8cc-7db9-4e7f-8e9c-1d64ab1c6ae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:50.435587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:50.435587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:50.435587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:50.435587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:50.435587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:50.435587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:50.435587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:50.435587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:50.435587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:50.435587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:50.435587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:50.435587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:50.435587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:50.435587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:50.435587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:50.437391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:50.437391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:50.437391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:50.437391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:50.437391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:50.437391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:50.437391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:50.437391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:50.437391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:50.437391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:50.437391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:50.437391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:50.437391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:50.437391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:50.437391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:50.437391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:50.437391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:50.439124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:50.439124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:50.439124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:50.439124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 322/660] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:50.439124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2e8cc-7db9-4e7f-8e9c-1d64ab1c6ae6 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:50.478966 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905d4ed-32b8-40c0-9930-b8d8c3a514d2 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:50.553287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70237298-b421-4550-bdf1-c9f68dfee037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:50.554236 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70237298-b421-4550-bdf1-c9f68dfee037 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:50.554804 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70237298-b421-4550-bdf1-c9f68dfee037 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:50.555203 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70237298-b421-4550-bdf1-c9f68dfee037 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:50.568487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70237298-b421-4550-bdf1-c9f68dfee037 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:50.570444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70237298-b421-4550-bdf1-c9f68dfee037 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:50.585567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-70237298-b421-4550-bdf1-c9f68dfee037 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 01:06:50.585567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:50.585567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:50.585567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:50.585567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:50.585567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:50.585567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:50.585567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:50.585567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:50.585567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:50.585567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:50.585567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:50.585567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:06:50.585567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:06:50.585567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:06:50.585567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:06:50.587820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:50.587820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:50.587820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:06:50.587820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:50.587820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:06:50.587820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:50.587820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:50.587820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:50.587820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:50.587820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:50.587820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:50.587820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:50.587820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:50.587820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:50.587820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:50.587820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:50.587820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:50.587820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:50.590157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:50.590157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:50.590157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:06:50.590157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:06:50.590157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:06:50.590157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:06:50.590157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:06:50.590157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:06:50.590157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 01:06:50.590157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:50.591306 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:50.591469 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 339/661] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:06:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:50.591469 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70237298-b421-4550-bdf1-c9f68dfee037 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:50.596118 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2e8cc-7db9-4e7f-8e9c-1d64ab1c6ae6 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:50.640214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55062919-ef8e-4eac-bfea-3c00bb1dcc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:50.640969 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55062919-ef8e-4eac-bfea-3c00bb1dcc3d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:50.641309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55062919-ef8e-4eac-bfea-3c00bb1dcc3d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:50.641709 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55062919-ef8e-4eac-bfea-3c00bb1dcc3d None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:50.642486 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55062919-ef8e-4eac-bfea-3c00bb1dcc3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:50.643050 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55062919-ef8e-4eac-bfea-3c00bb1dcc3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:50.646796 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55062919-ef8e-4eac-bfea-3c00bb1dcc3d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:50.665520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 323/662] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:50.667064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55062919-ef8e-4eac-bfea-3c00bb1dcc3d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:50.757616 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70237298-b421-4550-bdf1-c9f68dfee037 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:50.762192 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:50.801640 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55062919-ef8e-4eac-bfea-3c00bb1dcc3d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:50.803784 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230981b8-ea5a-47a9-8dc5-b1eb44c69353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:50.804547 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230981b8-ea5a-47a9-8dc5-b1eb44c69353 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:50.804925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230981b8-ea5a-47a9-8dc5-b1eb44c69353 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:50.805294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230981b8-ea5a-47a9-8dc5-b1eb44c69353 None admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:50.806094 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230981b8-ea5a-47a9-8dc5-b1eb44c69353 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:50.806502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230981b8-ea5a-47a9-8dc5-b1eb44c69353 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:50.808109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230981b8-ea5a-47a9-8dc5-b1eb44c69353 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:50.831262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 340/663] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:06:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:50.831262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230981b8-ea5a-47a9-8dc5-b1eb44c69353 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:50.848399 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa5961-45c2-4e81-9823-8875ad1a3c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:50.849011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa5961-45c2-4e81-9823-8875ad1a3c51 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:50.849287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa5961-45c2-4e81-9823-8875ad1a3c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:50.849559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa5961-45c2-4e81-9823-8875ad1a3c51 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:50.850263 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa5961-45c2-4e81-9823-8875ad1a3c51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:50.850678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa5961-45c2-4e81-9823-8875ad1a3c51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:50.852168 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa5961-45c2-4e81-9823-8875ad1a3c51 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:50.865829 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 324/664] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:50.866706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa5961-45c2-4e81-9823-8875ad1a3c51 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:50.891047 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:50.995357 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230981b8-ea5a-47a9-8dc5-b1eb44c69353 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:50.999948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa5961-45c2-4e81-9823-8875ad1a3c51 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:51.040040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75d6ac-1a7c-43a1-8233-9a425cab102c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:51.040689 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75d6ac-1a7c-43a1-8233-9a425cab102c None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:51.041052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75d6ac-1a7c-43a1-8233-9a425cab102c None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:51.041373 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75d6ac-1a7c-43a1-8233-9a425cab102c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:51.046717 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ac8fb-5c68-48e3-866f-b6307f5bf539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:51.047798 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ac8fb-5c68-48e3-866f-b6307f5bf539 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:51.048303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ac8fb-5c68-48e3-866f-b6307f5bf539 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:51.048867 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ac8fb-5c68-48e3-866f-b6307f5bf539 None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:51.050258 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ac8fb-5c68-48e3-866f-b6307f5bf539 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:51.050864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ac8fb-5c68-48e3-866f-b6307f5bf539 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:51.053636 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ac8fb-5c68-48e3-866f-b6307f5bf539 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:51.054453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75d6ac-1a7c-43a1-8233-9a425cab102c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:51.060353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-4a75d6ac-1a7c-43a1-8233-9a425cab102c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:51.060353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:51.060353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:51.060353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:51.060353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:51.060353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:51.060353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:51.060353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:51.060353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:51.060353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:51.060353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:51.060353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:51.060353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:51.060353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:51.060353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:51.060353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:51.067434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:51.067434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:51.067434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:51.067434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:51.067434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:51.067434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:51.067434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:51.067434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:51.067434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:51.067434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:51.067434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:51.067434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:51.067434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:51.067434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:51.067434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:51.067434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:51.068437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:51.068437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:51.068437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:51.068437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:51.068437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:51.068437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:51.068437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:51.068437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:51.068437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:51.068437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:51.068437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:06:51.068437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:51.068437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 341/665] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:06:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:51.068437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75d6ac-1a7c-43a1-8233-9a425cab102c None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:51.085435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 325/666] 10.222.0.83 () {56 vars in 1139 bytes} [Fri Sep 23 01:06:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:51.086852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ac8fb-5c68-48e3-866f-b6307f5bf539 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:51.107739 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:51.204483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:51.218572 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75d6ac-1a7c-43a1-8233-9a425cab102c None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:51.246175 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ac8fb-5c68-48e3-866f-b6307f5bf539 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:51.259852 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722acf6-a45d-4aa8-bd8f-bd951ec10be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:51.260507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722acf6-a45d-4aa8-bd8f-bd951ec10be7 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:51.260782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722acf6-a45d-4aa8-bd8f-bd951ec10be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:51.261049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722acf6-a45d-4aa8-bd8f-bd951ec10be7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:51.268609 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722acf6-a45d-4aa8-bd8f-bd951ec10be7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:51.270140 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722acf6-a45d-4aa8-bd8f-bd951ec10be7 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:51.283337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-4722acf6-a45d-4aa8-bd8f-bd951ec10be7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:51.283337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:51.283337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:51.283337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:51.283337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:51.283337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:51.283337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:51.283337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:51.283337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:51.283337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:51.283337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:51.283337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:51.283337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:06:51.283337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:06:51.283337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:06:51.291412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:06:51.291412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:51.291412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:51.291412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:51.291412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:51.291412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:51.291412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:51.291412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:51.291412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:51.291412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:51.291412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:51.291412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:51.291412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:51.291412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:51.291412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:51.291412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:51.291412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:51.292920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:06:51.292920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:06:51.292920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:06:51.292920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:06:51.292920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:06:51.292920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:06:51.292920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:51.292920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:51.292920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 342/667] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:51.292920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722acf6-a45d-4aa8-bd8f-bd951ec10be7 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:51.308450 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e061141-0463-439f-87fb-3ab311731a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:51.309081 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e061141-0463-439f-87fb-3ab311731a56 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:51.309360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e061141-0463-439f-87fb-3ab311731a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:51.309624 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e061141-0463-439f-87fb-3ab311731a56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:51.310392 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e061141-0463-439f-87fb-3ab311731a56 None admin] RBAC: Adding query filter params (role.id=2e8d92bd39634bbdad03d67d3fc439f0, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=824648d693af4b44ae5df853a3d258f5) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:51.310739 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e061141-0463-439f-87fb-3ab311731a56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:51.312354 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e061141-0463-439f-87fb-3ab311731a56 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:51.319639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 326/668] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:06:51 2022] GET /identity/v3/role_assignments?user.id=824648d693af4b44ae5df853a3d258f5&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=2e8d92bd39634bbdad03d67d3fc439f0 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:51.320479 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e061141-0463-439f-87fb-3ab311731a56 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:51.445511 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:51.475885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722acf6-a45d-4aa8-bd8f-bd951ec10be7 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:51.501917 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e061141-0463-439f-87fb-3ab311731a56 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:51.533887 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea4f36-8e07-4b46-a13c-905bc05ae4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:51.534752 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea4f36-8e07-4b46-a13c-905bc05ae4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:51.535035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea4f36-8e07-4b46-a13c-905bc05ae4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:51.535305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea4f36-8e07-4b46-a13c-905bc05ae4c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:51.543978 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea4f36-8e07-4b46-a13c-905bc05ae4c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:51.545442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea4f36-8e07-4b46-a13c-905bc05ae4c5 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:51.553772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c751c1-2fc0-4eb9-a38d-07490cec6378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:51.554409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c751c1-2fc0-4eb9-a38d-07490cec6378 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:51.554728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c751c1-2fc0-4eb9-a38d-07490cec6378 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:51.555002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c751c1-2fc0-4eb9-a38d-07490cec6378 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:51.555700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c751c1-2fc0-4eb9-a38d-07490cec6378 None admin] RBAC: Adding query filter params (name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:51.556086 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c751c1-2fc0-4eb9-a38d-07490cec6378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:51.557439 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c751c1-2fc0-4eb9-a38d-07490cec6378 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:51.558944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-dbea4f36-8e07-4b46-a13c-905bc05ae4c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:51.558944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:51.558944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:51.558944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:51.558944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:51.558944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:51.558944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:51.558944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:51.558944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:51.558944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:51.558944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:51.558944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:51.558944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:06:51.558944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:06:51.558944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:06:51.559910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:06:51.559910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:51.559910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:51.559910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:51.559910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:51.559910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:51.559910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:51.559910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:51.559910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:51.559910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:51.559910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:51.559910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:51.559910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:51.559910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:51.559910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:51.559910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:51.559910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:51.560780 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:06:51.560780 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:06:51.560780 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:06:51.560780 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:06:51.560780 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:06:51.560780 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:06:51.560780 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:51.560780 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:51.560780 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 343/669] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:51.562947 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea4f36-8e07-4b46-a13c-905bc05ae4c5 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:51.572947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 327/670] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:06:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:51.573894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c751c1-2fc0-4eb9-a38d-07490cec6378 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:51.577247 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:51.745759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea4f36-8e07-4b46-a13c-905bc05ae4c5 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:51.762997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c751c1-2fc0-4eb9-a38d-07490cec6378 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:51.796276 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e4ec1-16a5-47ae-98d8-65eb127fad73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:51.797046 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e4ec1-16a5-47ae-98d8-65eb127fad73 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:51.797509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e4ec1-16a5-47ae-98d8-65eb127fad73 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:51.797799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e4ec1-16a5-47ae-98d8-65eb127fad73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:51.817772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:51.819500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5401b58-4ba3-4d1e-91ee-ebf4414a14cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:51.820139 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5401b58-4ba3-4d1e-91ee-ebf4414a14cf None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:51.820410 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5401b58-4ba3-4d1e-91ee-ebf4414a14cf None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:51.820869 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5401b58-4ba3-4d1e-91ee-ebf4414a14cf None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:51.821852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5401b58-4ba3-4d1e-91ee-ebf4414a14cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:51.822165 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5401b58-4ba3-4d1e-91ee-ebf4414a14cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:51.823686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5401b58-4ba3-4d1e-91ee-ebf4414a14cf None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:51.838695 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 328/671] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:06:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:51.839583 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5401b58-4ba3-4d1e-91ee-ebf4414a14cf None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:51.915798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e4ec1-16a5-47ae-98d8-65eb127fad73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:51.919030 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e4ec1-16a5-47ae-98d8-65eb127fad73 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:51.920839 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:51.974357 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5401b58-4ba3-4d1e-91ee-ebf4414a14cf None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:52.026688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f6402-e08b-4686-b331-eb3d88d28fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:52.027671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f6402-e08b-4686-b331-eb3d88d28fdb None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:52.028120 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f6402-e08b-4686-b331-eb3d88d28fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:52.028561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f6402-e08b-4686-b331-eb3d88d28fdb None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:52.029844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f6402-e08b-4686-b331-eb3d88d28fdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:52.030356 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f6402-e08b-4686-b331-eb3d88d28fdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:52.033004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f6402-e08b-4686-b331-eb3d88d28fdb None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:52.056506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 329/672] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:06:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:52.057635 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f6402-e08b-4686-b331-eb3d88d28fdb None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:52.085361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 344/673] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:06:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:06:52.086757 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e4ec1-16a5-47ae-98d8-65eb127fad73 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:52.148583 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:52.220870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f6402-e08b-4686-b331-eb3d88d28fdb None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:52.247570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e4ec1-16a5-47ae-98d8-65eb127fad73 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:52.260804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:52.282168 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06750cb7-59f0-4dfa-a015-2eb5c8874904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:52.283337 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06750cb7-59f0-4dfa-a015-2eb5c8874904 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:52.283819 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06750cb7-59f0-4dfa-a015-2eb5c8874904 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:52.284302 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06750cb7-59f0-4dfa-a015-2eb5c8874904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:52.305941 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06750cb7-59f0-4dfa-a015-2eb5c8874904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:52.308762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06750cb7-59f0-4dfa-a015-2eb5c8874904 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:52.315069 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674ad73-5a1f-4ad6-b785-dfd191c15178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:52.316111 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674ad73-5a1f-4ad6-b785-dfd191c15178 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:52.316571 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674ad73-5a1f-4ad6-b785-dfd191c15178 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:52.317031 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674ad73-5a1f-4ad6-b785-dfd191c15178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:52.318379 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674ad73-5a1f-4ad6-b785-dfd191c15178 None admin] RBAC: Adding query filter params (role.id=2e8d92bd39634bbdad03d67d3fc439f0, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=f5b3a7a9a08e40718980143d7c4880ff) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:52.318961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674ad73-5a1f-4ad6-b785-dfd191c15178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:52.321972 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674ad73-5a1f-4ad6-b785-dfd191c15178 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:52.341113 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 345/674] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:06:52 2022] GET /identity/v3/role_assignments?user.id=f5b3a7a9a08e40718980143d7c4880ff&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=2e8d92bd39634bbdad03d67d3fc439f0 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:52.341113 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674ad73-5a1f-4ad6-b785-dfd191c15178 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:52.341396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-06750cb7-59f0-4dfa-a015-2eb5c8874904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:52.341396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:52.341396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:52.341396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:52.341396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:52.341396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:52.341396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:52.341396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:52.341396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:52.341396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:52.341396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:52.341396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:52.341396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:52.341396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:52.341396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:52.341396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:52.342351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:52.342351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:52.342351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:52.342351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:52.342351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:52.342351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:52.342351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:52.342351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:52.342351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:52.342351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:52.342351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:52.342351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:52.342351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:52.342351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:52.342351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:52.342351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:52.342351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:52.343855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:52.343855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:52.343855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:52.343855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 330/675] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:52.343855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06750cb7-59f0-4dfa-a015-2eb5c8874904 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:52.536851 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674ad73-5a1f-4ad6-b785-dfd191c15178 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:52.549159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:52.555895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06750cb7-59f0-4dfa-a015-2eb5c8874904 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:52.583631 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8dab8-3beb-45ee-9205-1739fae4024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:52.584745 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8dab8-3beb-45ee-9205-1739fae4024f None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:52.585445 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8dab8-3beb-45ee-9205-1739fae4024f None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:52.586007 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8dab8-3beb-45ee-9205-1739fae4024f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:52.587148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8dab8-3beb-45ee-9205-1739fae4024f None admin] RBAC: Adding query filter params (role.id=2e8d92bd39634bbdad03d67d3fc439f0, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=9f71db705b08460996a729a88c82bb63) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:52.588773 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8dab8-3beb-45ee-9205-1739fae4024f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:52.590515 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8dab8-3beb-45ee-9205-1739fae4024f None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:52.600237 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 346/676] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:06:52 2022] GET /identity/v3/role_assignments?user.id=9f71db705b08460996a729a88c82bb63&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=2e8d92bd39634bbdad03d67d3fc439f0 => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:52.601463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8dab8-3beb-45ee-9205-1739fae4024f None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:52.630204 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39045b-8bb8-4cef-b8f4-939f7927db24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:52.631366 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39045b-8bb8-4cef-b8f4-939f7927db24 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:52.631976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39045b-8bb8-4cef-b8f4-939f7927db24 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:52.632355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39045b-8bb8-4cef-b8f4-939f7927db24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:52.655124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39045b-8bb8-4cef-b8f4-939f7927db24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:52.658225 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39045b-8bb8-4cef-b8f4-939f7927db24 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:52.692599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-8b39045b-8bb8-4cef-b8f4-939f7927db24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:52.692599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:52.692599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:52.692599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:52.692599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:52.692599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:52.692599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:52.692599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:52.692599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:52.692599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:52.692599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:52.692599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:52.692599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:52.692599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:52.692599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:52.692599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:52.693646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:52.693646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:52.693646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:52.693646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:52.693646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:52.693646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:52.693646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:52.693646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:52.693646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:52.693646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:52.693646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:52.693646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:52.693646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:52.693646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:52.693646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:52.693646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:52.693646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:52.694517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:52.694517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:52.694517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:52.694517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 331/677] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:52.704026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39045b-8bb8-4cef-b8f4-939f7927db24 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:52.757825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:52.815383 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8dab8-3beb-45ee-9205-1739fae4024f None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:52.880685 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f6dd3-e16c-47a6-b9cb-a14a3866c45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:52.881200 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f6dd3-e16c-47a6-b9cb-a14a3866c45e None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:52.881482 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f6dd3-e16c-47a6-b9cb-a14a3866c45e None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:52.881858 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f6dd3-e16c-47a6-b9cb-a14a3866c45e None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:52.882629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f6dd3-e16c-47a6-b9cb-a14a3866c45e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:52.882886 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f6dd3-e16c-47a6-b9cb-a14a3866c45e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:52.884575 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f6dd3-e16c-47a6-b9cb-a14a3866c45e None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:52.904359 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39045b-8bb8-4cef-b8f4-939f7927db24 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:52.905838 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 347/678] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:52.918113 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f6dd3-e16c-47a6-b9cb-a14a3866c45e None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:52.998038 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:53.000440 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9882b-126b-4615-8455-793af2625de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:53.000868 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9882b-126b-4615-8455-793af2625de4 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:53.001986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9882b-126b-4615-8455-793af2625de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:53.001986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9882b-126b-4615-8455-793af2625de4 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:53.002288 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9882b-126b-4615-8455-793af2625de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:53.002417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9882b-126b-4615-8455-793af2625de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:53.004753 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9882b-126b-4615-8455-793af2625de4 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:53.038827 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 332/679] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:53.049158 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9882b-126b-4615-8455-793af2625de4 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:53.158764 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f6dd3-e16c-47a6-b9cb-a14a3866c45e None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:53.234750 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ff61e-cc02-4301-9707-2ae9d7b819d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:53.235824 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ff61e-cc02-4301-9707-2ae9d7b819d9 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:53.236582 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ff61e-cc02-4301-9707-2ae9d7b819d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:53.238691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ff61e-cc02-4301-9707-2ae9d7b819d9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:53.255391 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ff61e-cc02-4301-9707-2ae9d7b819d9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:53.258805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ff61e-cc02-4301-9707-2ae9d7b819d9 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:53.260796 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:53.287927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-581ff61e-cc02-4301-9707-2ae9d7b819d9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 01:06:53.287927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:53.287927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:53.287927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:53.287927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:53.287927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:53.287927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:53.287927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:53.287927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:53.287927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:53.287927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:53.287927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:53.287927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:06:53.287927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:06:53.287927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:06:53.287927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:06:53.289700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:53.289700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:53.289700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:06:53.289700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:53.289700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:06:53.289700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:53.289700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:53.289700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:53.289700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:53.289700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:53.289700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:53.289700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:53.289700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:53.289700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:53.289700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:53.289700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:53.289700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:53.289700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:53.291853 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:53.291853 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:53.291853 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:06:53.291853 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:06:53.291853 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:06:53.291853 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:06:53.291853 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:06:53.291853 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:06:53.291853 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 23 01:06:53.291853 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:53.295619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 348/680] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:06:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:06:53.307421 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ff61e-cc02-4301-9707-2ae9d7b819d9 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:53.309064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9882b-126b-4615-8455-793af2625de4 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:53.411508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7638c-ad1d-4b31-a9e5-6b22f26f7c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:53.412093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7638c-ad1d-4b31-a9e5-6b22f26f7c06 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:53.412371 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7638c-ad1d-4b31-a9e5-6b22f26f7c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:53.412745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7638c-ad1d-4b31-a9e5-6b22f26f7c06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:53.423454 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:53.427833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7638c-ad1d-4b31-a9e5-6b22f26f7c06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:53.429408 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7638c-ad1d-4b31-a9e5-6b22f26f7c06 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:53.435208 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ff61e-cc02-4301-9707-2ae9d7b819d9 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:53.469919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-e5f7638c-ad1d-4b31-a9e5-6b22f26f7c06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:53.469919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:53.469919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:53.469919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:53.469919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:53.469919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:53.469919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:53.469919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:53.469919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:53.469919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:53.469919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:53.469919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:53.469919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:06:53.469919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:06:53.469919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:06:53.471375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:06:53.471375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:53.471375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:53.471375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:53.471375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:53.471375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:53.471375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:53.471375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:53.471375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:53.471375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:53.471375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:53.471375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:53.471375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:53.471375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:53.471375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:53.471375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:53.471375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:53.473148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:06:53.473148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:06:53.473148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:06:53.473148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:06:53.473148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:06:53.473148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:06:53.473148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:53.473148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:53.473148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 333/681] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:53.482107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7638c-ad1d-4b31-a9e5-6b22f26f7c06 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:53.495642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4881f0-8ed7-4fa9-be13-ec78e8a3e73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:53.496697 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4881f0-8ed7-4fa9-be13-ec78e8a3e73b None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:53.497162 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4881f0-8ed7-4fa9-be13-ec78e8a3e73b None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:53.504275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4881f0-8ed7-4fa9-be13-ec78e8a3e73b None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:53.505799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4881f0-8ed7-4fa9-be13-ec78e8a3e73b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:53.506326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4881f0-8ed7-4fa9-be13-ec78e8a3e73b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:53.509110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4881f0-8ed7-4fa9-be13-ec78e8a3e73b None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:53.561572 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 349/682] 10.222.0.83 () {56 vars in 1135 bytes} [Fri Sep 23 01:06:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:53.571932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4881f0-8ed7-4fa9-be13-ec78e8a3e73b None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:53.752355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7638c-ad1d-4b31-a9e5-6b22f26f7c06 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:53.790081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4881f0-8ed7-4fa9-be13-ec78e8a3e73b None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:53.793710 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2bce0-fabf-4150-a1c6-1f996e7ce779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:53.794536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2bce0-fabf-4150-a1c6-1f996e7ce779 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:53.794938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2bce0-fabf-4150-a1c6-1f996e7ce779 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:53.795331 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2bce0-fabf-4150-a1c6-1f996e7ce779 None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:53.796172 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2bce0-fabf-4150-a1c6-1f996e7ce779 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:53.796577 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2bce0-fabf-4150-a1c6-1f996e7ce779 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:53.798155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2bce0-fabf-4150-a1c6-1f996e7ce779 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:53.813623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 334/683] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:06:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:53.827738 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2bce0-fabf-4150-a1c6-1f996e7ce779 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:53.845697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:53.851437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd85e81-e5c6-44bd-9957-bb4a19c65ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:53.852629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd85e81-e5c6-44bd-9957-bb4a19c65ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:53.853099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd85e81-e5c6-44bd-9957-bb4a19c65ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:53.853539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd85e81-e5c6-44bd-9957-bb4a19c65ac4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:53.879301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:53.943466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd85e81-e5c6-44bd-9957-bb4a19c65ac4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:53.945444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd85e81-e5c6-44bd-9957-bb4a19c65ac4 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:54.033733 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2bce0-fabf-4150-a1c6-1f996e7ce779 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:54.072591 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 350/684] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:06:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:06:54.078954 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd85e81-e5c6-44bd-9957-bb4a19c65ac4 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:54.114860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c2a2a-85e6-423d-905a-342fe36e5ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:54.115540 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c2a2a-85e6-423d-905a-342fe36e5ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:54.115775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c2a2a-85e6-423d-905a-342fe36e5ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:54.116182 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c2a2a-85e6-423d-905a-342fe36e5ed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:54.116952 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c2a2a-85e6-423d-905a-342fe36e5ed1 None admin] RBAC: Adding query filter params (role.id=2e8d92bd39634bbdad03d67d3fc439f0, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=be2b2806686c4a15b1ace8b6245c4e28) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:54.117259 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c2a2a-85e6-423d-905a-342fe36e5ed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:54.120408 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c2a2a-85e6-423d-905a-342fe36e5ed1 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:54.130840 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 335/685] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:06:53 2022] GET /identity/v3/role_assignments?user.id=be2b2806686c4a15b1ace8b6245c4e28&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=2e8d92bd39634bbdad03d67d3fc439f0 => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:54.182066 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:54.269839 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd85e81-e5c6-44bd-9957-bb4a19c65ac4 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:54.321919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cecd6-5d8f-4811-8d9e-a05d730bc62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:54.322499 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cecd6-5d8f-4811-8d9e-a05d730bc62a None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:54.322809 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cecd6-5d8f-4811-8d9e-a05d730bc62a None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:54.323084 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cecd6-5d8f-4811-8d9e-a05d730bc62a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:54.343203 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cecd6-5d8f-4811-8d9e-a05d730bc62a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:54.344720 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cecd6-5d8f-4811-8d9e-a05d730bc62a None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:54.347723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31aff00-5531-4564-9218-7883a6f4938d None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:54.348677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31aff00-5531-4564-9218-7883a6f4938d None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:54.349181 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31aff00-5531-4564-9218-7883a6f4938d None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:54.351211 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 336/686] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:06:54.358037 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be24726-04bc-4308-aaaf-d1813e09fa45 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:54.358740 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be24726-04bc-4308-aaaf-d1813e09fa45 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:54.359236 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be24726-04bc-4308-aaaf-d1813e09fa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:54.376783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-840cecd6-5d8f-4811-8d9e-a05d730bc62a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:54.376783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:54.376783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:54.376783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:54.376783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:54.376783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:54.376783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:54.376783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:54.376783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:54.376783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:54.376783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:54.376783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:54.376783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:54.376783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:54.376783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:54.376783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:54.377806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:54.377806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:54.377806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:54.377806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:54.377806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:54.377806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:54.377806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:54.377806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:54.377806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:54.377806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:54.377806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:54.377806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:54.377806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:54.377806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:54.377806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:54.377806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:54.377806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:54.379439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:54.379439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:54.379439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:54.379439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 351/687] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:54.386338 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cecd6-5d8f-4811-8d9e-a05d730bc62a None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:54.391114 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-4be24726-04bc-4308-aaaf-d1813e09fa45 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:54.392320 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-4be24726-04bc-4308-aaaf-d1813e09fa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:54.484142 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:54.489989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 337/688] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:06:54.730653 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cecd6-5d8f-4811-8d9e-a05d730bc62a None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:54.734929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:54.783519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3cdbd-9bbd-4204-9694-b8b1e881c1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:54.784157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3cdbd-9bbd-4204-9694-b8b1e881c1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:54.784493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3cdbd-9bbd-4204-9694-b8b1e881c1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:54.784769 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3cdbd-9bbd-4204-9694-b8b1e881c1e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:54.785430 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3cdbd-9bbd-4204-9694-b8b1e881c1e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:54.785733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3cdbd-9bbd-4204-9694-b8b1e881c1e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:54.787186 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3cdbd-9bbd-4204-9694-b8b1e881c1e5 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:54.811088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 352/689] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:54.816566 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be24726-04bc-4308-aaaf-d1813e09fa45 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:54.949149 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be24726-04bc-4308-aaaf-d1813e09fa45 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:54.990394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92157dc9-a810-4ef1-8ab8-c81fbf64925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:54.990998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92157dc9-a810-4ef1-8ab8-c81fbf64925b None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:54.991283 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92157dc9-a810-4ef1-8ab8-c81fbf64925b None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:54.991554 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92157dc9-a810-4ef1-8ab8-c81fbf64925b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:54.999279 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92157dc9-a810-4ef1-8ab8-c81fbf64925b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:55.000942 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92157dc9-a810-4ef1-8ab8-c81fbf64925b None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:55.014812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-92157dc9-a810-4ef1-8ab8-c81fbf64925b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:55.014812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:55.014812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:55.014812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:55.014812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:55.014812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:55.014812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:55.014812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:55.014812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:55.014812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:55.014812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:55.014812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:55.014812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:06:55.014812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:06:55.014812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:06:55.015967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:06:55.015967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:55.015967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:55.015967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:55.015967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:55.015967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:55.015967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:55.015967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:55.015967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:55.015967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:55.015967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:55.015967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:55.015967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:55.015967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:55.015967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:55.015967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:55.015967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:55.016874 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:06:55.016874 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:06:55.016874 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:06:55.016874 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:06:55.016874 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:06:55.016874 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:06:55.016874 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:55.016874 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:55.016874 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 338/690] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:55.023015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3cdbd-9bbd-4204-9694-b8b1e881c1e5 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:55.043354 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92157dc9-a810-4ef1-8ab8-c81fbf64925b None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:55.156222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:55.161898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3cdbd-9bbd-4204-9694-b8b1e881c1e5 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:55.239251 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03cd41-8435-42a9-9acc-222a28cd931b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:55.239876 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03cd41-8435-42a9-9acc-222a28cd931b None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:55.240152 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03cd41-8435-42a9-9acc-222a28cd931b None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:55.240468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03cd41-8435-42a9-9acc-222a28cd931b None admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:55.241349 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03cd41-8435-42a9-9acc-222a28cd931b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:55.241650 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03cd41-8435-42a9-9acc-222a28cd931b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:55.243190 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03cd41-8435-42a9-9acc-222a28cd931b None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:55.252782 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92157dc9-a810-4ef1-8ab8-c81fbf64925b None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:55.276816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 353/691] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:06:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:55.283976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03cd41-8435-42a9-9acc-222a28cd931b None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:55.344568 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d8c78-a5ff-49a9-854f-56a3e1a10179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:55.345413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d8c78-a5ff-49a9-854f-56a3e1a10179 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:55.345901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d8c78-a5ff-49a9-854f-56a3e1a10179 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:55.346359 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d8c78-a5ff-49a9-854f-56a3e1a10179 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:55.365085 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:55.372054 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d8c78-a5ff-49a9-854f-56a3e1a10179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:55.379900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-544d8c78-a5ff-49a9-854f-56a3e1a10179 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:06:55.379900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:55.379900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:55.379900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:55.379900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:55.379900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:55.379900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:55.379900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:55.379900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:55.379900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:55.379900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:55.379900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:55.379900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:55.379900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:55.379900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:55.379900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:06:55.380918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:06:55.380918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:06:55.380918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:06:55.380918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:06:55.380918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:55.380918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:55.380918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:55.380918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:55.380918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:55.380918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:55.380918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:55.380918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:55.380918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:55.380918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:55.380918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:55.380918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:55.381772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:55.381772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:55.381772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:55.381772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:55.381772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:06:55.381772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:06:55.381772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:06:55.381772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:06:55.381772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:06:55.381772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:06:55.381772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:06:55.381772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:55.382546 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 339/692] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:06:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:55.388651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d8c78-a5ff-49a9-854f-56a3e1a10179 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:55.543500 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03cd41-8435-42a9-9acc-222a28cd931b None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:55.590817 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d8c78-a5ff-49a9-854f-56a3e1a10179 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:55.618252 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e5d3e-12f7-4803-baf4-164448bfdca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:55.619768 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e5d3e-12f7-4803-baf4-164448bfdca7 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:55.620655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e5d3e-12f7-4803-baf4-164448bfdca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:55.621551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e5d3e-12f7-4803-baf4-164448bfdca7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:55.623687 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e5d3e-12f7-4803-baf4-164448bfdca7 None admin] RBAC: Adding query filter params (role.id=2e8d92bd39634bbdad03d67d3fc439f0, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=c526c7ad227943d1a2bba7b5e2e039e0) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:55.625093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e5d3e-12f7-4803-baf4-164448bfdca7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:55.628369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e5d3e-12f7-4803-baf4-164448bfdca7 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:55.630008 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:55.644586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 354/693] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:06:55 2022] GET /identity/v3/role_assignments?user.id=c526c7ad227943d1a2bba7b5e2e039e0&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=2e8d92bd39634bbdad03d67d3fc439f0 => generated 608 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:55.647808 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e88bd-c9a1-47d6-89fd-9c535706c84a None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:55.648782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e88bd-c9a1-47d6-89fd-9c535706c84a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:55.649504 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e88bd-c9a1-47d6-89fd-9c535706c84a None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:55.653289 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 355/694] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:55.664808 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec89d9-3391-42ec-9327-07bd9f80b8e5 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:55.665105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34290871-5ae1-4afe-ac58-f8748b4ca34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:55.665928 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34290871-5ae1-4afe-ac58-f8748b4ca34b None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:55.666390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34290871-5ae1-4afe-ac58-f8748b4ca34b None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:55.666797 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec89d9-3391-42ec-9327-07bd9f80b8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:55.666960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34290871-5ae1-4afe-ac58-f8748b4ca34b None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:55.670389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34290871-5ae1-4afe-ac58-f8748b4ca34b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:55.670389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34290871-5ae1-4afe-ac58-f8748b4ca34b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:55.671788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec89d9-3391-42ec-9327-07bd9f80b8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:55.671989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34290871-5ae1-4afe-ac58-f8748b4ca34b None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:55.709898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-05ec89d9-3391-42ec-9327-07bd9f80b8e5 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:55.710630 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 340/695] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:06:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:06:55.712967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-05ec89d9-3391-42ec-9327-07bd9f80b8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:55.720454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34290871-5ae1-4afe-ac58-f8748b4ca34b None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:55.816652 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 356/696] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:56.013012 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f2539-f739-4bdd-a7a4-944aaf4ce6dd None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:56.013396 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f2539-f739-4bdd-a7a4-944aaf4ce6dd None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:56.013685 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f2539-f739-4bdd-a7a4-944aaf4ce6dd None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:56.016892 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 357/697] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:06:56.022509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646ea30-4657-4d39-9630-072a49defc2c None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:56.022892 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646ea30-4657-4d39-9630-072a49defc2c None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:56.023170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646ea30-4657-4d39-9630-072a49defc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:56.040763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34290871-5ae1-4afe-ac58-f8748b4ca34b None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:56.059801 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-0646ea30-4657-4d39-9630-072a49defc2c None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:56.061098 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-0646ea30-4657-4d39-9630-072a49defc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:56.076392 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:56.110315 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb8ab4-9e10-4cb5-a690-5e003a0ae16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:56.111414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb8ab4-9e10-4cb5-a690-5e003a0ae16b None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:56.111900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb8ab4-9e10-4cb5-a690-5e003a0ae16b None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:56.112373 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb8ab4-9e10-4cb5-a690-5e003a0ae16b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:56.138445 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb8ab4-9e10-4cb5-a690-5e003a0ae16b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:56.142119 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb8ab4-9e10-4cb5-a690-5e003a0ae16b None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:56.170140 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 358/698] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 01:06:56.176482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-d6cb8ab4-9e10-4cb5-a690-5e003a0ae16b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:56.176482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:56.176482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:56.176482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:56.176482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:56.176482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:56.176482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:56.176482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:56.176482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:56.176482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:56.176482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:56.176482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:56.176482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:56.176482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:56.176482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:56.176482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:56.178235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:56.178235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:56.178235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:56.178235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:56.178235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:56.178235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:56.178235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:56.178235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:56.178235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:56.178235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:56.178235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:56.178235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:56.178235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:56.178235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:56.178235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:56.178235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:56.178235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:56.179484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:56.179484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:56.179484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:56.179484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 341/699] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 462 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:56.186345 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646ea30-4657-4d39-9630-072a49defc2c None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:56.379586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646ea30-4657-4d39-9630-072a49defc2c None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:56.415222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb8ab4-9e10-4cb5-a690-5e003a0ae16b None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:56.445424 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02461b5a-c815-4aae-bb26-e895c2bc3024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:56.446788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02461b5a-c815-4aae-bb26-e895c2bc3024 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:56.447289 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02461b5a-c815-4aae-bb26-e895c2bc3024 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:56.447777 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02461b5a-c815-4aae-bb26-e895c2bc3024 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:56.448995 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02461b5a-c815-4aae-bb26-e895c2bc3024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:56.449539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02461b5a-c815-4aae-bb26-e895c2bc3024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:56.452332 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02461b5a-c815-4aae-bb26-e895c2bc3024 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:56.476347 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 359/700] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:56.485194 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02461b5a-c815-4aae-bb26-e895c2bc3024 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:56.510422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:56.530543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:56.635667 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb8ab4-9e10-4cb5-a690-5e003a0ae16b None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:56.677879 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02461b5a-c815-4aae-bb26-e895c2bc3024 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:56.686934 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde501d0-fbbf-4dcb-9760-7fae74a604f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:56.688181 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde501d0-fbbf-4dcb-9760-7fae74a604f8 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:56.688798 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde501d0-fbbf-4dcb-9760-7fae74a604f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:56.689288 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde501d0-fbbf-4dcb-9760-7fae74a604f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:56.705485 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde501d0-fbbf-4dcb-9760-7fae74a604f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:56.708575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde501d0-fbbf-4dcb-9760-7fae74a604f8 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:56.733447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-dde501d0-fbbf-4dcb-9760-7fae74a604f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:56.733447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:56.733447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:56.733447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:56.733447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:56.733447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:56.733447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:56.733447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:56.733447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:56.733447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:56.733447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:56.733447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:56.733447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:56.733447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:56.733447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:56.733447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:56.735324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:56.735324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:56.735324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:56.735324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:56.735324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:56.735324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:56.735324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:56.735324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:56.735324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:56.735324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:56.735324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:56.735324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:56.735324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:56.735324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:56.735324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:56.735324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:56.735324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:56.737117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:56.737117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:56.737117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:56.740934 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 342/701] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:56.743105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde501d0-fbbf-4dcb-9760-7fae74a604f8 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:56.745039 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faee47b-001d-4271-8fac-faf84848bd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:56.746204 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faee47b-001d-4271-8fac-faf84848bd7a None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:56.746746 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faee47b-001d-4271-8fac-faf84848bd7a None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:56.747309 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faee47b-001d-4271-8fac-faf84848bd7a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:56.762816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faee47b-001d-4271-8fac-faf84848bd7a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:56.765728 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faee47b-001d-4271-8fac-faf84848bd7a None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:56.790546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-7faee47b-001d-4271-8fac-faf84848bd7a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 01:06:56.790546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:56.790546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:56.790546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:56.790546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:56.790546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:56.790546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:56.790546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:56.790546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:56.790546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:56.790546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:56.790546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:56.790546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:06:56.790546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:06:56.790546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:06:56.790546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:06:56.792486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:56.792486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:56.792486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:06:56.792486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:56.792486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:06:56.792486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:06:56.792486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:56.792486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:56.792486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:56.792486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:56.792486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:56.792486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:56.792486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:56.792486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:56.792486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:56.792486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:56.792486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:56.792486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:56.794302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:56.794302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:56.794302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:06:56.794302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:06:56.794302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:06:56.794302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:06:56.794302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:06:56.794302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:06:56.794302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 01:06:56.794302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:56.794302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 360/702] 10.222.0.83 () {56 vars in 1093 bytes} [Fri Sep 23 01:06:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:06:56.794302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faee47b-001d-4271-8fac-faf84848bd7a None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:56.933198 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:56.967060 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:56.971163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde501d0-fbbf-4dcb-9760-7fae74a604f8 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:56.992594 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faee47b-001d-4271-8fac-faf84848bd7a None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:57.044878 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c0372-e373-427a-bb29-60b55ee48ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:57.046823 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c0372-e373-427a-bb29-60b55ee48ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:57.047712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c0372-e373-427a-bb29-60b55ee48ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:57.048329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c0372-e373-427a-bb29-60b55ee48ed7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:57.049378 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c0372-e373-427a-bb29-60b55ee48ed7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:57.053201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c0372-e373-427a-bb29-60b55ee48ed7 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:57.060240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bc501-c396-42de-acc3-292e1f18a5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:57.061302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bc501-c396-42de-acc3-292e1f18a5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:57.061798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bc501-c396-42de-acc3-292e1f18a5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:57.062251 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bc501-c396-42de-acc3-292e1f18a5d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:57.063536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bc501-c396-42de-acc3-292e1f18a5d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:57.064069 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bc501-c396-42de-acc3-292e1f18a5d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:57.066732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bc501-c396-42de-acc3-292e1f18a5d2 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:57.073510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-9f4c0372-e373-427a-bb29-60b55ee48ed7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 01:06:57.073510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:57.073510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:06:57.073510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:06:57.073510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:06:57.073510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:06:57.073510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:06:57.073510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:06:57.073510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 01:06:57.073510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:57.073510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:06:57.073510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:57.073510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:57.073510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:57.073510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:57.073510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:57.073510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:57.074804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:57.074804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:57.074804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:57.074804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:57.074804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:57.074804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:57.074804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:06:57.074804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:06:57.074804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:06:57.074804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:06:57.074804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:57.074804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:57.074804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:57.074804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:57.074804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:57.074804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:57.076277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:57.076277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:57.076277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:57.076277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:57.076277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:57.076277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:57.076277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:57.076277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:57.076277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:57.076277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:57.076277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:06:57.076277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:06:57.076277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 01:06:57.076277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:57.087768 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 343/703] 10.222.0.83 () {56 vars in 1129 bytes} [Fri Sep 23 01:06:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:57.089409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c0372-e373-427a-bb29-60b55ee48ed7 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:57.095387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 361/704] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:57.099747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bc501-c396-42de-acc3-292e1f18a5d2 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:57.287649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bc501-c396-42de-acc3-292e1f18a5d2 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:57.297650 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c0372-e373-427a-bb29-60b55ee48ed7 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:57.333874 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:57.351217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995694ce-2508-4eff-a8e7-ab7b2e1e9685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:57.352927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995694ce-2508-4eff-a8e7-ab7b2e1e9685 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:57.356757 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995694ce-2508-4eff-a8e7-ab7b2e1e9685 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:57.356757 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995694ce-2508-4eff-a8e7-ab7b2e1e9685 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:57.356757 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995694ce-2508-4eff-a8e7-ab7b2e1e9685 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:57.356757 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995694ce-2508-4eff-a8e7-ab7b2e1e9685 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:57.359988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995694ce-2508-4eff-a8e7-ab7b2e1e9685 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:57.360369 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5081f-26b4-4b0b-92f8-f09a05b5dcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:57.361351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5081f-26b4-4b0b-92f8-f09a05b5dcd7 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:57.361822 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5081f-26b4-4b0b-92f8-f09a05b5dcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:57.362288 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5081f-26b4-4b0b-92f8-f09a05b5dcd7 None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:57.364421 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5081f-26b4-4b0b-92f8-f09a05b5dcd7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:57.364839 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5081f-26b4-4b0b-92f8-f09a05b5dcd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:57.367341 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5081f-26b4-4b0b-92f8-f09a05b5dcd7 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:57.379346 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 362/705] 10.222.0.83 () {56 vars in 1124 bytes} [Fri Sep 23 01:06:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:57.381227 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995694ce-2508-4eff-a8e7-ab7b2e1e9685 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:57.402787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 344/706] 10.222.0.83 () {56 vars in 1133 bytes} [Fri Sep 23 01:06:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:57.404398 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5081f-26b4-4b0b-92f8-f09a05b5dcd7 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:57.424311 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:57.566233 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995694ce-2508-4eff-a8e7-ab7b2e1e9685 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:57.574064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5081f-26b4-4b0b-92f8-f09a05b5dcd7 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:57.611742 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7ed27-97e8-4601-8e28-ce8eb567ed7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:57.612366 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7ed27-97e8-4601-8e28-ce8eb567ed7a None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:57.613244 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7ed27-97e8-4601-8e28-ce8eb567ed7a None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:57.613601 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7ed27-97e8-4601-8e28-ce8eb567ed7a None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:57.614288 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7ed27-97e8-4601-8e28-ce8eb567ed7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:57.615890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7ed27-97e8-4601-8e28-ce8eb567ed7a None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:57.618474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7eb1b-e47e-4e40-81ec-7b63fe9b68bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:57.619379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7eb1b-e47e-4e40-81ec-7b63fe9b68bd None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:57.619834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7eb1b-e47e-4e40-81ec-7b63fe9b68bd None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:57.620253 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7eb1b-e47e-4e40-81ec-7b63fe9b68bd None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:57.621039 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7eb1b-e47e-4e40-81ec-7b63fe9b68bd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:57.621507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7eb1b-e47e-4e40-81ec-7b63fe9b68bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:57.623108 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7eb1b-e47e-4e40-81ec-7b63fe9b68bd None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:57.638631 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 345/707] 10.222.0.83 () {56 vars in 1124 bytes} [Fri Sep 23 01:06:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:57.638631 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7eb1b-e47e-4e40-81ec-7b63fe9b68bd None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:57.741751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:57.749477 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 363/708] 10.222.0.83 () {60 vars in 1132 bytes} [Fri Sep 23 01:06:57 2022] POST /identity/v3/users => generated 254 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:06:57.751770 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdae67-de03-4743-9742-053f5cba346b None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:57.752244 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdae67-de03-4743-9742-053f5cba346b None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:57.752730 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdae67-de03-4743-9742-053f5cba346b None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:57.763435 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 364/709] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:57 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:57.765888 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ead693-8057-4f55-8b01-38d3c72b09f5 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:57.766355 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ead693-8057-4f55-8b01-38d3c72b09f5 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:57.767593 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ead693-8057-4f55-8b01-38d3c72b09f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:57.824106 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-47ead693-8057-4f55-8b01-38d3c72b09f5 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:57.825995 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-47ead693-8057-4f55-8b01-38d3c72b09f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:57.848428 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7eb1b-e47e-4e40-81ec-7b63fe9b68bd None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:57.906737 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:57.921863 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8005924-d1c6-4594-aae3-5de80e272aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:57.922829 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8005924-d1c6-4594-aae3-5de80e272aaf None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:57.923371 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8005924-d1c6-4594-aae3-5de80e272aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:57.923838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8005924-d1c6-4594-aae3-5de80e272aaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:57.948876 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 365/710] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:58.028101 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8005924-d1c6-4594-aae3-5de80e272aaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:58.029627 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8005924-d1c6-4594-aae3-5de80e272aaf None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:58.124968 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:58.193067 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 346/711] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:06:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:06:58.199750 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ead693-8057-4f55-8b01-38d3c72b09f5 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:58.353995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8005924-d1c6-4594-aae3-5de80e272aaf None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:58.392680 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ead693-8057-4f55-8b01-38d3c72b09f5 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:58.444353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc326f-678f-452f-be73-6c59ff801cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:58.445113 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc326f-678f-452f-be73-6c59ff801cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:58.445396 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc326f-678f-452f-be73-6c59ff801cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:58.445671 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc326f-678f-452f-be73-6c59ff801cd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:58.463301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc326f-678f-452f-be73-6c59ff801cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:58.464785 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc326f-678f-452f-be73-6c59ff801cd8 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:58.493624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-22bc326f-678f-452f-be73-6c59ff801cd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:58.493624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:58.493624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:58.493624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:58.493624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:58.493624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:58.493624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:58.493624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:58.493624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:58.493624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:58.493624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:58.493624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:58.493624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:06:58.493624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:06:58.493624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:06:58.493624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:06:58.494796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:58.494796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:58.494796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:58.494796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:58.494796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:58.494796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:58.494796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:58.494796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:58.494796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:58.494796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:58.494796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:58.494796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:58.494796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:58.494796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:58.494796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:58.494796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:58.494796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:06:58.496214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:06:58.496214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:06:58.496214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:58.496214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 366/712] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:06:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:58.501972 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc326f-678f-452f-be73-6c59ff801cd8 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:58.543446 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8005924-d1c6-4594-aae3-5de80e272aaf None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:58.572315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:58.631219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b43073-ea2d-47b4-8435-2c2326ee3dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:58.631888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b43073-ea2d-47b4-8435-2c2326ee3dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:58.632164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b43073-ea2d-47b4-8435-2c2326ee3dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:58.632433 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b43073-ea2d-47b4-8435-2c2326ee3dc5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:58.633033 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b43073-ea2d-47b4-8435-2c2326ee3dc5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:58.634437 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b43073-ea2d-47b4-8435-2c2326ee3dc5 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:58.649383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-77b43073-ea2d-47b4-8435-2c2326ee3dc5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 01:06:58.649383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:58.649383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:06:58.649383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:06:58.649383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:06:58.649383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:06:58.649383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:06:58.649383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:06:58.649383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 01:06:58.649383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:58.649383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:06:58.649383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:58.649383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:58.649383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:58.649383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:58.649383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:58.649383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:58.650524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:58.650524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:58.650524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:58.650524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:58.650524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:58.650524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:58.650524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:06:58.650524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:06:58.650524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:06:58.650524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:06:58.650524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:58.650524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:58.650524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:58.650524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:58.650524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:58.650524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:58.651372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:58.651372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:58.651372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:58.651372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:58.651372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:58.651372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:58.651372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:58.651372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:58.651372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:58.651372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:58.651372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:06:58.651372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:06:58.651372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 01:06:58.651372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:06:58.652921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 347/713] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:58 2022] GET /identity/v3/services/network => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:58.661127 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b43073-ea2d-47b4-8435-2c2326ee3dc5 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:58.726702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc326f-678f-452f-be73-6c59ff801cd8 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:58.748453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:58.808176 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40fa56-1720-47e4-a3dc-15edbcb2f0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:58.808799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40fa56-1720-47e4-a3dc-15edbcb2f0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:58.809080 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40fa56-1720-47e4-a3dc-15edbcb2f0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:58.809355 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40fa56-1720-47e4-a3dc-15edbcb2f0b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:58.810016 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40fa56-1720-47e4-a3dc-15edbcb2f0b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:58.810318 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40fa56-1720-47e4-a3dc-15edbcb2f0b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:58.811768 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40fa56-1720-47e4-a3dc-15edbcb2f0b9 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:58.849461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 367/714] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:06:58.855773 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40fa56-1720-47e4-a3dc-15edbcb2f0b9 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:58.907002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b43073-ea2d-47b4-8435-2c2326ee3dc5 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:58.959133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921b154-9372-4de9-9554-d01173245897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:58.960032 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921b154-9372-4de9-9554-d01173245897 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:58.960310 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921b154-9372-4de9-9554-d01173245897 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:58.961051 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921b154-9372-4de9-9554-d01173245897 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:58.961855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921b154-9372-4de9-9554-d01173245897 None admin] RBAC: Adding query filter params (name=network) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:58.962279 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921b154-9372-4de9-9554-d01173245897 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:58.963759 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921b154-9372-4de9-9554-d01173245897 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:58.976801 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 348/715] 10.222.0.83 () {56 vars in 1112 bytes} [Fri Sep 23 01:06:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:58.978331 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8beb769-b88a-4907-95a0-68f981ab0566 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:58.978802 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8beb769-b88a-4907-95a0-68f981ab0566 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:58.979307 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8beb769-b88a-4907-95a0-68f981ab0566 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:58.985965 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 349/716] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:06:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:06:58.988102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8beb769-b88a-4907-95a0-68f981ab0566 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:59.005005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:59.024283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40fa56-1720-47e4-a3dc-15edbcb2f0b9 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:59.078681 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ea673-3941-4f14-8620-fa2032dcb993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:59.079813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ea673-3941-4f14-8620-fa2032dcb993 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:59.080597 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ea673-3941-4f14-8620-fa2032dcb993 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:59.081660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ea673-3941-4f14-8620-fa2032dcb993 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:59.093193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ea673-3941-4f14-8620-fa2032dcb993 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:59.095277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ea673-3941-4f14-8620-fa2032dcb993 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:59.114342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-115ea673-3941-4f14-8620-fa2032dcb993 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:59.114342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:59.114342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:59.114342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:59.114342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:59.114342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:59.114342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:59.114342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:59.114342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:59.114342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:59.114342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:59.114342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:59.114342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:06:59.114342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:06:59.114342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:06:59.115425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:06:59.115425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:06:59.115425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:06:59.115425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:06:59.115425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:06:59.115425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:06:59.115425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:06:59.115425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:06:59.115425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:06:59.115425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:06:59.115425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:06:59.115425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:06:59.115425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:06:59.115425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:06:59.115425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:06:59.115425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:06:59.115425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:06:59.116453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:06:59.116453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:06:59.116453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:06:59.116453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:06:59.116453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:06:59.116453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:06:59.116453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:06:59.116453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:06:59.120079 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 368/717] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:06:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:06:59.122177 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a19c45-958e-4a90-8f24-03f38edf0eeb None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:59.123404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a19c45-958e-4a90-8f24-03f38edf0eeb None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:59.123936 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a19c45-958e-4a90-8f24-03f38edf0eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:59.132432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:59.137252 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8beb769-b88a-4907-95a0-68f981ab0566 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:59.152480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-98a19c45-958e-4a90-8f24-03f38edf0eeb None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:06:59.154528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-98a19c45-958e-4a90-8f24-03f38edf0eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:06:59.182849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c789978-d88b-471e-9204-6e9836eacc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:59.184281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c789978-d88b-471e-9204-6e9836eacc6c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:59.184896 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c789978-d88b-471e-9204-6e9836eacc6c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:59.185481 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c789978-d88b-471e-9204-6e9836eacc6c None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:59.187149 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c789978-d88b-471e-9204-6e9836eacc6c None admin] RBAC: Adding query filter params (type=network) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:59.187731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c789978-d88b-471e-9204-6e9836eacc6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:59.189789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c789978-d88b-471e-9204-6e9836eacc6c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:59.203108 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 350/718] 10.222.0.83 () {56 vars in 1112 bytes} [Fri Sep 23 01:06:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:59.203108 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c789978-d88b-471e-9204-6e9836eacc6c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:59.279547 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 369/719] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:06:59.441038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c789978-d88b-471e-9204-6e9836eacc6c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:59.508064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b794a-618f-45e6-bfff-1ff48b087938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:59.509098 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b794a-618f-45e6-bfff-1ff48b087938 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:59.509582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b794a-618f-45e6-bfff-1ff48b087938 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:59.510032 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b794a-618f-45e6-bfff-1ff48b087938 None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:59.511300 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b794a-618f-45e6-bfff-1ff48b087938 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:59.511845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b794a-618f-45e6-bfff-1ff48b087938 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:59.514259 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b794a-618f-45e6-bfff-1ff48b087938 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:59.537468 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 351/720] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:06:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:59.543324 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a19c45-958e-4a90-8f24-03f38edf0eeb None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:59.668440 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:59.684737 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b794a-618f-45e6-bfff-1ff48b087938 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:06:59.696876 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a19c45-958e-4a90-8f24-03f38edf0eeb None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:59.735286 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:06:59.776209 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef04013-9061-45e2-b1ea-b6e9012fc7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:59.776962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef04013-9061-45e2-b1ea-b6e9012fc7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:59.777243 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef04013-9061-45e2-b1ea-b6e9012fc7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:59.777520 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef04013-9061-45e2-b1ea-b6e9012fc7f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:59.778260 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef04013-9061-45e2-b1ea-b6e9012fc7f4 None admin] RBAC: Adding query filter params (role.id=d365054bc34046c5829cd1355f3a31ac, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=824648d693af4b44ae5df853a3d258f5) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:06:59.778581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef04013-9061-45e2-b1ea-b6e9012fc7f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:06:59.782622 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef04013-9061-45e2-b1ea-b6e9012fc7f4 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:06:59.787216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 370/721] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:06:59 2022] GET /identity/v3/role_assignments?user.id=824648d693af4b44ae5df853a3d258f5&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=d365054bc34046c5829cd1355f3a31ac => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:06:59.903104 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b794a-618f-45e6-bfff-1ff48b087938 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:06:59.971397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0156b96-5a25-49fa-9084-aa150807da96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:06:59.971397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0156b96-5a25-49fa-9084-aa150807da96 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:06:59.971397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0156b96-5a25-49fa-9084-aa150807da96 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:06:59.971397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0156b96-5a25-49fa-9084-aa150807da96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:06:59.993009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0156b96-5a25-49fa-9084-aa150807da96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:06:59.998913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-b0156b96-5a25-49fa-9084-aa150807da96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:06:59.998913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:06:59.998913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:06:59.998913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:06:59.998913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:06:59.998913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:06:59.998913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:06:59.998913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:06:59.998913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:06:59.998913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:06:59.998913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:06:59.998913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:06:59.998913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:06:59.998913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:06:59.998913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:06:59.998913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:07:00.000658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:07:00.000658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:07:00.000658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:07:00.000658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:07:00.000658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:00.000658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:00.000658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:00.000658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:00.000658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:00.000658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:00.000658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:00.000658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:00.000658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:00.000658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:00.000658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:00.000658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:00.002292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:00.002292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:00.002292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:00.002292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:00.002292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:07:00.002292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:07:00.002292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:07:00.002292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:07:00.002292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:07:00.002292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:07:00.002292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:07:00.002292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:00.002292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 352/722] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:06:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:00.014632 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef04013-9061-45e2-b1ea-b6e9012fc7f4 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:00.225483 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef04013-9061-45e2-b1ea-b6e9012fc7f4 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:00.287304 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4b21e-3490-4df0-8bcd-5c921898f3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:00.288285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4b21e-3490-4df0-8bcd-5c921898f3fe None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:00.288285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4b21e-3490-4df0-8bcd-5c921898f3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:00.288540 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4b21e-3490-4df0-8bcd-5c921898f3fe None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:00.289349 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4b21e-3490-4df0-8bcd-5c921898f3fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:00.289658 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4b21e-3490-4df0-8bcd-5c921898f3fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:00.291149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4b21e-3490-4df0-8bcd-5c921898f3fe None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:00.301902 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 371/723] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:07:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:00.308007 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0156b96-5a25-49fa-9084-aa150807da96 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:00.459762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:00.480069 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0156b96-5a25-49fa-9084-aa150807da96 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:00.523209 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a323b8-b366-4eef-b326-da68c4c56888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:00.523956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a323b8-b366-4eef-b326-da68c4c56888 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:00.524236 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a323b8-b366-4eef-b326-da68c4c56888 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:00.524505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a323b8-b366-4eef-b326-da68c4c56888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:00.537418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a323b8-b366-4eef-b326-da68c4c56888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:00.539069 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a323b8-b366-4eef-b326-da68c4c56888 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:00.557673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-33a323b8-b366-4eef-b326-da68c4c56888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:00.557673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:00.557673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:00.557673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:00.557673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:00.557673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:00.557673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:00.557673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:00.557673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:00.557673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:00.557673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:00.557673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:00.557673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:00.557673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:00.557673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:00.557673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:00.559555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:00.559555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:00.559555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:00.559555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:00.559555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:00.559555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:00.559555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:00.559555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:00.559555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:00.559555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:00.559555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:00.559555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:00.559555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:00.559555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:00.559555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:00.559555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:00.559555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:00.561159 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:00.561159 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:00.561159 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:00.561159 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 353/724] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:00.565030 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4b21e-3490-4df0-8bcd-5c921898f3fe None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:00.570182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:00.731479 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4b21e-3490-4df0-8bcd-5c921898f3fe None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:00.820456 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa043d0-0b75-4725-aa04-de6e99ecfa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:00.822221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa043d0-0b75-4725-aa04-de6e99ecfa23 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:00.823001 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa043d0-0b75-4725-aa04-de6e99ecfa23 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:00.823785 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa043d0-0b75-4725-aa04-de6e99ecfa23 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:00.825321 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa043d0-0b75-4725-aa04-de6e99ecfa23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:00.826131 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa043d0-0b75-4725-aa04-de6e99ecfa23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:00.828869 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa043d0-0b75-4725-aa04-de6e99ecfa23 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:00.856172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 372/725] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:00.862281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a323b8-b366-4eef-b326-da68c4c56888 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:00.868743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763d588-47f5-443a-8cd7-6f3902ef8c72 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:00.869746 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763d588-47f5-443a-8cd7-6f3902ef8c72 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:00.870539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763d588-47f5-443a-8cd7-6f3902ef8c72 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:00.873832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 373/726] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:00.890430 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cf11e-dcaa-4376-b606-51945cc86e55 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:00.891296 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cf11e-dcaa-4376-b606-51945cc86e55 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:00.892073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cf11e-dcaa-4376-b606-51945cc86e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:00.926868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-b27cf11e-dcaa-4376-b606-51945cc86e55 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:00.929098 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b27cf11e-dcaa-4376-b606-51945cc86e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:01.023114 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:01.037542 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 374/727] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:07:01.121966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a323b8-b366-4eef-b326-da68c4c56888 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:01.173837 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f31f12-5fae-4a6a-a4b8-e2f8cbf1c50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:01.174619 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31f12-5fae-4a6a-a4b8-e2f8cbf1c50b None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:01.174914 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31f12-5fae-4a6a-a4b8-e2f8cbf1c50b None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:01.175845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31f12-5fae-4a6a-a4b8-e2f8cbf1c50b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:01.182120 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:01.188526 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f31f12-5fae-4a6a-a4b8-e2f8cbf1c50b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:01.190022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f31f12-5fae-4a6a-a4b8-e2f8cbf1c50b None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:01.208549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-b8f31f12-5fae-4a6a-a4b8-e2f8cbf1c50b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 01:07:01.208549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:01.208549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:01.208549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:01.208549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:01.208549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:01.208549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:01.208549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:01.208549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:01.208549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:01.208549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:01.208549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:01.208549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:07:01.208549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:07:01.208549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:07:01.208549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:07:01.211065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:01.211065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:01.211065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:07:01.211065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:01.211065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:07:01.211065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:01.211065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:01.211065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:01.211065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:01.211065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:01.211065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:01.211065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:01.211065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:01.211065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:01.211065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:01.211065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:01.211065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:01.211065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:01.213011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:01.213011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:01.213011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:07:01.213011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:07:01.213011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:07:01.213011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:07:01.213011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:07:01.213011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:07:01.213011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 23 01:07:01.213011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:01.213011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 354/728] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:07:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:01.217185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cf11e-dcaa-4376-b606-51945cc86e55 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:01.343119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cf11e-dcaa-4376-b606-51945cc86e55 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:01.385007 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98cdca-d01a-497b-ae3e-c532bdad1022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:01.385632 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98cdca-d01a-497b-ae3e-c532bdad1022 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:01.385906 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98cdca-d01a-497b-ae3e-c532bdad1022 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:01.386170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98cdca-d01a-497b-ae3e-c532bdad1022 None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:01.386939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98cdca-d01a-497b-ae3e-c532bdad1022 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:01.387263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98cdca-d01a-497b-ae3e-c532bdad1022 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:01.388816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98cdca-d01a-497b-ae3e-c532bdad1022 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:01.410643 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 375/729] 10.222.0.83 () {56 vars in 1135 bytes} [Fri Sep 23 01:07:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:01.416037 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f31f12-5fae-4a6a-a4b8-e2f8cbf1c50b None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:01.543003 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f31f12-5fae-4a6a-a4b8-e2f8cbf1c50b None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:01.559082 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98cdca-d01a-497b-ae3e-c532bdad1022 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:01.594757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d515f89-b2a0-4012-abe4-34b21f8db535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:01.594757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d515f89-b2a0-4012-abe4-34b21f8db535 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:01.594757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d515f89-b2a0-4012-abe4-34b21f8db535 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:01.594757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d515f89-b2a0-4012-abe4-34b21f8db535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:01.680033 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:01.690236 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d515f89-b2a0-4012-abe4-34b21f8db535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:01.696049 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d515f89-b2a0-4012-abe4-34b21f8db535 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:01.703290 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:01.794223 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98cdca-d01a-497b-ae3e-c532bdad1022 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:01.835775 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a3bb2-ecf7-453d-81b0-464a84dcabbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:01.836457 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a3bb2-ecf7-453d-81b0-464a84dcabbc None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:01.836736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a3bb2-ecf7-453d-81b0-464a84dcabbc None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:01.837003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a3bb2-ecf7-453d-81b0-464a84dcabbc None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:01.837678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a3bb2-ecf7-453d-81b0-464a84dcabbc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:01.840550 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a3bb2-ecf7-453d-81b0-464a84dcabbc None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:01.897988 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 355/730] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:07:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 01:07:01.900036 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50421b0-a6e3-4fe7-8c92-60a239bcc372 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:01.900530 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50421b0-a6e3-4fe7-8c92-60a239bcc372 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:01.901912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50421b0-a6e3-4fe7-8c92-60a239bcc372 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:01.903718 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 356/731] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:01.905263 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50421b0-a6e3-4fe7-8c92-60a239bcc372 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:01.963866 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 376/732] 10.222.0.83 () {60 vars in 1141 bytes} [Fri Sep 23 01:07:01 2022] POST /identity/v3/services => generated 251 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:07:01.965892 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bde84-35d1-4f3c-8691-3003c1a92e0e None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:01.966420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bde84-35d1-4f3c-8691-3003c1a92e0e None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:01.967016 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bde84-35d1-4f3c-8691-3003c1a92e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:02.008020 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-a06bde84-35d1-4f3c-8691-3003c1a92e0e None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:02.009749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a06bde84-35d1-4f3c-8691-3003c1a92e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:02.107122 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:02.133701 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50421b0-a6e3-4fe7-8c92-60a239bcc372 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:02.202101 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 377/733] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:07:02.219265 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280676c-9723-45de-b4c8-369a2f4a95ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:02.221075 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280676c-9723-45de-b4c8-369a2f4a95ba None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:02.222508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280676c-9723-45de-b4c8-369a2f4a95ba None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:02.223454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280676c-9723-45de-b4c8-369a2f4a95ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:02.251023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280676c-9723-45de-b4c8-369a2f4a95ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:02.252927 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280676c-9723-45de-b4c8-369a2f4a95ba None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:02.272020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-b280676c-9723-45de-b4c8-369a2f4a95ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:02.272020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:02.272020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:02.272020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:02.272020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:02.272020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:02.272020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:02.272020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:02.272020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:02.272020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:02.272020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:02.272020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:02.272020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:02.272020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:02.272020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:02.272020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:02.273080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:02.273080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:02.273080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:02.273080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:02.273080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:02.273080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:02.273080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:02.273080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:02.273080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:02.273080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:02.273080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:02.273080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:02.273080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:02.273080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:02.273080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:02.273080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:02.273080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:02.274067 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:02.274067 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:02.274067 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:02.276285 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 357/734] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:02.285684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bde84-35d1-4f3c-8691-3003c1a92e0e None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:02.376228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:02.486548 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bde84-35d1-4f3c-8691-3003c1a92e0e None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:02.555944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194dab7-15f2-4758-a1ff-fc294c1d9e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:02.556897 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194dab7-15f2-4758-a1ff-fc294c1d9e95 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:02.557328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194dab7-15f2-4758-a1ff-fc294c1d9e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:02.557753 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194dab7-15f2-4758-a1ff-fc294c1d9e95 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:02.558847 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194dab7-15f2-4758-a1ff-fc294c1d9e95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:02.559316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194dab7-15f2-4758-a1ff-fc294c1d9e95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:02.561661 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194dab7-15f2-4758-a1ff-fc294c1d9e95 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:02.595250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 378/735] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:02.596749 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280676c-9723-45de-b4c8-369a2f4a95ba None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:02.644718 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194dab7-15f2-4758-a1ff-fc294c1d9e95 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:02.846050 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280676c-9723-45de-b4c8-369a2f4a95ba None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:02.895562 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7f3c8-e3e6-4ee6-9063-27502fe1180b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:02.896686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7f3c8-e3e6-4ee6-9063-27502fe1180b None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:02.897144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7f3c8-e3e6-4ee6-9063-27502fe1180b None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:02.897683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7f3c8-e3e6-4ee6-9063-27502fe1180b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:02.907101 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7f3c8-e3e6-4ee6-9063-27502fe1180b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:02.910183 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7f3c8-e3e6-4ee6-9063-27502fe1180b None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:02.921833 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194dab7-15f2-4758-a1ff-fc294c1d9e95 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:02.924916 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:02.925520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-1ce7f3c8-e3e6-4ee6-9063-27502fe1180b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:02.925520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:02.925520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:02.925520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:02.925520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:02.925520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:02.925520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:02.925520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:02.925520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:02.925520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:02.925520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:02.925520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:02.925520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:07:02.925520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:07:02.925520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:07:02.926559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:07:02.926559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:02.926559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:02.926559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:02.926559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:02.926559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:02.926559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:02.926559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:02.926559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:02.926559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:02.926559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:02.926559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:02.926559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:02.926559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:02.926559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:02.926559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:02.926559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:02.927608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:07:02.927608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:07:02.927608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:07:02.927608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:07:02.927608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:07:02.927608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:07:02.927608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:02.927608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:02.930760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 358/736] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:07:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:02.932293 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254a0fb-2571-4fda-9efb-b47d42f986d1 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:02.932851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254a0fb-2571-4fda-9efb-b47d42f986d1 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:02.933278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254a0fb-2571-4fda-9efb-b47d42f986d1 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:02.939457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 359/737] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:02.940800 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254a0fb-2571-4fda-9efb-b47d42f986d1 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:02.945303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:02.993247 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9abd7-f5cb-489f-b9ae-1eab5b796f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:02.993914 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9abd7-f5cb-489f-b9ae-1eab5b796f5a None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:02.994191 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9abd7-f5cb-489f-b9ae-1eab5b796f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:02.994459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9abd7-f5cb-489f-b9ae-1eab5b796f5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:03.018509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9abd7-f5cb-489f-b9ae-1eab5b796f5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:07:03.028003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-3bd9abd7-f5cb-489f-b9ae-1eab5b796f5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:07:03.028003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:03.028003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:03.028003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:03.028003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:03.028003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:03.028003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:03.028003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:03.028003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:03.028003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:03.028003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:03.028003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:03.028003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:07:03.028003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:07:03.028003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:07:03.028003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:07:03.029205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:07:03.029205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:07:03.029205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:07:03.029205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:07:03.029205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:03.029205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:03.029205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:03.029205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:03.029205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:03.029205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:03.029205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:03.029205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:03.029205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:03.029205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:03.029205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:03.029205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:03.030043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:03.030043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:03.030043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:03.030043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:03.030043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:07:03.030043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:07:03.030043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:07:03.030043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:07:03.030043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:07:03.030043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:07:03.030043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:07:03.030043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:03.030043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 379/738] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:07:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:03.031631 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058ab3a-90e3-4ec9-887f-7356ccfa1732 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:03.031631 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058ab3a-90e3-4ec9-887f-7356ccfa1732 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:03.031917 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058ab3a-90e3-4ec9-887f-7356ccfa1732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:03.056208 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-2058ab3a-90e3-4ec9-887f-7356ccfa1732 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:03.057489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-2058ab3a-90e3-4ec9-887f-7356ccfa1732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:03.119482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254a0fb-2571-4fda-9efb-b47d42f986d1 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:03.174017 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 380/739] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:07:03.174017 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058ab3a-90e3-4ec9-887f-7356ccfa1732 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:03.195408 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6a101-df50-4228-85fa-f6e70a244b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:03.196617 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6a101-df50-4228-85fa-f6e70a244b1d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:03.197130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6a101-df50-4228-85fa-f6e70a244b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:03.197584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6a101-df50-4228-85fa-f6e70a244b1d None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:03.198515 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6a101-df50-4228-85fa-f6e70a244b1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:03.199043 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6a101-df50-4228-85fa-f6e70a244b1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:03.200871 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6a101-df50-4228-85fa-f6e70a244b1d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:03.229334 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 360/740] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:07:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:03.235099 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6a101-df50-4228-85fa-f6e70a244b1d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:03.339268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:03.376718 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:03.386196 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6a101-df50-4228-85fa-f6e70a244b1d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:03.396103 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058ab3a-90e3-4ec9-887f-7356ccfa1732 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:03.431910 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7cef0-1b7e-4bd1-9686-52c4934806e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:03.432967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7cef0-1b7e-4bd1-9686-52c4934806e1 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:03.433459 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7cef0-1b7e-4bd1-9686-52c4934806e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:03.434113 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7cef0-1b7e-4bd1-9686-52c4934806e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:03.435181 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7cef0-1b7e-4bd1-9686-52c4934806e1 None admin] RBAC: Adding query filter params (role.id=d365054bc34046c5829cd1355f3a31ac, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=c526c7ad227943d1a2bba7b5e2e039e0) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:03.435686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7cef0-1b7e-4bd1-9686-52c4934806e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:03.437345 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7cef0-1b7e-4bd1-9686-52c4934806e1 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:03.445634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 361/741] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:07:03 2022] GET /identity/v3/role_assignments?user.id=c526c7ad227943d1a2bba7b5e2e039e0&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=d365054bc34046c5829cd1355f3a31ac => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:03.448587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2250ac-d084-4172-b3b8-f35ff11bf41a None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:03.449164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2250ac-d084-4172-b3b8-f35ff11bf41a None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:03.449620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2250ac-d084-4172-b3b8-f35ff11bf41a None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:03.452002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 362/742] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:03.459633 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a87c8c-dd04-48e9-bc7e-c3aa4fc00edc None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:03.460284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a87c8c-dd04-48e9-bc7e-c3aa4fc00edc None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:03.460841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a87c8c-dd04-48e9-bc7e-c3aa4fc00edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:03.492616 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838c540-fbef-49d3-9eea-07834ec08d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:03.494396 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838c540-fbef-49d3-9eea-07834ec08d50 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:03.496277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838c540-fbef-49d3-9eea-07834ec08d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:03.496798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838c540-fbef-49d3-9eea-07834ec08d50 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:03.498915 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838c540-fbef-49d3-9eea-07834ec08d50 None admin] RBAC: Adding query filter params (name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:03.499616 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838c540-fbef-49d3-9eea-07834ec08d50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:03.502880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838c540-fbef-49d3-9eea-07834ec08d50 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:03.508598 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-b2a87c8c-dd04-48e9-bc7e-c3aa4fc00edc None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:03.510629 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b2a87c8c-dd04-48e9-bc7e-c3aa4fc00edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:03.524558 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 381/743] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:07:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:03.531988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838c540-fbef-49d3-9eea-07834ec08d50 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:03.658007 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 363/744] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 01:07:03.658866 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a87c8c-dd04-48e9-bc7e-c3aa4fc00edc None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:03.747774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:03.766231 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838c540-fbef-49d3-9eea-07834ec08d50 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:03.822393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a87c8c-dd04-48e9-bc7e-c3aa4fc00edc None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:03.867443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a997d-d03a-47db-a259-4b62281c94a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:03.868105 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a997d-d03a-47db-a259-4b62281c94a2 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:03.868437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a997d-d03a-47db-a259-4b62281c94a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:03.868714 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a997d-d03a-47db-a259-4b62281c94a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:03.884451 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a997d-d03a-47db-a259-4b62281c94a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:03.886237 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a997d-d03a-47db-a259-4b62281c94a2 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:03.923275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-bf0a997d-d03a-47db-a259-4b62281c94a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:03.923275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:03.923275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:03.923275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:03.923275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:03.923275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:03.923275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:03.923275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:03.923275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:03.923275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:03.923275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:03.923275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:03.923275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:03.923275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:03.923275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:03.923275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:03.925097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:03.925097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:03.925097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:03.925097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:03.925097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:03.925097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:03.925097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:03.925097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:03.925097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:03.925097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:03.925097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:03.925097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:03.925097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:03.925097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:03.925097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:03.925097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:03.925097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:03.927635 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:03.927635 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:03.927635 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:03.930800 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 382/745] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:03.938606 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a6f23-e51d-473e-b57e-715d33697354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:03.939420 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a6f23-e51d-473e-b57e-715d33697354 None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:03.939560 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a6f23-e51d-473e-b57e-715d33697354 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:03.939893 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a6f23-e51d-473e-b57e-715d33697354 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:03.940309 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a997d-d03a-47db-a259-4b62281c94a2 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:03.940476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a6f23-e51d-473e-b57e-715d33697354 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:03.945988 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a6f23-e51d-473e-b57e-715d33697354 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:03.963738 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:04.032889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 364/746] 10.222.0.83 () {60 vars in 1141 bytes} [Fri Sep 23 01:07:03 2022] POST /identity/v3/services => generated 240 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:07:04.034309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a6f23-e51d-473e-b57e-715d33697354 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:04.235803 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a997d-d03a-47db-a259-4b62281c94a2 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:04.334823 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da3373-888f-4944-bf4b-5f63f8c05fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:04.335482 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da3373-888f-4944-bf4b-5f63f8c05fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:04.335759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da3373-888f-4944-bf4b-5f63f8c05fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:04.336303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da3373-888f-4944-bf4b-5f63f8c05fe8 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:04.337131 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da3373-888f-4944-bf4b-5f63f8c05fe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:04.337835 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da3373-888f-4944-bf4b-5f63f8c05fe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:04.340138 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da3373-888f-4944-bf4b-5f63f8c05fe8 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:04.342436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a6f23-e51d-473e-b57e-715d33697354 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:04.356745 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 383/747] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:04.362991 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da3373-888f-4944-bf4b-5f63f8c05fe8 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:04.371680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:04.399757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d57ff2-2952-48d4-943f-a7bae88fb6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:04.401404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d57ff2-2952-48d4-943f-a7bae88fb6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:04.402074 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d57ff2-2952-48d4-943f-a7bae88fb6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:04.402558 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d57ff2-2952-48d4-943f-a7bae88fb6e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:04.421198 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d57ff2-2952-48d4-943f-a7bae88fb6e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:07:04.429510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-36d57ff2-2952-48d4-943f-a7bae88fb6e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:07:04.429510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:04.429510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:04.429510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:04.429510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:04.429510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:04.429510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:04.429510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:04.429510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:04.429510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:04.429510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:04.429510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:04.429510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:07:04.429510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:07:04.429510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:07:04.429510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:07:04.431082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:07:04.431082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:07:04.431082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:07:04.431082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:07:04.431082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:04.431082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:04.431082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:04.431082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:04.431082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:04.431082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:04.431082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:04.431082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:04.431082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:04.431082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:04.431082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:04.431082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:04.431989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:04.431989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:04.431989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:04.431989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:04.431989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:07:04.431989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:07:04.431989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:07:04.431989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:07:04.431989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:07:04.431989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:07:04.431989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:07:04.431989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:04.435587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 365/748] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:07:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:04.442646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d57ff2-2952-48d4-943f-a7bae88fb6e2 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:04.457214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:04.535961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da3373-888f-4944-bf4b-5f63f8c05fe8 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:04.609109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608fd49-efd8-424b-92b4-df4ae40f2af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:04.609760 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608fd49-efd8-424b-92b4-df4ae40f2af9 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:04.610037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608fd49-efd8-424b-92b4-df4ae40f2af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:04.610306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608fd49-efd8-424b-92b4-df4ae40f2af9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:04.628205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608fd49-efd8-424b-92b4-df4ae40f2af9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:04.630335 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608fd49-efd8-424b-92b4-df4ae40f2af9 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:04.647771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d57ff2-2952-48d4-943f-a7bae88fb6e2 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:04.654466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-f608fd49-efd8-424b-92b4-df4ae40f2af9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 01:07:04.654466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:04.654466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:04.654466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:04.654466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:04.654466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:04.654466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:04.654466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:04.654466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:04.654466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:04.654466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:04.654466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:04.654466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:07:04.654466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:07:04.654466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:07:04.654466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:07:04.655702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:04.655702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:04.655702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:07:04.655702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:04.655702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:07:04.655702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:04.655702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:04.655702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:04.655702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:04.655702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:04.655702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:04.655702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:04.655702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:04.655702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:04.655702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:04.655702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:04.655702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:04.655702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:04.656644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:04.656644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:04.656644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:07:04.656644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:07:04.656644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:07:04.656644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:07:04.656644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:07:04.656644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:07:04.656644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 01:07:04.656644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:04.656644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 384/749] 10.222.0.83 () {56 vars in 1117 bytes} [Fri Sep 23 01:07:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:04.664150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608fd49-efd8-424b-92b4-df4ae40f2af9 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:04.728353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00846225-2b47-44e0-b0d3-88116807e97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:04.728996 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00846225-2b47-44e0-b0d3-88116807e97f None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:04.729268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00846225-2b47-44e0-b0d3-88116807e97f None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:04.729540 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00846225-2b47-44e0-b0d3-88116807e97f None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:04.730218 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00846225-2b47-44e0-b0d3-88116807e97f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:04.730518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00846225-2b47-44e0-b0d3-88116807e97f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:04.731952 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00846225-2b47-44e0-b0d3-88116807e97f None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:04.750901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 366/750] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:07:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:04.757525 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00846225-2b47-44e0-b0d3-88116807e97f None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:04.811098 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:04.892128 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608fd49-efd8-424b-92b4-df4ae40f2af9 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:04.897498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00846225-2b47-44e0-b0d3-88116807e97f None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:04.937571 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:04.954398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca7e5b-b808-432e-9507-b57f9a4fed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:04.955660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca7e5b-b808-432e-9507-b57f9a4fed88 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:04.956149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca7e5b-b808-432e-9507-b57f9a4fed88 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:04.956659 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca7e5b-b808-432e-9507-b57f9a4fed88 None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:04.957667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca7e5b-b808-432e-9507-b57f9a4fed88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:04.958178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca7e5b-b808-432e-9507-b57f9a4fed88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:04.960710 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca7e5b-b808-432e-9507-b57f9a4fed88 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:04.990804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bdbc9-26df-4a7c-b6a4-8cb01319cdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:04.992918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bdbc9-26df-4a7c-b6a4-8cb01319cdc5 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:04.993599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bdbc9-26df-4a7c-b6a4-8cb01319cdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:04.995676 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 385/751] 10.222.0.83 () {56 vars in 1149 bytes} [Fri Sep 23 01:07:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:04.996174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bdbc9-26df-4a7c-b6a4-8cb01319cdc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:05.003801 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca7e5b-b808-432e-9507-b57f9a4fed88 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:05.009843 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8bdbc9-26df-4a7c-b6a4-8cb01319cdc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:05.012215 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8bdbc9-26df-4a7c-b6a4-8cb01319cdc5 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:05.029434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-0e8bdbc9-26df-4a7c-b6a4-8cb01319cdc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:05.029434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:05.029434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:05.029434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:05.029434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:05.029434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:05.029434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:05.029434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:05.029434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:05.029434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:05.029434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:05.029434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:05.029434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:05.029434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:05.029434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:05.029434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:05.030618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:05.030618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:05.030618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:05.030618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:05.030618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:05.030618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:05.030618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:05.030618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:05.030618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:05.030618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:05.030618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:05.030618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:05.030618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:05.030618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:05.030618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:05.030618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:05.030618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:05.031680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:05.031680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:05.031680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:05.033899 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 367/752] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:05.040538 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bdbc9-26df-4a7c-b6a4-8cb01319cdc5 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:05.162281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:05.173740 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bdbc9-26df-4a7c-b6a4-8cb01319cdc5 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:05.214265 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc13d1-8c99-4d9b-a991-2d78033b6f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:05.216660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc13d1-8c99-4d9b-a991-2d78033b6f1e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:05.217232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc13d1-8c99-4d9b-a991-2d78033b6f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:05.217726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc13d1-8c99-4d9b-a991-2d78033b6f1e None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:05.218615 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc13d1-8c99-4d9b-a991-2d78033b6f1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:05.219210 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc13d1-8c99-4d9b-a991-2d78033b6f1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:05.220863 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc13d1-8c99-4d9b-a991-2d78033b6f1e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:05.236720 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 368/753] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:05.243594 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc13d1-8c99-4d9b-a991-2d78033b6f1e None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:05.255952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca7e5b-b808-432e-9507-b57f9a4fed88 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:05.336029 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1eb2b-53b3-4cb6-9b48-539138c325d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:05.336891 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1eb2b-53b3-4cb6-9b48-539138c325d2 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:05.337171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1eb2b-53b3-4cb6-9b48-539138c325d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:05.337443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1eb2b-53b3-4cb6-9b48-539138c325d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:05.401755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc13d1-8c99-4d9b-a991-2d78033b6f1e None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:05.408389 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:05.446003 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad66687-7f77-42b3-bcef-65e57b8d6d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:05.446931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad66687-7f77-42b3-bcef-65e57b8d6d16 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:05.447210 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad66687-7f77-42b3-bcef-65e57b8d6d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:05.447475 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad66687-7f77-42b3-bcef-65e57b8d6d16 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:05.459283 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad66687-7f77-42b3-bcef-65e57b8d6d16 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:05.460440 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1eb2b-53b3-4cb6-9b48-539138c325d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:05.461796 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad66687-7f77-42b3-bcef-65e57b8d6d16 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:05.464976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1eb2b-53b3-4cb6-9b48-539138c325d2 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:05.483374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-3ad66687-7f77-42b3-bcef-65e57b8d6d16 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 01:07:05.483374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:05.483374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:05.483374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:05.483374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:05.483374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:05.483374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:05.483374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:05.483374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:05.483374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:05.483374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:05.483374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:05.483374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:07:05.483374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:07:05.483374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:07:05.483374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:07:05.485289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:05.485289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:05.485289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:07:05.485289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:05.485289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:07:05.485289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:05.485289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:05.485289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:05.485289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:05.485289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:05.485289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:05.485289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:05.485289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:05.485289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:05.485289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:05.485289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:05.485289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:05.485289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:05.486973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:05.486973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:05.486973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:07:05.486973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:07:05.486973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:07:05.486973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:07:05.486973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:07:05.486973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:07:05.486973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 01:07:05.486973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:05.489574 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 369/754] 10.222.0.83 () {56 vars in 1093 bytes} [Fri Sep 23 01:07:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:05.491247 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6401bda-4aef-4fb0-85f0-cebaafce5e11 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:05.491526 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6401bda-4aef-4fb0-85f0-cebaafce5e11 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:05.491798 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6401bda-4aef-4fb0-85f0-cebaafce5e11 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:05.498183 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 370/755] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:05.498805 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6401bda-4aef-4fb0-85f0-cebaafce5e11 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:05.516697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:05.651168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 386/756] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:07:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 01:07:05.652915 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d0d7f-8ce3-405a-b820-12ad89001751 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:05.653313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d0d7f-8ce3-405a-b820-12ad89001751 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:05.653545 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d0d7f-8ce3-405a-b820-12ad89001751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:05.679922 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-041d0d7f-8ce3-405a-b820-12ad89001751 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:05.681185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-041d0d7f-8ce3-405a-b820-12ad89001751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:05.686343 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6401bda-4aef-4fb0-85f0-cebaafce5e11 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:05.741061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6160d-e1ad-423f-807e-7f67ce85cd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:05.741583 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6160d-e1ad-423f-807e-7f67ce85cd02 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:05.741862 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6160d-e1ad-423f-807e-7f67ce85cd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:05.742132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6160d-e1ad-423f-807e-7f67ce85cd02 None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:05.742990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6160d-e1ad-423f-807e-7f67ce85cd02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:05.743302 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6160d-e1ad-423f-807e-7f67ce85cd02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:05.744834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6160d-e1ad-423f-807e-7f67ce85cd02 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:05.767683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 371/757] 10.222.0.83 () {56 vars in 1133 bytes} [Fri Sep 23 01:07:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:05.773128 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6160d-e1ad-423f-807e-7f67ce85cd02 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:05.822778 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 387/758] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:05.824764 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d0d7f-8ce3-405a-b820-12ad89001751 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:05.852581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:05.910024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:06.000071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6160d-e1ad-423f-807e-7f67ce85cd02 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:06.060488 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d0d7f-8ce3-405a-b820-12ad89001751 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:06.124737 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e42687-3e8b-4640-88df-669dbc7ed243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:06.125823 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e42687-3e8b-4640-88df-669dbc7ed243 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:06.126311 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e42687-3e8b-4640-88df-669dbc7ed243 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:06.126825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e42687-3e8b-4640-88df-669dbc7ed243 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:06.133272 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a9f98-df0d-4452-b6df-fee3a2a1d649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:06.134369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a9f98-df0d-4452-b6df-fee3a2a1d649 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:06.134901 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a9f98-df0d-4452-b6df-fee3a2a1d649 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:06.135529 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a9f98-df0d-4452-b6df-fee3a2a1d649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:06.157813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a9f98-df0d-4452-b6df-fee3a2a1d649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:06.160699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a9f98-df0d-4452-b6df-fee3a2a1d649 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:06.169236 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e42687-3e8b-4640-88df-669dbc7ed243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:06.171167 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e42687-3e8b-4640-88df-669dbc7ed243 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:06.195910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-219a9f98-df0d-4452-b6df-fee3a2a1d649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:06.195910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:06.195910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:06.195910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:06.195910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:06.195910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:06.195910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:06.195910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:06.195910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:06.195910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:06.195910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:06.195910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:06.195910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:06.195910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:06.195910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:06.195910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:06.197587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:06.197587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:06.197587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:06.197587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:06.197587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:06.197587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:06.197587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:06.197587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:06.197587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:06.197587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:06.197587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:06.197587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:06.197587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:06.197587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:06.197587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:06.197587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:06.197587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:06.198454 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:06.198454 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:06.198454 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:06.198666 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 388/759] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:06.207275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-60e42687-3e8b-4640-88df-669dbc7ed243 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:06.207275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:06.207275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:06.207275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:06.207275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:06.207275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:06.207275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:06.207275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:06.207275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:06.207275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:06.207275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:06.207275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:06.207275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:06.207275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:06.207275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:06.207275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:06.208275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:06.208275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:06.208275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:06.208275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:06.208275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:06.208275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:06.208275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:06.208275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:06.208275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:06.208275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:06.208275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:06.208275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:06.208275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:06.208275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:06.208275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:06.208275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:06.208275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:06.209178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:06.209178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:06.209178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:06.211411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 372/760] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 443 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:06.218391 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a9f98-df0d-4452-b6df-fee3a2a1d649 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:06.219100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e42687-3e8b-4640-88df-669dbc7ed243 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:06.325597 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:06.380509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a9f98-df0d-4452-b6df-fee3a2a1d649 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:06.395712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e42687-3e8b-4640-88df-669dbc7ed243 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:06.430496 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:06.438207 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356760fe-92f1-44b8-9a20-e0250928a01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:06.439730 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356760fe-92f1-44b8-9a20-e0250928a01d None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:06.440823 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356760fe-92f1-44b8-9a20-e0250928a01d None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:06.441509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356760fe-92f1-44b8-9a20-e0250928a01d None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:06.444463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356760fe-92f1-44b8-9a20-e0250928a01d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:06.444463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356760fe-92f1-44b8-9a20-e0250928a01d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:06.445055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356760fe-92f1-44b8-9a20-e0250928a01d None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:06.446136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cd7bb-f901-42b4-8afe-4ef250e0da16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:06.447140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cd7bb-f901-42b4-8afe-4ef250e0da16 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:06.447419 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cd7bb-f901-42b4-8afe-4ef250e0da16 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:06.447691 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cd7bb-f901-42b4-8afe-4ef250e0da16 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:06.448898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491cd7bb-f901-42b4-8afe-4ef250e0da16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:06.449226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491cd7bb-f901-42b4-8afe-4ef250e0da16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:06.451127 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491cd7bb-f901-42b4-8afe-4ef250e0da16 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:06.476639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 373/761] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:06.476639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cd7bb-f901-42b4-8afe-4ef250e0da16 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:06.477714 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 389/762] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:06.479912 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356760fe-92f1-44b8-9a20-e0250928a01d None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:06.647841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cd7bb-f901-42b4-8afe-4ef250e0da16 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:06.660204 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356760fe-92f1-44b8-9a20-e0250928a01d None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:06.704626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:06.711513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08226115-c791-45eb-8295-3f6d8d8ff903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:06.712987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226115-c791-45eb-8295-3f6d8d8ff903 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:06.714243 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226115-c791-45eb-8295-3f6d8d8ff903 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:06.715262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226115-c791-45eb-8295-3f6d8d8ff903 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:06.716264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08226115-c791-45eb-8295-3f6d8d8ff903 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:06.717904 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08226115-c791-45eb-8295-3f6d8d8ff903 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:06.730843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a03e7-dfc5-416c-bc30-22976edab3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:06.731983 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a03e7-dfc5-416c-bc30-22976edab3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:06.732659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-08226115-c791-45eb-8295-3f6d8d8ff903 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 01:07:06.732659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:06.732659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:06.732659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:06.732659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:06.732659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:06.732659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:06.732659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:06.732659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 01:07:06.732659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:06.732659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:06.732659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:06.732659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:06.732659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:06.732659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:06.732659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:06.732659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:06.733726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:06.733726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:06.733726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:06.733726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:06.733726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:06.733726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:06.733726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:06.733726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:06.733726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:06.733726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:06.733726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:06.733726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:06.733726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:06.733726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:06.733726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:06.733726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:06.734757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:06.734757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:06.734757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:06.734757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:06.734757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:06.734757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:06.734757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:06.734757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:06.734757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:06.734757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:06.734757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:06.734757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:06.734757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 01:07:06.734757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:06.735583 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a03e7-dfc5-416c-bc30-22976edab3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:06.735583 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a03e7-dfc5-416c-bc30-22976edab3d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:06.738143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 374/763] 10.222.0.83 () {56 vars in 1129 bytes} [Fri Sep 23 01:07:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:06.739273 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08226115-c791-45eb-8295-3f6d8d8ff903 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:06.749256 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a03e7-dfc5-416c-bc30-22976edab3d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:06.751716 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a03e7-dfc5-416c-bc30-22976edab3d3 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:06.774150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-b87a03e7-dfc5-416c-bc30-22976edab3d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:06.774150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:06.774150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:06.774150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:06.774150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:06.774150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:06.774150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:06.774150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:06.774150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:06.774150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:06.774150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:06.774150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:06.774150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:07:06.774150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:07:06.774150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:07:06.775554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:07:06.775554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:06.775554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:06.775554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:06.775554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:06.775554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:06.775554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:06.775554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:06.775554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:06.775554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:06.775554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:06.775554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:06.775554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:06.775554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:06.775554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:06.775554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:06.775554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:06.777093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:07:06.777093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:07:06.777093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:07:06.777093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:07:06.777093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:07:06.777093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:07:06.777093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:06.777093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:06.786156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 390/764] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:07:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:06.786156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a03e7-dfc5-416c-bc30-22976edab3d3 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:06.843982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:06.940076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08226115-c791-45eb-8295-3f6d8d8ff903 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:06.985425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a03e7-dfc5-416c-bc30-22976edab3d3 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:06.999073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550d977-429c-4735-842d-29905bd496c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:07.000304 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550d977-429c-4735-842d-29905bd496c7 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:07.000913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550d977-429c-4735-842d-29905bd496c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:07.001136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550d977-429c-4735-842d-29905bd496c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:07.010505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550d977-429c-4735-842d-29905bd496c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:07.012290 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550d977-429c-4735-842d-29905bd496c7 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:07.026760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-4550d977-429c-4735-842d-29905bd496c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:07.026760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:07.026760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:07.026760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:07.026760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:07.026760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:07.026760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:07.026760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:07.026760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:07.026760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:07.026760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:07.026760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:07.026760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:07:07.026760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:07:07.026760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:07:07.028520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:07:07.028520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:07.028520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:07.028520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:07.028520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:07.028520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:07.028520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:07.028520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:07.028520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:07.028520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:07.028520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:07.028520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:07.028520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:07.028520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:07.028520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:07.028520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:07.028520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:07.030284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:07:07.030284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:07:07.030284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:07:07.030284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:07:07.030284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:07:07.030284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:07:07.030284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:07.030284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:07.030284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 375/765] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:07:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:07.030284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550d977-429c-4735-842d-29905bd496c7 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:07.043249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb78fe7-a825-4e87-8805-16b91da569b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:07.043866 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb78fe7-a825-4e87-8805-16b91da569b0 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:07.044139 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb78fe7-a825-4e87-8805-16b91da569b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:07.044396 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb78fe7-a825-4e87-8805-16b91da569b0 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:07.045047 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb78fe7-a825-4e87-8805-16b91da569b0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:07.045479 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb78fe7-a825-4e87-8805-16b91da569b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:07.046970 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb78fe7-a825-4e87-8805-16b91da569b0 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:07.059548 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 391/766] 10.222.0.83 () {56 vars in 1124 bytes} [Fri Sep 23 01:07:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:07.059548 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef55aa-0d2c-4080-a46d-672005a1241e None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:07.059548 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef55aa-0d2c-4080-a46d-672005a1241e None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:07.059548 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef55aa-0d2c-4080-a46d-672005a1241e None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:07.062669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 392/767] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:07.063001 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef55aa-0d2c-4080-a46d-672005a1241e None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:07.131835 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:07.187270 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550d977-429c-4735-842d-29905bd496c7 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:07.200467 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:07.227660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef55aa-0d2c-4080-a46d-672005a1241e None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:07.239190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056faa5-8eee-4f13-9c26-92afbaf6b38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:07.239825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056faa5-8eee-4f13-9c26-92afbaf6b38c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:07.240122 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056faa5-8eee-4f13-9c26-92afbaf6b38c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:07.240396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056faa5-8eee-4f13-9c26-92afbaf6b38c None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:07.241249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056faa5-8eee-4f13-9c26-92afbaf6b38c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:07.241559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056faa5-8eee-4f13-9c26-92afbaf6b38c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:07.243215 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056faa5-8eee-4f13-9c26-92afbaf6b38c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:07.268432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 376/768] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:07:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:07.268432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261dcdb-de26-4bc3-8ab8-2081599c49f6 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:07.268432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261dcdb-de26-4bc3-8ab8-2081599c49f6 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:07.268432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261dcdb-de26-4bc3-8ab8-2081599c49f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:07.288269 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-5261dcdb-de26-4bc3-8ab8-2081599c49f6 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:07.289579 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-5261dcdb-de26-4bc3-8ab8-2081599c49f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:07.293751 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c45cb-e3ac-4682-9f79-01dfe23863b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:07.294501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c45cb-e3ac-4682-9f79-01dfe23863b4 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:07.294867 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c45cb-e3ac-4682-9f79-01dfe23863b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:07.295263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c45cb-e3ac-4682-9f79-01dfe23863b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:07.296445 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c45cb-e3ac-4682-9f79-01dfe23863b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:07.296930 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c45cb-e3ac-4682-9f79-01dfe23863b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:07.298846 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c45cb-e3ac-4682-9f79-01dfe23863b4 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:07.315936 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 393/769] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:07:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:07.317335 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c45cb-e3ac-4682-9f79-01dfe23863b4 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:07.397280 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 377/770] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:07.398777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261dcdb-de26-4bc3-8ab8-2081599c49f6 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:07.511943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c45cb-e3ac-4682-9f79-01dfe23863b4 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:07.521936 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:07.560419 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:07.570012 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261dcdb-de26-4bc3-8ab8-2081599c49f6 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:07.581705 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73156617-9716-4544-9d03-611158724215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:07.582810 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73156617-9716-4544-9d03-611158724215 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:07.583299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73156617-9716-4544-9d03-611158724215 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:07.583816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73156617-9716-4544-9d03-611158724215 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:07.584995 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73156617-9716-4544-9d03-611158724215 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:07.585689 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73156617-9716-4544-9d03-611158724215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:07.588330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73156617-9716-4544-9d03-611158724215 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:07.608019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 394/771] 10.222.0.83 () {56 vars in 1124 bytes} [Fri Sep 23 01:07:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:07.608019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92336f-247d-4bd9-a75f-7b5dfb47d915 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:07.608019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92336f-247d-4bd9-a75f-7b5dfb47d915 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:07.608019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92336f-247d-4bd9-a75f-7b5dfb47d915 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:07.608019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 395/772] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:07.608019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92336f-247d-4bd9-a75f-7b5dfb47d915 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:07.636642 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd971422-bc6e-41cd-98bc-f90d3692de41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:07.637267 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd971422-bc6e-41cd-98bc-f90d3692de41 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:07.637625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd971422-bc6e-41cd-98bc-f90d3692de41 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:07.637897 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd971422-bc6e-41cd-98bc-f90d3692de41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:07.638689 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd971422-bc6e-41cd-98bc-f90d3692de41 None admin] RBAC: Adding query filter params (role.id=2e8d92bd39634bbdad03d67d3fc439f0, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=f2cea4c08f324769bf6dcea58c9394b3) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:07.639133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd971422-bc6e-41cd-98bc-f90d3692de41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:07.640676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd971422-bc6e-41cd-98bc-f90d3692de41 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:07.658630 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 378/773] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:07:07 2022] GET /identity/v3/role_assignments?user.id=f2cea4c08f324769bf6dcea58c9394b3&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=2e8d92bd39634bbdad03d67d3fc439f0 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:07.658630 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd971422-bc6e-41cd-98bc-f90d3692de41 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:07.775722 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92336f-247d-4bd9-a75f-7b5dfb47d915 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:07.822575 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d999e-48ed-4e86-b316-dda1b1854a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:07.823325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d999e-48ed-4e86-b316-dda1b1854a3e None admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:07.823644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d999e-48ed-4e86-b316-dda1b1854a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:07.824064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d999e-48ed-4e86-b316-dda1b1854a3e None admin] PATH_INFO: `/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/824648d693af4b44ae5df853a3d258f5/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:07.826995 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d999e-48ed-4e86-b316-dda1b1854a3e None admin] RBAC: Authorizing `identity:create_grant(project_id=78d0895fea004a02b1d8338f5fb0250c, user_id=824648d693af4b44ae5df853a3d258f5, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:07.828909 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d999e-48ed-4e86-b316-dda1b1854a3e None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:07.833451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd971422-bc6e-41cd-98bc-f90d3692de41 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:07.897623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a92559-77dd-4e3b-9740-9ffd283f6fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:07.898399 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a92559-77dd-4e3b-9740-9ffd283f6fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:07.898711 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a92559-77dd-4e3b-9740-9ffd283f6fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:07.898987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a92559-77dd-4e3b-9740-9ffd283f6fb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:07.899952 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a92559-77dd-4e3b-9740-9ffd283f6fb5 None admin] RBAC: Adding query filter params (interface=public, service_id=8cacc88d41d74db091c56c5739ea9ccc, region_id=RegionOne) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:07.900264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a92559-77dd-4e3b-9740-9ffd283f6fb5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:07.901775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a92559-77dd-4e3b-9740-9ffd283f6fb5 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:07.912472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 396/774] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:07:07 2022] PUT /identity/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/824648d693af4b44ae5df853a3d258f5/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:07:07.913100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 379/775] 10.222.0.83 () {56 vars in 1251 bytes} [Fri Sep 23 01:07:07 2022] GET /identity/v3/endpoints?service_id=8cacc88d41d74db091c56c5739ea9ccc&interface=public®ion_id=RegionOne => generated 194 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:07.914009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a92559-77dd-4e3b-9740-9ffd283f6fb5 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:07.916015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4b2bc-3e2a-48a0-a884-fe3d7a8ab68e None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:07.916503 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4b2bc-3e2a-48a0-a884-fe3d7a8ab68e None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:07.916990 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4b2bc-3e2a-48a0-a884-fe3d7a8ab68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:07.962649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-29f4b2bc-3e2a-48a0-a884-fe3d7a8ab68e None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:07.964817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-29f4b2bc-3e2a-48a0-a884-fe3d7a8ab68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:07.991786 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:08.017628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:08.122812 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 397/776] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:08.124581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4b2bc-3e2a-48a0-a884-fe3d7a8ab68e None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:08.179921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a92559-77dd-4e3b-9740-9ffd283f6fb5 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:08.298963 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbd9b4-04ba-4e55-9d6d-922df53d0658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:08.300519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbd9b4-04ba-4e55-9d6d-922df53d0658 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:08.300986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbd9b4-04ba-4e55-9d6d-922df53d0658 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:08.301457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbd9b4-04ba-4e55-9d6d-922df53d0658 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:08.328160 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4b2bc-3e2a-48a0-a884-fe3d7a8ab68e None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:08.342714 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbd9b4-04ba-4e55-9d6d-922df53d0658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:07:08.353404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-25cbd9b4-04ba-4e55-9d6d-922df53d0658 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:07:08.353404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:08.353404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:08.353404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:08.353404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:08.353404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:08.353404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:08.353404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:08.353404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:08.353404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:08.353404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:08.353404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:08.353404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:07:08.353404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:07:08.353404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:07:08.353404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:07:08.354411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:07:08.354411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:07:08.354411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:07:08.354411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:07:08.354411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:08.354411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:08.354411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:08.354411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:08.354411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:08.354411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:08.354411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:08.354411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:08.354411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:08.354411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:08.354411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:08.354411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:08.355277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:08.355277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:08.355277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:08.355277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:08.355277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:07:08.355277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:07:08.355277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:07:08.355277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:07:08.355277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:07:08.355277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:07:08.355277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:07:08.355277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:08.355906 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 380/777] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:07:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:08.365936 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbd9b4-04ba-4e55-9d6d-922df53d0658 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:08.405693 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e0c09-43e3-4003-aa28-704e5a30edf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:08.406891 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e0c09-43e3-4003-aa28-704e5a30edf5 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:08.407379 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e0c09-43e3-4003-aa28-704e5a30edf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:08.407875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e0c09-43e3-4003-aa28-704e5a30edf5 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:08.412158 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e0c09-43e3-4003-aa28-704e5a30edf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:08.414721 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e0c09-43e3-4003-aa28-704e5a30edf5 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:08.433348 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 398/778] 10.222.0.83 () {56 vars in 1087 bytes} [Fri Sep 23 01:07:08 2022] GET /identity/v3/services => generated 772 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:08.627580 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:08.663966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbd9b4-04ba-4e55-9d6d-922df53d0658 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:08.696858 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e0c09-43e3-4003-aa28-704e5a30edf5 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:08.751689 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:08.759791 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9bc77-a319-4108-8cf2-3163733129f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:08.760871 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9bc77-a319-4108-8cf2-3163733129f5 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:08.761433 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9bc77-a319-4108-8cf2-3163733129f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:08.761901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9bc77-a319-4108-8cf2-3163733129f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:08.763119 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9bc77-a319-4108-8cf2-3163733129f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:08.763623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9bc77-a319-4108-8cf2-3163733129f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:08.766039 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9bc77-a319-4108-8cf2-3163733129f5 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:08.794936 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 381/779] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:07:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:08.805111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9bc77-a319-4108-8cf2-3163733129f5 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:08.950020 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e0c09-43e3-4003-aa28-704e5a30edf5 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:09.029172 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9bc77-a319-4108-8cf2-3163733129f5 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:09.052706 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf747862-dd8c-4497-8165-924157caad0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:09.053808 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf747862-dd8c-4497-8165-924157caad0f None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:09.054281 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf747862-dd8c-4497-8165-924157caad0f None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:09.054789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf747862-dd8c-4497-8165-924157caad0f None admin] PATH_INFO: `/v3/services/network` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:09.055831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf747862-dd8c-4497-8165-924157caad0f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:09.058516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf747862-dd8c-4497-8165-924157caad0f None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:09.084219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-cf747862-dd8c-4497-8165-924157caad0f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 01:07:09.084219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:09.084219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:09.084219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:09.084219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:09.084219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:09.084219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:09.084219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:09.084219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 01:07:09.084219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:09.084219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:09.084219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:09.084219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:09.084219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:09.084219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:09.084219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:09.084219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:09.086224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:09.086224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:09.086224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:09.086224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:09.086224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:09.086224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:09.086224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:09.086224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:09.086224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:09.086224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:09.086224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:09.086224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:09.086224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:09.086224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:09.086224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:09.086224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:09.087484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:09.087484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:09.087484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:09.087484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:09.087484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:09.087484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:09.087484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:09.087484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:09.087484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:09.087484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:09.087484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:09.087484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:09.087484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 01:07:09.087484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:09.087484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 399/780] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:07:08 2022] GET /identity/v3/services/network => generated 88 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:09.101715 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf747862-dd8c-4497-8165-924157caad0f None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:09.111537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3d53d-89c7-47e7-9213-4ebf6ec146af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:09.112835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3d53d-89c7-47e7-9213-4ebf6ec146af None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:09.113336 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3d53d-89c7-47e7-9213-4ebf6ec146af None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:09.113829 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3d53d-89c7-47e7-9213-4ebf6ec146af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:09.134527 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3d53d-89c7-47e7-9213-4ebf6ec146af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:09.137547 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3d53d-89c7-47e7-9213-4ebf6ec146af None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:09.152065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:09.170395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-8eb3d53d-89c7-47e7-9213-4ebf6ec146af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:09.170395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:09.170395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:09.170395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:09.170395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:09.170395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:09.170395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:09.170395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:09.170395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:09.170395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:09.170395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:09.170395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:09.170395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:09.170395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:09.170395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:09.170395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:09.173436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:09.173436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:09.173436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:09.173436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:09.173436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:09.173436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:09.173436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:09.173436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:09.173436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:09.173436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:09.173436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:09.173436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:09.173436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:09.173436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:09.173436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:09.173436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:09.173436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:09.185704 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:09.185704 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:09.185704 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:09.185704 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 382/781] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:07:09.185704 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3d53d-89c7-47e7-9213-4ebf6ec146af None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:09.320552 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:09.344457 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf747862-dd8c-4497-8165-924157caad0f None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:09.430047 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920ad48-529f-4fd4-b600-c2965a2fdd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:09.431199 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920ad48-529f-4fd4-b600-c2965a2fdd68 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:09.431693 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920ad48-529f-4fd4-b600-c2965a2fdd68 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:09.432179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920ad48-529f-4fd4-b600-c2965a2fdd68 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:09.433333 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920ad48-529f-4fd4-b600-c2965a2fdd68 None admin] RBAC: Adding query filter params (name=network) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:09.433884 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920ad48-529f-4fd4-b600-c2965a2fdd68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:09.436522 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920ad48-529f-4fd4-b600-c2965a2fdd68 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:09.466484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 400/782] 10.222.0.83 () {56 vars in 1112 bytes} [Fri Sep 23 01:07:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:09.489362 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920ad48-529f-4fd4-b600-c2965a2fdd68 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:09.563977 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3d53d-89c7-47e7-9213-4ebf6ec146af None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:09.700415 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5a5f6-7d02-474c-9384-3bc231f30ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:09.700939 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5a5f6-7d02-474c-9384-3bc231f30ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:09.701219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5a5f6-7d02-474c-9384-3bc231f30ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:09.701483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5a5f6-7d02-474c-9384-3bc231f30ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:09.702130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5a5f6-7d02-474c-9384-3bc231f30ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:09.702428 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5a5f6-7d02-474c-9384-3bc231f30ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:09.704105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5a5f6-7d02-474c-9384-3bc231f30ad3 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:09.721733 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 383/783] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 537 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:09.727922 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5a5f6-7d02-474c-9384-3bc231f30ad3 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:09.781864 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920ad48-529f-4fd4-b600-c2965a2fdd68 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:09.857525 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:09.891444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a9f70-7e7c-44da-824f-b607e1116766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:09.892082 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a9f70-7e7c-44da-824f-b607e1116766 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:09.892361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a9f70-7e7c-44da-824f-b607e1116766 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:09.892629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a9f70-7e7c-44da-824f-b607e1116766 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:09.893276 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a9f70-7e7c-44da-824f-b607e1116766 None admin] RBAC: Adding query filter params (type=network) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:09.893608 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a9f70-7e7c-44da-824f-b607e1116766 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:09.895317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a9f70-7e7c-44da-824f-b607e1116766 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:09.913875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 401/784] 10.222.0.83 () {56 vars in 1112 bytes} [Fri Sep 23 01:07:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:09.922856 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a9f70-7e7c-44da-824f-b607e1116766 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:09.962221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5a5f6-7d02-474c-9384-3bc231f30ad3 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:10.003059 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:10.060967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1e503-f0f6-4288-b4c2-b2329d49ec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:10.062172 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1e503-f0f6-4288-b4c2-b2329d49ec93 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:10.062739 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1e503-f0f6-4288-b4c2-b2329d49ec93 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:10.063265 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1e503-f0f6-4288-b4c2-b2329d49ec93 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:10.084625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1e503-f0f6-4288-b4c2-b2329d49ec93 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:10.090111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1e503-f0f6-4288-b4c2-b2329d49ec93 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:10.136132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-3fd1e503-f0f6-4288-b4c2-b2329d49ec93 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 01:07:10.136132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:10.136132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:10.136132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:10.136132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:10.136132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:10.136132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:10.136132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:10.136132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:10.136132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:10.136132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:10.136132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:10.136132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:07:10.136132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:07:10.136132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:07:10.136132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:07:10.138360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:10.138360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:10.138360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:07:10.138360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:10.138360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:07:10.138360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:10.138360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:10.138360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:10.138360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:10.138360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:10.138360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:10.138360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:10.138360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:10.138360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:10.138360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:10.138360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:10.138360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:10.138360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:10.140457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:10.140457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:10.140457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:07:10.140457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:07:10.140457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:07:10.140457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:07:10.140457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:07:10.140457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:07:10.140457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 23 01:07:10.140457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:10.140457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 384/785] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:07:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:10.145534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1e503-f0f6-4288-b4c2-b2329d49ec93 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:10.209510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a9f70-7e7c-44da-824f-b607e1116766 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:10.281620 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4a04f-48bd-4b49-ac54-dc7bc7daecc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:10.282987 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4a04f-48bd-4b49-ac54-dc7bc7daecc3 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:10.283483 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4a04f-48bd-4b49-ac54-dc7bc7daecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:10.283971 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4a04f-48bd-4b49-ac54-dc7bc7daecc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:10.285859 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4a04f-48bd-4b49-ac54-dc7bc7daecc3 None admin] RBAC: Adding query filter params (interface=public, service_id=0693813e7eaf4ff9a1afeb7bf2d9106a, region_id=RegionOne) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:10.286416 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4a04f-48bd-4b49-ac54-dc7bc7daecc3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:10.290568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4a04f-48bd-4b49-ac54-dc7bc7daecc3 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:10.318319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 402/786] 10.222.0.83 () {56 vars in 1251 bytes} [Fri Sep 23 01:07:09 2022] GET /identity/v3/endpoints?service_id=0693813e7eaf4ff9a1afeb7bf2d9106a&interface=public®ion_id=RegionOne => generated 194 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:10.323954 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4a04f-48bd-4b49-ac54-dc7bc7daecc3 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:10.532549 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:10.533400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1e503-f0f6-4288-b4c2-b2329d49ec93 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:10.568027 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4a04f-48bd-4b49-ac54-dc7bc7daecc3 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:10.619246 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:10.644723 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654211a6-cc45-488e-aab0-d8853db75769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:10.645790 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654211a6-cc45-488e-aab0-d8853db75769 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:10.646271 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654211a6-cc45-488e-aab0-d8853db75769 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:10.646780 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654211a6-cc45-488e-aab0-d8853db75769 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:10.647951 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654211a6-cc45-488e-aab0-d8853db75769 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:10.652672 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654211a6-cc45-488e-aab0-d8853db75769 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:10.664084 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 403/787] 10.222.0.83 () {56 vars in 1087 bytes} [Fri Sep 23 01:07:10 2022] GET /identity/v3/services => generated 772 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:10.664970 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37466306-f4f0-4ec7-83b9-3a9f54b475c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:10.666058 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37466306-f4f0-4ec7-83b9-3a9f54b475c1 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:10.666552 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37466306-f4f0-4ec7-83b9-3a9f54b475c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:10.667059 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37466306-f4f0-4ec7-83b9-3a9f54b475c1 None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:10.668500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37466306-f4f0-4ec7-83b9-3a9f54b475c1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:10.674669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37466306-f4f0-4ec7-83b9-3a9f54b475c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:10.674669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37466306-f4f0-4ec7-83b9-3a9f54b475c1 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:10.740331 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 385/788] 10.222.0.83 () {56 vars in 1135 bytes} [Fri Sep 23 01:07:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 596 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:10.749482 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654211a6-cc45-488e-aab0-d8853db75769 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:10.833592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2b876-d7c0-47c5-9a22-19464feeca5a None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:10.833861 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2b876-d7c0-47c5-9a22-19464feeca5a None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:10.834007 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2b876-d7c0-47c5-9a22-19464feeca5a None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:10.837028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 386/789] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:07:10.844171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d7213-4c24-453f-8972-139bd528821e None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:10.844547 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d7213-4c24-453f-8972-139bd528821e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:10.844915 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d7213-4c24-453f-8972-139bd528821e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:10.891030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-076d7213-4c24-453f-8972-139bd528821e None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:10.892279 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-076d7213-4c24-453f-8972-139bd528821e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:11.035348 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654211a6-cc45-488e-aab0-d8853db75769 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:11.045490 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 387/790] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:11.093688 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd413f-6cef-476e-a20a-3ef9a1d98fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:11.094688 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd413f-6cef-476e-a20a-3ef9a1d98fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:11.095185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd413f-6cef-476e-a20a-3ef9a1d98fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:11.095482 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd413f-6cef-476e-a20a-3ef9a1d98fb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:11.108678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd413f-6cef-476e-a20a-3ef9a1d98fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:11.110160 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd413f-6cef-476e-a20a-3ef9a1d98fb4 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:11.122998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:11.152448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-7efd413f-6cef-476e-a20a-3ef9a1d98fb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:11.152448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:11.152448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:11.152448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:11.152448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:11.152448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:11.152448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:11.152448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:11.152448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:11.152448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:11.152448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:11.152448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:11.152448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:11.152448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:11.152448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:11.152448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:11.153589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:11.153589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:11.153589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:11.153589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:11.153589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:11.153589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:11.153589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:11.153589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:11.153589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:11.153589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:11.153589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:11.153589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:11.153589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:11.153589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:11.153589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:11.153589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:11.153589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:11.154628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:11.154628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:11.154628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:11.155946 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 404/791] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:11.161962 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d7213-4c24-453f-8972-139bd528821e None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:11.320605 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d7213-4c24-453f-8972-139bd528821e None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:11.329810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:11.358459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd413f-6cef-476e-a20a-3ef9a1d98fb4 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:11.362818 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce31e3-2f4b-4732-a8e7-5ae4fd02b312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:11.363725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce31e3-2f4b-4732-a8e7-5ae4fd02b312 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:11.364224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce31e3-2f4b-4732-a8e7-5ae4fd02b312 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:11.364666 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce31e3-2f4b-4732-a8e7-5ae4fd02b312 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:11.365463 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce31e3-2f4b-4732-a8e7-5ae4fd02b312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:11.365938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce31e3-2f4b-4732-a8e7-5ae4fd02b312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:11.367531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce31e3-2f4b-4732-a8e7-5ae4fd02b312 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:11.381560 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 388/792] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:11.388264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce31e3-2f4b-4732-a8e7-5ae4fd02b312 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:11.516907 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce31e3-2f4b-4732-a8e7-5ae4fd02b312 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:11.561915 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7ff7b-1e24-472d-b1a1-1b3b9a3db98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:11.563868 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7ff7b-1e24-472d-b1a1-1b3b9a3db98f None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:11.565700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7ff7b-1e24-472d-b1a1-1b3b9a3db98f None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:11.566953 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7ff7b-1e24-472d-b1a1-1b3b9a3db98f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:11.578998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7ff7b-1e24-472d-b1a1-1b3b9a3db98f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:11.581664 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7ff7b-1e24-472d-b1a1-1b3b9a3db98f None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:11.614237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-73b7ff7b-1e24-472d-b1a1-1b3b9a3db98f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:11.614237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:11.614237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:11.614237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:11.614237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:11.614237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:11.614237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:11.614237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:11.614237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:11.614237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:11.614237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:11.614237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:11.614237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:07:11.614237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:07:11.614237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:07:11.615390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:07:11.615390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:11.615390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:11.615390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:11.615390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:11.615390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:11.615390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:11.615390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:11.615390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:11.615390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:11.615390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:11.615390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:11.615390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:11.615390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:11.615390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:11.615390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:11.615390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:11.616488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:07:11.616488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:07:11.616488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:07:11.616488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:07:11.616488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:07:11.616488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:07:11.616488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:11.616488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:11.620902 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 389/793] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:07:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:11.628311 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7ff7b-1e24-472d-b1a1-1b3b9a3db98f None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:11.678481 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd413f-6cef-476e-a20a-3ef9a1d98fb4 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:11.706999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:11.776352 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710acd4-3acf-4d9a-a78d-f44ac0a9e8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:11.777433 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710acd4-3acf-4d9a-a78d-f44ac0a9e8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:11.777921 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710acd4-3acf-4d9a-a78d-f44ac0a9e8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:11.778406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710acd4-3acf-4d9a-a78d-f44ac0a9e8e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:11.803542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7ff7b-1e24-472d-b1a1-1b3b9a3db98f None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:11.812785 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710acd4-3acf-4d9a-a78d-f44ac0a9e8e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:07:11.829875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-2710acd4-3acf-4d9a-a78d-f44ac0a9e8e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:07:11.829875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:11.829875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:11.829875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:11.829875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:11.829875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:11.829875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:11.829875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:11.829875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:11.829875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:11.829875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:11.829875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:11.829875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:07:11.829875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:07:11.829875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:07:11.829875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:07:11.831110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:07:11.831110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:07:11.831110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:07:11.831110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:07:11.831110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:11.831110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:11.831110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:11.831110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:11.831110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:11.831110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:11.831110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:11.831110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:11.831110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:11.831110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:11.831110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:11.831110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:11.831968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:11.831968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:11.831968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:11.831968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:11.831968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:07:11.831968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:07:11.831968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:07:11.831968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:07:11.831968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:07:11.831968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:07:11.831968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:07:11.831968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:11.832608 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 405/794] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:07:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 485 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:11.844340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710acd4-3acf-4d9a-a78d-f44ac0a9e8e8 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:11.861672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e26fd-58a4-4d5e-a821-8d6714107cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:11.863382 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e26fd-58a4-4d5e-a821-8d6714107cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:11.863673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e26fd-58a4-4d5e-a821-8d6714107cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:11.864040 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e26fd-58a4-4d5e-a821-8d6714107cf0 None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:11.864941 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e26fd-58a4-4d5e-a821-8d6714107cf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:11.865379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e26fd-58a4-4d5e-a821-8d6714107cf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:11.867525 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e26fd-58a4-4d5e-a821-8d6714107cf0 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:11.888238 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 390/795] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:07:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:11.898215 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e26fd-58a4-4d5e-a821-8d6714107cf0 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:12.011024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:12.016502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:12.025772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e26fd-58a4-4d5e-a821-8d6714107cf0 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:12.090168 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49edf8-b6ac-428a-a8ef-6cb542f23d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:12.091502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49edf8-b6ac-428a-a8ef-6cb542f23d3a None admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:12.092919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49edf8-b6ac-428a-a8ef-6cb542f23d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:12.094207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49edf8-b6ac-428a-a8ef-6cb542f23d3a None admin] PATH_INFO: `/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/c526c7ad227943d1a2bba7b5e2e039e0/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:12.103425 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49edf8-b6ac-428a-a8ef-6cb542f23d3a None admin] RBAC: Authorizing `identity:create_grant(project_id=78d0895fea004a02b1d8338f5fb0250c, user_id=c526c7ad227943d1a2bba7b5e2e039e0, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:12.111351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49edf8-b6ac-428a-a8ef-6cb542f23d3a None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:12.154638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710acd4-3acf-4d9a-a78d-f44ac0a9e8e8 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:12.223581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f666f9-dea4-48a2-a2ea-b9089a4e8abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:12.225176 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f666f9-dea4-48a2-a2ea-b9089a4e8abb None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:12.225962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f666f9-dea4-48a2-a2ea-b9089a4e8abb None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:12.226681 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f666f9-dea4-48a2-a2ea-b9089a4e8abb None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:12.228132 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f666f9-dea4-48a2-a2ea-b9089a4e8abb None admin] RBAC: Adding query filter params (name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:12.228904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f666f9-dea4-48a2-a2ea-b9089a4e8abb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:12.231886 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f666f9-dea4-48a2-a2ea-b9089a4e8abb None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:12.250075 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 406/796] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:07:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:12.252614 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4dbd6-cee4-46df-a513-b162beef78d5 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:12.253905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4dbd6-cee4-46df-a513-b162beef78d5 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:12.254555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4dbd6-cee4-46df-a513-b162beef78d5 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:12.257444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 407/797] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:12.259210 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4dbd6-cee4-46df-a513-b162beef78d5 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:12.342833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 391/798] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:07:11 2022] PUT /identity/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/c526c7ad227943d1a2bba7b5e2e039e0/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:07:12.345697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d42496-7926-46bf-91dd-8ba8b503ac3e None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:12.347034 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d42496-7926-46bf-91dd-8ba8b503ac3e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:12.347726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d42496-7926-46bf-91dd-8ba8b503ac3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:12.391578 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-31d42496-7926-46bf-91dd-8ba8b503ac3e None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:12.394265 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-31d42496-7926-46bf-91dd-8ba8b503ac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:12.447950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4dbd6-cee4-46df-a513-b162beef78d5 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:12.480544 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:12.517941 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50907677-68d7-4737-ab3b-6c1886c177c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:12.518491 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 392/799] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:12.520302 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f669f-83a4-4fd9-8a14-8478bd3246b0 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:12.520900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f669f-83a4-4fd9-8a14-8478bd3246b0 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:12.521420 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f669f-83a4-4fd9-8a14-8478bd3246b0 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:12.523482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 393/800] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:12.523760 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50907677-68d7-4737-ab3b-6c1886c177c8 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:12.524375 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50907677-68d7-4737-ab3b-6c1886c177c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:12.528749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50907677-68d7-4737-ab3b-6c1886c177c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:12.530207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bd4db-6e17-4b81-8cfb-0c1f06ea53f8 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:12.530918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bd4db-6e17-4b81-8cfb-0c1f06ea53f8 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:12.531497 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bd4db-6e17-4b81-8cfb-0c1f06ea53f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:12.555550 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-a44bd4db-6e17-4b81-8cfb-0c1f06ea53f8 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:12.557337 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a44bd4db-6e17-4b81-8cfb-0c1f06ea53f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:12.557936 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50907677-68d7-4737-ab3b-6c1886c177c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:12.564255 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50907677-68d7-4737-ab3b-6c1886c177c8 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:12.594414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-50907677-68d7-4737-ab3b-6c1886c177c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:12.594414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:12.594414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:12.594414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:12.594414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:12.594414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:12.594414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:12.594414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:12.594414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:12.594414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:12.594414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:12.594414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:12.594414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:12.594414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:12.594414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:12.594414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:12.595425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:12.595425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:12.595425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:12.595425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:12.595425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:12.595425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:12.595425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:12.595425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:12.595425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:12.595425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:12.595425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:12.595425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:12.595425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:12.595425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:12.595425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:12.595425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:12.595425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:12.596301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:12.596301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:12.596301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:12.599089 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 408/801] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:12.606558 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50907677-68d7-4737-ab3b-6c1886c177c8 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:12.691586 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 394/802] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:12.752087 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50907677-68d7-4737-ab3b-6c1886c177c8 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:12.794999 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a3352-1b9e-4ec7-9bc6-b7dfb3b5d279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:12.795675 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a3352-1b9e-4ec7-9bc6-b7dfb3b5d279 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:12.795952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a3352-1b9e-4ec7-9bc6-b7dfb3b5d279 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:12.796221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a3352-1b9e-4ec7-9bc6-b7dfb3b5d279 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:12.796878 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a3352-1b9e-4ec7-9bc6-b7dfb3b5d279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:12.797275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a3352-1b9e-4ec7-9bc6-b7dfb3b5d279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:12.798884 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a3352-1b9e-4ec7-9bc6-b7dfb3b5d279 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:12.818737 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 409/803] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:12.820932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bd4db-6e17-4b81-8cfb-0c1f06ea53f8 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:12.842956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:13.069447 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a3352-1b9e-4ec7-9bc6-b7dfb3b5d279 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:13.093110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bd4db-6e17-4b81-8cfb-0c1f06ea53f8 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:13.156543 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00490e-1495-4cfa-a70c-c32e8a151d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:13.157658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00490e-1495-4cfa-a70c-c32e8a151d53 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:13.158158 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00490e-1495-4cfa-a70c-c32e8a151d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:13.158747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00490e-1495-4cfa-a70c-c32e8a151d53 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:13.172773 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00490e-1495-4cfa-a70c-c32e8a151d53 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:13.176768 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00490e-1495-4cfa-a70c-c32e8a151d53 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:13.187231 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:13.199894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-3c00490e-1495-4cfa-a70c-c32e8a151d53 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 01:07:13.199894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:13.199894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:13.199894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:13.199894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:13.199894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:13.199894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:13.199894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:13.199894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:13.199894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:13.199894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:13.199894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:13.199894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:07:13.199894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:07:13.199894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:07:13.199894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:07:13.204073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:13.204073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:13.204073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:07:13.204073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:13.204073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:07:13.204073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:13.204073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:13.204073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:13.204073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:13.204073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:13.204073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:13.204073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:13.204073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:13.204073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:13.204073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:13.204073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:13.204073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:13.204073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:13.206027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:13.206027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:13.206027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:07:13.206027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:07:13.206027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:07:13.206027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:07:13.206027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:07:13.206027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:07:13.206027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 01:07:13.206027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:13.206027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 395/804] 10.222.0.83 () {56 vars in 1117 bytes} [Fri Sep 23 01:07:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:13.206027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00490e-1495-4cfa-a70c-c32e8a151d53 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:13.317165 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a3352-1b9e-4ec7-9bc6-b7dfb3b5d279 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:13.319766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:13.366326 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00490e-1495-4cfa-a70c-c32e8a151d53 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:13.389081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee511dcc-9380-48b3-bc18-8a0faa4fd8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:13.390285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee511dcc-9380-48b3-bc18-8a0faa4fd8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:13.390757 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee511dcc-9380-48b3-bc18-8a0faa4fd8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:13.391358 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee511dcc-9380-48b3-bc18-8a0faa4fd8d6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:13.392590 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee511dcc-9380-48b3-bc18-8a0faa4fd8d6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:13.397093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee511dcc-9380-48b3-bc18-8a0faa4fd8d6 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:13.408825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae7171-b85f-48ad-b758-324992d977bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:13.410410 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae7171-b85f-48ad-b758-324992d977bc None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:13.410901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae7171-b85f-48ad-b758-324992d977bc None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:13.411431 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae7171-b85f-48ad-b758-324992d977bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:13.417534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-ee511dcc-9380-48b3-bc18-8a0faa4fd8d6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 01:07:13.417534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:13.417534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:13.417534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:13.417534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:13.417534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:13.417534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:13.417534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:13.417534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 01:07:13.417534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:13.417534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:13.417534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:13.417534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:13.417534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:13.417534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:13.417534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:13.417534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:13.418619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:13.418619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:13.418619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:13.418619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:13.418619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:13.418619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:13.418619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:13.418619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:13.418619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:13.418619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:13.418619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:13.418619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:13.418619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:13.418619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:13.418619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:13.418619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:13.419452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:13.419452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:13.419452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:13.419452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:13.419452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:13.419452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:13.419452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:13.419452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:13.419452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:13.419452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:13.419452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:13.419452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:13.419452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 01:07:13.419452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:13.420189 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 410/805] 10.222.0.83 () {56 vars in 1129 bytes} [Fri Sep 23 01:07:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:07:13.422295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee511dcc-9380-48b3-bc18-8a0faa4fd8d6 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:13.429637 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae7171-b85f-48ad-b758-324992d977bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:07:13.437722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-d7ae7171-b85f-48ad-b758-324992d977bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:07:13.437722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:13.437722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:13.437722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:13.437722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:13.437722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:13.437722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:13.437722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:13.437722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:13.437722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:13.437722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:13.437722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:13.437722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:07:13.437722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:07:13.437722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:07:13.437722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:07:13.439230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:07:13.439230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:07:13.439230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:07:13.439230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:07:13.439230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:13.439230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:13.439230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:13.439230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:13.439230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:13.439230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:13.439230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:13.439230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:13.439230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:13.439230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:13.439230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:13.439230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:13.440678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:13.440678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:13.440678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:13.440678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:13.440678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:07:13.440678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:07:13.440678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:07:13.440678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:07:13.440678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:07:13.440678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:07:13.440678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:07:13.440678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:13.450516 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 396/806] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:07:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:13.452065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae7171-b85f-48ad-b758-324992d977bc None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:13.566491 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:13.584448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee511dcc-9380-48b3-bc18-8a0faa4fd8d6 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:13.629007 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3cfd3-2956-43c1-8a53-2cd46c8cdb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:13.631010 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3cfd3-2956-43c1-8a53-2cd46c8cdb65 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:13.631575 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3cfd3-2956-43c1-8a53-2cd46c8cdb65 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:13.632389 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3cfd3-2956-43c1-8a53-2cd46c8cdb65 None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:13.633434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3cfd3-2956-43c1-8a53-2cd46c8cdb65 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:13.633977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3cfd3-2956-43c1-8a53-2cd46c8cdb65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:13.636382 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3cfd3-2956-43c1-8a53-2cd46c8cdb65 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:13.663024 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 411/807] 10.222.0.83 () {56 vars in 1149 bytes} [Fri Sep 23 01:07:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:13.664285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3cfd3-2956-43c1-8a53-2cd46c8cdb65 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:13.679338 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae7171-b85f-48ad-b758-324992d977bc None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:13.742531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:13.764018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57067d1a-4096-4d11-9792-2310a357fcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:13.765366 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57067d1a-4096-4d11-9792-2310a357fcc6 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:13.765970 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57067d1a-4096-4d11-9792-2310a357fcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:13.766255 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57067d1a-4096-4d11-9792-2310a357fcc6 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:13.767974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57067d1a-4096-4d11-9792-2310a357fcc6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:13.769036 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57067d1a-4096-4d11-9792-2310a357fcc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:13.771868 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57067d1a-4096-4d11-9792-2310a357fcc6 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:13.784272 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 397/808] 10.222.0.83 () {56 vars in 1124 bytes} [Fri Sep 23 01:07:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:13.785888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57067d1a-4096-4d11-9792-2310a357fcc6 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:13.855118 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3cfd3-2956-43c1-8a53-2cd46c8cdb65 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:13.925642 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57067d1a-4096-4d11-9792-2310a357fcc6 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:13.926553 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0c193-f94d-4d4b-a60a-5e9cebcaf1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:13.927432 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0c193-f94d-4d4b-a60a-5e9cebcaf1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:13.928201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0c193-f94d-4d4b-a60a-5e9cebcaf1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:13.928651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0c193-f94d-4d4b-a60a-5e9cebcaf1e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:13.930655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0c193-f94d-4d4b-a60a-5e9cebcaf1e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:13.931195 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0c193-f94d-4d4b-a60a-5e9cebcaf1e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:13.933044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0c193-f94d-4d4b-a60a-5e9cebcaf1e6 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:13.949051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 412/809] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:07:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:13.950350 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0c193-f94d-4d4b-a60a-5e9cebcaf1e6 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:13.973564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:13.980691 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb71990-5f7d-4f75-a953-388ea6836fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:13.981706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb71990-5f7d-4f75-a953-388ea6836fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:13.982094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb71990-5f7d-4f75-a953-388ea6836fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:13.986069 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb71990-5f7d-4f75-a953-388ea6836fb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:13.998186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb71990-5f7d-4f75-a953-388ea6836fb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:13.999646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb71990-5f7d-4f75-a953-388ea6836fb9 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:14.016070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-2fb71990-5f7d-4f75-a953-388ea6836fb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:14.016070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:14.016070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:14.016070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:14.016070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:14.016070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:14.016070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:14.016070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:14.016070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:14.016070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:14.016070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:14.016070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:14.016070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:14.016070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:14.016070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:14.016070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:14.017513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:14.017513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:14.017513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:14.017513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:14.017513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:14.017513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:14.017513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:14.017513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:14.017513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:14.017513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:14.017513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:14.017513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:14.017513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:14.017513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:14.017513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:14.017513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:14.017513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:14.019530 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:14.019530 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:14.019530 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:14.022254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 398/810] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:14.023346 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb71990-5f7d-4f75-a953-388ea6836fb9 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:14.099397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:14.117721 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0c193-f94d-4d4b-a60a-5e9cebcaf1e6 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:14.161746 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfc051-2f01-45fb-be12-db41d7956f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:14.162892 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfc051-2f01-45fb-be12-db41d7956f83 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:14.163419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfc051-2f01-45fb-be12-db41d7956f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:14.163897 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfc051-2f01-45fb-be12-db41d7956f83 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:14.165034 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfc051-2f01-45fb-be12-db41d7956f83 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:14.166029 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfc051-2f01-45fb-be12-db41d7956f83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:14.168042 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfc051-2f01-45fb-be12-db41d7956f83 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:14.176564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 413/811] 10.222.0.83 () {56 vars in 1124 bytes} [Fri Sep 23 01:07:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:14.178485 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfc051-2f01-45fb-be12-db41d7956f83 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:14.212247 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb71990-5f7d-4f75-a953-388ea6836fb9 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:14.276310 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f15aa8-00b6-4bb4-886d-71e5d2e6feef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:14.277393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f15aa8-00b6-4bb4-886d-71e5d2e6feef None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:14.277881 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f15aa8-00b6-4bb4-886d-71e5d2e6feef None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:14.278362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f15aa8-00b6-4bb4-886d-71e5d2e6feef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:14.290483 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:14.321942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfc051-2f01-45fb-be12-db41d7956f83 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:14.375843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314e11a-0024-45d4-ac42-21b71cbad7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:14.377025 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314e11a-0024-45d4-ac42-21b71cbad7dc None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:14.377581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314e11a-0024-45d4-ac42-21b71cbad7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:14.378855 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314e11a-0024-45d4-ac42-21b71cbad7dc None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:14.380067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314e11a-0024-45d4-ac42-21b71cbad7dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:14.381543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314e11a-0024-45d4-ac42-21b71cbad7dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:14.383812 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314e11a-0024-45d4-ac42-21b71cbad7dc None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:14.401605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 414/812] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:14.402943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314e11a-0024-45d4-ac42-21b71cbad7dc None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:14.474546 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f15aa8-00b6-4bb4-886d-71e5d2e6feef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:14.477434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f15aa8-00b6-4bb4-886d-71e5d2e6feef None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:14.505655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-86f15aa8-00b6-4bb4-886d-71e5d2e6feef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:14.505655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:14.505655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:14.505655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:14.505655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:14.505655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:14.505655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:14.505655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:14.505655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:14.505655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:14.505655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:14.505655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:14.505655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:14.505655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:14.505655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:14.505655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:14.506771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:14.506771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:14.506771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:14.506771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:14.506771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:14.506771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:14.506771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:14.506771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:14.506771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:14.506771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:14.506771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:14.506771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:14.506771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:14.506771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:14.506771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:14.506771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:14.506771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:14.507906 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:14.507906 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:14.507906 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:14.515156 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 399/813] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 492 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:14.516786 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f15aa8-00b6-4bb4-886d-71e5d2e6feef None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:14.554096 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314e11a-0024-45d4-ac42-21b71cbad7dc None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:14.602188 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607ee27-8400-4b7a-b4f9-fbc437750ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:14.602880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607ee27-8400-4b7a-b4f9-fbc437750ce7 None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:14.603384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607ee27-8400-4b7a-b4f9-fbc437750ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:14.603566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607ee27-8400-4b7a-b4f9-fbc437750ce7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:14.604225 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607ee27-8400-4b7a-b4f9-fbc437750ce7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:14.605959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607ee27-8400-4b7a-b4f9-fbc437750ce7 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:14.617604 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:14.685736 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:14.696886 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f15aa8-00b6-4bb4-886d-71e5d2e6feef None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:14.734119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 415/814] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:07:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:07:14.735611 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607ee27-8400-4b7a-b4f9-fbc437750ce7 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:14.767045 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bd9e0-67b9-4736-aa49-bdd82f6c7369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:14.769102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bd9e0-67b9-4736-aa49-bdd82f6c7369 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:14.769823 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bd9e0-67b9-4736-aa49-bdd82f6c7369 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:14.771001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bd9e0-67b9-4736-aa49-bdd82f6c7369 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:14.788376 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bd9e0-67b9-4736-aa49-bdd82f6c7369 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:14.794903 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bd9e0-67b9-4736-aa49-bdd82f6c7369 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:14.828875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-0f3bd9e0-67b9-4736-aa49-bdd82f6c7369 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:14.828875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:14.828875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:14.828875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:14.828875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:14.828875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:14.828875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:14.828875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:14.828875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:14.828875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:14.828875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:14.828875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:14.828875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:07:14.828875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:07:14.828875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:07:14.830725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:07:14.830725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:14.830725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:14.830725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:14.830725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:14.830725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:14.830725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:14.830725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:14.830725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:14.830725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:14.830725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:14.830725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:14.830725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:14.830725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:14.830725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:14.830725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:14.830725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:14.832546 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:07:14.832546 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:07:14.832546 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:07:14.832546 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:07:14.832546 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:07:14.832546 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:07:14.832546 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:14.832546 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:14.832546 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 400/815] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:07:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:14.836504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef270f-a7d2-495f-8d7f-a980307e0b3c None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:14.836787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef270f-a7d2-495f-8d7f-a980307e0b3c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:14.837291 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef270f-a7d2-495f-8d7f-a980307e0b3c None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:14.841866 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 401/816] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:14.843992 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef270f-a7d2-495f-8d7f-a980307e0b3c None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:14.913545 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607ee27-8400-4b7a-b4f9-fbc437750ce7 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:14.972859 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f578781-cc6d-4976-a964-73d2cfaf6955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:14.973439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f578781-cc6d-4976-a964-73d2cfaf6955 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:14.973841 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f578781-cc6d-4976-a964-73d2cfaf6955 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:14.974120 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f578781-cc6d-4976-a964-73d2cfaf6955 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:14.974887 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f578781-cc6d-4976-a964-73d2cfaf6955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:14.975299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f578781-cc6d-4976-a964-73d2cfaf6955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:14.977068 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f578781-cc6d-4976-a964-73d2cfaf6955 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:15.000002 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 416/817] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:15.002411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a07a04-7a7d-4aef-8c7c-82099e969252 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:15.002960 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a07a04-7a7d-4aef-8c7c-82099e969252 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:15.003435 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a07a04-7a7d-4aef-8c7c-82099e969252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:15.036654 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-07a07a04-7a7d-4aef-8c7c-82099e969252 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:15.039014 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-07a07a04-7a7d-4aef-8c7c-82099e969252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:15.081248 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef270f-a7d2-495f-8d7f-a980307e0b3c None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:15.125429 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc37de-9208-41ab-aad9-7045955fd713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:15.126050 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc37de-9208-41ab-aad9-7045955fd713 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:15.126396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc37de-9208-41ab-aad9-7045955fd713 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:15.126697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc37de-9208-41ab-aad9-7045955fd713 None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:15.127419 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc37de-9208-41ab-aad9-7045955fd713 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:15.127759 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc37de-9208-41ab-aad9-7045955fd713 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:15.129512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc37de-9208-41ab-aad9-7045955fd713 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:15.145653 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 402/818] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:07:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:15.146703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc37de-9208-41ab-aad9-7045955fd713 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:15.155246 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:15.169794 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:15.182371 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 417/819] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:15.183925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a07a04-7a7d-4aef-8c7c-82099e969252 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:15.307840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a07a04-7a7d-4aef-8c7c-82099e969252 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:15.314428 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc37de-9208-41ab-aad9-7045955fd713 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:15.349455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec3ac4-0386-4d79-870b-1d4c32ce8ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:15.350145 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3ac4-0386-4d79-870b-1d4c32ce8ffb None admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:15.350434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3ac4-0386-4d79-870b-1d4c32ce8ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:15.350756 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3ac4-0386-4d79-870b-1d4c32ce8ffb None admin] PATH_INFO: `/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/f2cea4c08f324769bf6dcea58c9394b3/roles/2e8d92bd39634bbdad03d67d3fc439f0` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:15.363208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8b1d0-1f91-42a4-a5d1-a927c7d619d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:15.364338 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8b1d0-1f91-42a4-a5d1-a927c7d619d8 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:15.364816 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8b1d0-1f91-42a4-a5d1-a927c7d619d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:15.365244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8b1d0-1f91-42a4-a5d1-a927c7d619d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:15.376805 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8b1d0-1f91-42a4-a5d1-a927c7d619d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:15.378852 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec3ac4-0386-4d79-870b-1d4c32ce8ffb None admin] RBAC: Authorizing `identity:create_grant(project_id=78d0895fea004a02b1d8338f5fb0250c, user_id=f2cea4c08f324769bf6dcea58c9394b3, role_id=2e8d92bd39634bbdad03d67d3fc439f0)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:15.379377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8b1d0-1f91-42a4-a5d1-a927c7d619d8 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:15.381939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec3ac4-0386-4d79-870b-1d4c32ce8ffb None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:15.396676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-46f8b1d0-1f91-42a4-a5d1-a927c7d619d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 01:07:15.396676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:15.396676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:15.396676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:15.396676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:15.396676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:15.396676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:15.396676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:15.396676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:15.396676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:15.396676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:15.396676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:15.396676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:07:15.396676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:07:15.396676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:07:15.396676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:07:15.400535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:15.400535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:15.400535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:07:15.400535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:15.400535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:07:15.400535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:15.400535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:15.400535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:15.400535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:15.400535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:15.400535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:15.400535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:15.400535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:15.400535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:15.400535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:15.400535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:15.400535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:15.400535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:15.402820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:15.402820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:15.402820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:07:15.402820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:07:15.402820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:07:15.402820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:07:15.402820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:07:15.402820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:07:15.402820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 01:07:15.402820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:15.402820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 403/820] 10.222.0.83 () {56 vars in 1093 bytes} [Fri Sep 23 01:07:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:15.402820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702afe40-60a2-4be1-aa61-19a8e93b510a None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:15.402820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702afe40-60a2-4be1-aa61-19a8e93b510a None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:15.404249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702afe40-60a2-4be1-aa61-19a8e93b510a None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:15.410646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 404/821] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:15.410646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702afe40-60a2-4be1-aa61-19a8e93b510a None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:15.482849 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 418/822] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:07:15 2022] PUT /identity/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/f2cea4c08f324769bf6dcea58c9394b3/roles/2e8d92bd39634bbdad03d67d3fc439f0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:07:15.486934 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14aab67-97b7-466c-a5b5-23ff8d735796 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:15.487866 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14aab67-97b7-466c-a5b5-23ff8d735796 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:15.488581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14aab67-97b7-466c-a5b5-23ff8d735796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:15.530623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-e14aab67-97b7-466c-a5b5-23ff8d735796 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:15.532837 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e14aab67-97b7-466c-a5b5-23ff8d735796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:15.611652 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:15.637955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:15.695397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702afe40-60a2-4be1-aa61-19a8e93b510a None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:15.759338 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 419/823] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:15.760850 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14aab67-97b7-466c-a5b5-23ff8d735796 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:15.792605 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b5117-198b-45dd-bb8c-932e560031bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:15.793774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b5117-198b-45dd-bb8c-932e560031bb None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:15.794262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b5117-198b-45dd-bb8c-932e560031bb None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:15.794777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b5117-198b-45dd-bb8c-932e560031bb None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:15.797709 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b5117-198b-45dd-bb8c-932e560031bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:15.800592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b5117-198b-45dd-bb8c-932e560031bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:15.805421 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b5117-198b-45dd-bb8c-932e560031bb None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:15.853730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 405/824] 10.222.0.83 () {56 vars in 1133 bytes} [Fri Sep 23 01:07:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:15.859815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b5117-198b-45dd-bb8c-932e560031bb None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:16.016393 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14aab67-97b7-466c-a5b5-23ff8d735796 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:16.086737 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf02ab9-d9b2-4870-9a93-25801bf4d9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:16.087627 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf02ab9-d9b2-4870-9a93-25801bf4d9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:16.087905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf02ab9-d9b2-4870-9a93-25801bf4d9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:16.088175 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf02ab9-d9b2-4870-9a93-25801bf4d9a4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:16.088944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf02ab9-d9b2-4870-9a93-25801bf4d9a4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:16.091091 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf02ab9-d9b2-4870-9a93-25801bf4d9a4 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:16.097353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b5117-198b-45dd-bb8c-932e560031bb None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:16.117657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-adf02ab9-d9b2-4870-9a93-25801bf4d9a4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 01:07:16.117657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:16.117657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:16.117657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:16.117657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:16.117657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:16.117657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:16.117657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:16.117657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 01:07:16.117657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:16.117657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:16.117657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:16.117657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:16.117657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:16.117657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:16.117657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:16.117657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:16.119961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:16.119961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:16.119961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:16.119961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:16.119961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:16.119961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:16.119961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:16.119961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:16.119961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:16.119961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:16.119961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:16.119961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:16.119961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:16.119961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:16.119961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:16.119961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:16.121649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:16.121649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:16.121649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:16.121649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:16.121649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:16.121649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:16.121649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:16.121649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:16.121649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:16.121649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:16.121649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:16.121649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:16.121649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 01:07:16.121649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:16.128203 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 420/825] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:07:15 2022] GET /identity/v3/services/network => generated 88 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:16.135998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf02ab9-d9b2-4870-9a93-25801bf4d9a4 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:16.147218 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:16.165152 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd2d3d-554a-4fdc-afda-3a750cf93883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:16.175371 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd2d3d-554a-4fdc-afda-3a750cf93883 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:16.175371 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd2d3d-554a-4fdc-afda-3a750cf93883 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:16.175371 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd2d3d-554a-4fdc-afda-3a750cf93883 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:16.228359 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:16.260891 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd2d3d-554a-4fdc-afda-3a750cf93883 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:16.262409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd2d3d-554a-4fdc-afda-3a750cf93883 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:16.375916 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf02ab9-d9b2-4870-9a93-25801bf4d9a4 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:16.390542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 406/826] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:07:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 23 01:07:16.391642 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd2d3d-554a-4fdc-afda-3a750cf93883 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:16.424988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e90fb-84cc-4e85-81d7-1af52c88b386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:16.426506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e90fb-84cc-4e85-81d7-1af52c88b386 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:16.427733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e90fb-84cc-4e85-81d7-1af52c88b386 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:16.428041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:16.429355 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e90fb-84cc-4e85-81d7-1af52c88b386 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:16.431405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e90fb-84cc-4e85-81d7-1af52c88b386 None admin] RBAC: Adding query filter params (name=network) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:16.433330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e90fb-84cc-4e85-81d7-1af52c88b386 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:16.438542 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e90fb-84cc-4e85-81d7-1af52c88b386 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:16.450720 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 421/827] 10.222.0.83 () {56 vars in 1112 bytes} [Fri Sep 23 01:07:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:16.452744 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e90fb-84cc-4e85-81d7-1af52c88b386 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:16.538271 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd2d3d-554a-4fdc-afda-3a750cf93883 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:16.599675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b64c3-9b4c-43ee-90f5-5808f73c5101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:16.600706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b64c3-9b4c-43ee-90f5-5808f73c5101 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:16.601176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b64c3-9b4c-43ee-90f5-5808f73c5101 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:16.601638 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b64c3-9b4c-43ee-90f5-5808f73c5101 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:16.621047 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b64c3-9b4c-43ee-90f5-5808f73c5101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:07:16.622514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:16.631614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-7c2b64c3-9b4c-43ee-90f5-5808f73c5101 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:07:16.631614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:16.631614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:16.631614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:16.631614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:16.631614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:16.631614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:16.631614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:16.631614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:16.631614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:16.631614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:16.631614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:16.631614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:07:16.631614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:07:16.631614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:07:16.631614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:07:16.640703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:07:16.640703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:07:16.640703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:07:16.640703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:07:16.640703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:16.640703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:16.640703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:16.640703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:16.640703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:16.640703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:16.640703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:16.640703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:16.640703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:16.640703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:16.640703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:16.640703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:16.642348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:16.642348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:16.642348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:16.642348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:16.642348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:07:16.642348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:07:16.642348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:07:16.642348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:07:16.642348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:07:16.642348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:07:16.642348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:07:16.642348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:16.642348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 407/828] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:07:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:16.642348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b64c3-9b4c-43ee-90f5-5808f73c5101 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:16.654171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e90fb-84cc-4e85-81d7-1af52c88b386 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:16.725974 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d003b5-5f5a-4528-a5c6-f90db2b840fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:16.728112 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d003b5-5f5a-4528-a5c6-f90db2b840fb None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:16.728820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d003b5-5f5a-4528-a5c6-f90db2b840fb None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:16.729813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d003b5-5f5a-4528-a5c6-f90db2b840fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:16.750909 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d003b5-5f5a-4528-a5c6-f90db2b840fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:16.754568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d003b5-5f5a-4528-a5c6-f90db2b840fb None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:16.790826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-69d003b5-5f5a-4528-a5c6-f90db2b840fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:16.790826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:16.790826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:16.790826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:16.790826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:16.790826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:16.790826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:16.790826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:16.790826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:16.790826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:16.790826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:16.790826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:16.790826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:16.790826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:16.790826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:16.790826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:16.792781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:16.792781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:16.792781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:16.792781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:16.792781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:16.792781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:16.792781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:16.792781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:16.792781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:16.792781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:16.792781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:16.792781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:16.792781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:16.792781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:16.792781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:16.792781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:16.792781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:16.794643 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:16.794643 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:16.794643 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:16.803103 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 422/829] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:16.803103 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d003b5-5f5a-4528-a5c6-f90db2b840fb None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:16.821176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:16.847463 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b64c3-9b4c-43ee-90f5-5808f73c5101 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:16.918879 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df37e38-a695-42ea-a625-c0435fb71ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:16.919904 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df37e38-a695-42ea-a625-c0435fb71ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:16.920707 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df37e38-a695-42ea-a625-c0435fb71ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:16.920969 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df37e38-a695-42ea-a625-c0435fb71ec3 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:16.922107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df37e38-a695-42ea-a625-c0435fb71ec3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:16.922659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df37e38-a695-42ea-a625-c0435fb71ec3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:16.925578 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df37e38-a695-42ea-a625-c0435fb71ec3 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:16.935804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 408/830] 10.222.0.83 () {56 vars in 1112 bytes} [Fri Sep 23 01:07:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:16.937668 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df37e38-a695-42ea-a625-c0435fb71ec3 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:16.949214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d003b5-5f5a-4528-a5c6-f90db2b840fb None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:16.995453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8ef5d-a337-4bb1-9e7e-d917b266ad59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:16.996598 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8ef5d-a337-4bb1-9e7e-d917b266ad59 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:16.997096 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8ef5d-a337-4bb1-9e7e-d917b266ad59 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:16.997597 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8ef5d-a337-4bb1-9e7e-d917b266ad59 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:16.998522 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8ef5d-a337-4bb1-9e7e-d917b266ad59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:16.999142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8ef5d-a337-4bb1-9e7e-d917b266ad59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:17.000861 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8ef5d-a337-4bb1-9e7e-d917b266ad59 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:17.018731 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 423/831] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:07:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:17.020162 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8ef5d-a337-4bb1-9e7e-d917b266ad59 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:17.031535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:17.141435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df37e38-a695-42ea-a625-c0435fb71ec3 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:17.219971 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21f824-08ce-4ea9-890d-fb491126bfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:17.221266 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21f824-08ce-4ea9-890d-fb491126bfbc None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:17.222438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21f824-08ce-4ea9-890d-fb491126bfbc None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:17.223093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21f824-08ce-4ea9-890d-fb491126bfbc None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:17.224252 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21f824-08ce-4ea9-890d-fb491126bfbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:17.224910 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21f824-08ce-4ea9-890d-fb491126bfbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:17.227008 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21f824-08ce-4ea9-890d-fb491126bfbc None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:17.238206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8ef5d-a337-4bb1-9e7e-d917b266ad59 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:17.251624 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 409/832] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:17.253490 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21f824-08ce-4ea9-890d-fb491126bfbc None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:17.285688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:17.341723 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb60697-db6a-4c77-bd1d-0777c7163e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:17.343149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb60697-db6a-4c77-bd1d-0777c7163e99 None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:17.344158 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb60697-db6a-4c77-bd1d-0777c7163e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:17.345504 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb60697-db6a-4c77-bd1d-0777c7163e99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:17.347532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb60697-db6a-4c77-bd1d-0777c7163e99 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:17.350992 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb60697-db6a-4c77-bd1d-0777c7163e99 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:17.410511 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21f824-08ce-4ea9-890d-fb491126bfbc None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:17.460121 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8d1f7-b0fd-4e95-9f8a-61a94954d5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:17.460966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8d1f7-b0fd-4e95-9f8a-61a94954d5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:17.461379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8d1f7-b0fd-4e95-9f8a-61a94954d5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:17.461819 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8d1f7-b0fd-4e95-9f8a-61a94954d5c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:17.481579 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8d1f7-b0fd-4e95-9f8a-61a94954d5c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:17.483778 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 424/833] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:07:17 2022] POST /identity/v3/endpoints => generated 337 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:07:17.484518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8d1f7-b0fd-4e95-9f8a-61a94954d5c0 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:17.486577 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb60697-db6a-4c77-bd1d-0777c7163e99 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:17.521592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-a8c8d1f7-b0fd-4e95-9f8a-61a94954d5c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:17.521592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:17.521592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:17.521592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:17.521592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:17.521592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:17.521592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:17.521592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:17.521592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:17.521592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:17.521592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:17.521592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:17.521592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:17.521592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:17.521592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:17.521592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:17.523959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:17.523959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:17.523959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:17.523959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:17.523959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:17.523959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:17.523959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:17.523959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:17.523959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:17.523959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:17.523959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:17.523959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:17.523959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:17.523959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:17.523959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:17.523959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:17.523959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:17.525989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:17.525989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:17.525989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:17.532113 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 410/834] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:17.550189 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8d1f7-b0fd-4e95-9f8a-61a94954d5c0 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:17.636760 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:17.735091 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb60697-db6a-4c77-bd1d-0777c7163e99 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:17.797284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:17.809914 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381ea52-6977-4eed-be5a-ac59d511e3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:17.811436 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381ea52-6977-4eed-be5a-ac59d511e3dc None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:17.812169 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381ea52-6977-4eed-be5a-ac59d511e3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:17.812903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381ea52-6977-4eed-be5a-ac59d511e3dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:17.827799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381ea52-6977-4eed-be5a-ac59d511e3dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:17.830787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381ea52-6977-4eed-be5a-ac59d511e3dc None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:17.856455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-c381ea52-6977-4eed-be5a-ac59d511e3dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:17.856455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:17.856455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:17.856455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:17.856455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:17.856455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:17.856455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:17.856455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:17.856455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:17.856455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:17.856455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:17.856455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:17.856455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:07:17.856455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:07:17.856455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:07:17.858035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:07:17.858035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:17.858035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:17.858035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:17.858035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:17.858035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:17.858035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:17.858035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:17.858035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:17.858035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:17.858035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:17.858035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:17.858035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:17.858035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:17.858035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:17.858035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:17.858035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:17.859875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:07:17.859875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:07:17.859875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:07:17.859875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:07:17.859875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:07:17.859875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:07:17.859875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:17.859875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:17.864476 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 425/835] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:07:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:17.875052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381ea52-6977-4eed-be5a-ac59d511e3dc None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:17.928866 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8d1f7-b0fd-4e95-9f8a-61a94954d5c0 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:18.004529 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c0b24-6550-40c0-9aa3-e3d94f3c7cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:18.005871 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0b24-6550-40c0-9aa3-e3d94f3c7cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:18.006897 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0b24-6550-40c0-9aa3-e3d94f3c7cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:18.007372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0b24-6550-40c0-9aa3-e3d94f3c7cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:18.008212 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c0b24-6550-40c0-9aa3-e3d94f3c7cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:18.008666 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c0b24-6550-40c0-9aa3-e3d94f3c7cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:18.010650 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c0b24-6550-40c0-9aa3-e3d94f3c7cf7 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:18.028222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 411/836] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:18.035634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c0b24-6550-40c0-9aa3-e3d94f3c7cf7 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:18.098946 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381ea52-6977-4eed-be5a-ac59d511e3dc None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:18.129729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:18.161562 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a5f3d-35f9-4b98-b2f0-d7a83c156716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:18.162706 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a5f3d-35f9-4b98-b2f0-d7a83c156716 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:18.163258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a5f3d-35f9-4b98-b2f0-d7a83c156716 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:18.165194 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a5f3d-35f9-4b98-b2f0-d7a83c156716 None admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:18.165703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c0b24-6550-40c0-9aa3-e3d94f3c7cf7 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:18.166657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a5f3d-35f9-4b98-b2f0-d7a83c156716 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:18.167164 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a5f3d-35f9-4b98-b2f0-d7a83c156716 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:18.170409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a5f3d-35f9-4b98-b2f0-d7a83c156716 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:18.195348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:18.195854 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 426/837] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:07:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:18.206407 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a5f3d-35f9-4b98-b2f0-d7a83c156716 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:18.212230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c17b9-a840-426f-a5e6-3f9643f48246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:18.212230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c17b9-a840-426f-a5e6-3f9643f48246 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:18.212230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c17b9-a840-426f-a5e6-3f9643f48246 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:18.212230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c17b9-a840-426f-a5e6-3f9643f48246 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:18.219346 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c17b9-a840-426f-a5e6-3f9643f48246 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:18.221322 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c17b9-a840-426f-a5e6-3f9643f48246 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:18.235645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-1f2c17b9-a840-426f-a5e6-3f9643f48246 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 01:07:18.235645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:18.235645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:18.235645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:18.235645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:18.235645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:18.235645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:18.235645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:18.235645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:18.235645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:18.235645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:18.235645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:18.235645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:07:18.235645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:07:18.235645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:07:18.235645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:07:18.238035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:18.238035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:18.238035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:07:18.238035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:18.238035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:07:18.238035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:18.238035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:18.238035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:18.238035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:18.238035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:18.238035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:18.238035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:18.238035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:18.238035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:18.238035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:18.238035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:18.238035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:18.238035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:18.239976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:18.239976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:18.239976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:07:18.239976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:07:18.239976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:07:18.239976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:07:18.239976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:07:18.239976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:07:18.239976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 23 01:07:18.239976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:18.239976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 412/838] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:07:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:18.246757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c17b9-a840-426f-a5e6-3f9643f48246 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:18.372588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a5f3d-35f9-4b98-b2f0-d7a83c156716 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:18.398982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c17b9-a840-426f-a5e6-3f9643f48246 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:18.433607 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e4da0-4513-4977-810b-1df7baf82f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:18.434560 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e4da0-4513-4977-810b-1df7baf82f59 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:18.435054 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e4da0-4513-4977-810b-1df7baf82f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:18.435492 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e4da0-4513-4977-810b-1df7baf82f59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:18.436734 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e4da0-4513-4977-810b-1df7baf82f59 None admin] RBAC: Adding query filter params (role.id=d365054bc34046c5829cd1355f3a31ac, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=824648d693af4b44ae5df853a3d258f5) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:18.437250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e4da0-4513-4977-810b-1df7baf82f59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:18.439638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e4da0-4513-4977-810b-1df7baf82f59 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:18.450328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 427/839] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:07:18 2022] GET /identity/v3/role_assignments?user.id=824648d693af4b44ae5df853a3d258f5&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=d365054bc34046c5829cd1355f3a31ac => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:18.452098 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88b0ae-a0aa-4153-b0e2-ffd54fbb3931 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:18.452490 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88b0ae-a0aa-4153-b0e2-ffd54fbb3931 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:18.452868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88b0ae-a0aa-4153-b0e2-ffd54fbb3931 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:18.460136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 428/840] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:18.462670 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95ca12-add8-4e12-b5a6-ee7cb1a9d36d None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:18.463144 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95ca12-add8-4e12-b5a6-ee7cb1a9d36d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:18.463615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95ca12-add8-4e12-b5a6-ee7cb1a9d36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:18.468128 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5374aba-0821-43e5-8495-36fdfd3e0afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:18.469537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5374aba-0821-43e5-8495-36fdfd3e0afc None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:18.470248 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5374aba-0821-43e5-8495-36fdfd3e0afc None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:18.470949 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5374aba-0821-43e5-8495-36fdfd3e0afc None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:18.472635 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5374aba-0821-43e5-8495-36fdfd3e0afc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:18.473397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5374aba-0821-43e5-8495-36fdfd3e0afc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:18.476024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5374aba-0821-43e5-8495-36fdfd3e0afc None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:18.493697 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-3c95ca12-add8-4e12-b5a6-ee7cb1a9d36d None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:18.496794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-3c95ca12-add8-4e12-b5a6-ee7cb1a9d36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:18.510004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 413/841] 10.222.0.83 () {56 vars in 1135 bytes} [Fri Sep 23 01:07:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:18.517241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5374aba-0821-43e5-8495-36fdfd3e0afc None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:18.564274 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:18.601753 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:18.611141 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 429/842] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:18.710695 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5374aba-0821-43e5-8495-36fdfd3e0afc None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:18.774478 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2d6fb-9ef3-44c8-9135-0afc3979ef69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:18.775508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2d6fb-9ef3-44c8-9135-0afc3979ef69 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:18.775990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2d6fb-9ef3-44c8-9135-0afc3979ef69 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:18.776454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2d6fb-9ef3-44c8-9135-0afc3979ef69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:18.859019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1f26c-6643-4578-b341-da3421575913 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:18.859454 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1f26c-6643-4578-b341-da3421575913 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:18.859639 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1f26c-6643-4578-b341-da3421575913 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:18.861373 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 430/843] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:07:18.868136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c0c19-d676-4eb3-a7a9-99e3c536b38d None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:18.868489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c0c19-d676-4eb3-a7a9-99e3c536b38d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:18.868862 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c0c19-d676-4eb3-a7a9-99e3c536b38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:18.891253 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-f53c0c19-d676-4eb3-a7a9-99e3c536b38d None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:18.892904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f53c0c19-d676-4eb3-a7a9-99e3c536b38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:18.920790 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2d6fb-9ef3-44c8-9135-0afc3979ef69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:18.924020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2d6fb-9ef3-44c8-9135-0afc3979ef69 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:19.007398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 431/844] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 01:07:19.008767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c0c19-d676-4eb3-a7a9-99e3c536b38d None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:19.015372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:19.127461 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 414/845] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:07:18 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 23 01:07:19.137213 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2d6fb-9ef3-44c8-9135-0afc3979ef69 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:19.212078 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c0c19-d676-4eb3-a7a9-99e3c536b38d None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:19.214919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:19.278547 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280cba8-11a5-48a4-ae0c-6dba48e71a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:19.279675 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280cba8-11a5-48a4-ae0c-6dba48e71a2b None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:19.280192 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280cba8-11a5-48a4-ae0c-6dba48e71a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:19.280355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2d6fb-9ef3-44c8-9135-0afc3979ef69 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:19.280712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280cba8-11a5-48a4-ae0c-6dba48e71a2b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:19.281785 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280cba8-11a5-48a4-ae0c-6dba48e71a2b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:19.285778 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280cba8-11a5-48a4-ae0c-6dba48e71a2b None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:19.303330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-f280cba8-11a5-48a4-ae0c-6dba48e71a2b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 01:07:19.303330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:19.303330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:19.303330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:19.303330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:19.303330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:19.303330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:19.303330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:19.303330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 01:07:19.303330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:19.303330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:19.303330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:19.303330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:19.303330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:19.303330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:19.303330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:19.303330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:19.304390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:19.304390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:19.304390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:19.304390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:19.304390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:19.304390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:19.304390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:19.304390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:19.304390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:19.304390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:19.304390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:19.304390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:19.304390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:19.304390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:19.304390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:19.304390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:19.305206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:19.305206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:19.305206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:19.305206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:19.305206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:19.305206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:19.305206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:19.305206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:19.305206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:19.305206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:19.305206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:19.305206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:19.305206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 01:07:19.305206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:19.313505 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 432/846] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:07:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:19.315662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280cba8-11a5-48a4-ae0c-6dba48e71a2b None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:19.334508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2715a-2241-4f6e-bf76-00d947db26f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:19.335659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2715a-2241-4f6e-bf76-00d947db26f8 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:19.336141 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2715a-2241-4f6e-bf76-00d947db26f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:19.336622 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2715a-2241-4f6e-bf76-00d947db26f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:19.355418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2715a-2241-4f6e-bf76-00d947db26f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:19.358212 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2715a-2241-4f6e-bf76-00d947db26f8 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:19.361564 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:19.388143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-09e2715a-2241-4f6e-bf76-00d947db26f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:19.388143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:19.388143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:19.388143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:19.388143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:19.388143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:19.388143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:19.388143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:19.388143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:19.388143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:19.388143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:19.388143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:19.388143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:19.388143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:19.388143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:19.388143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:19.389163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:19.389163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:19.389163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:19.389163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:19.389163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:19.389163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:19.389163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:19.389163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:19.389163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:19.389163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:19.389163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:19.389163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:19.389163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:19.389163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:19.389163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:19.389163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:19.389163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:19.390048 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:19.390048 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:19.390048 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:19.390216 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 415/847] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:07:19.391705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2715a-2241-4f6e-bf76-00d947db26f8 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:19.449258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280cba8-11a5-48a4-ae0c-6dba48e71a2b None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:19.492533 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a112fda-5dbd-4248-a210-aa7b3fbc2fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:19.493209 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a112fda-5dbd-4248-a210-aa7b3fbc2fed None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:19.493485 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a112fda-5dbd-4248-a210-aa7b3fbc2fed None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:19.493854 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a112fda-5dbd-4248-a210-aa7b3fbc2fed None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:19.494793 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a112fda-5dbd-4248-a210-aa7b3fbc2fed None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:19.495439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a112fda-5dbd-4248-a210-aa7b3fbc2fed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:19.496860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a112fda-5dbd-4248-a210-aa7b3fbc2fed None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:19.510712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 433/848] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:07:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:19.510712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a112fda-5dbd-4248-a210-aa7b3fbc2fed None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:19.564894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:19.585177 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2715a-2241-4f6e-bf76-00d947db26f8 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:19.638994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019cd5e-2446-48c4-82ae-d8fba9e655e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:19.640464 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019cd5e-2446-48c4-82ae-d8fba9e655e3 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:19.640951 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019cd5e-2446-48c4-82ae-d8fba9e655e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:19.641432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019cd5e-2446-48c4-82ae-d8fba9e655e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:19.662991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019cd5e-2446-48c4-82ae-d8fba9e655e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:07:19.672838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-f019cd5e-2446-48c4-82ae-d8fba9e655e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:07:19.672838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:19.672838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:19.672838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:19.672838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:19.672838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:19.672838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:19.672838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:19.672838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:19.672838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:19.672838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:19.672838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:19.672838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:07:19.672838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:07:19.672838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:07:19.672838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:07:19.674991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:07:19.674991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:07:19.674991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:07:19.674991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:07:19.674991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:19.674991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:19.674991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:19.674991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:19.674991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:19.674991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:19.674991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:19.674991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:19.674991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:19.674991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:19.674991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:19.674991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:19.676900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:19.676900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:19.676900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:19.676900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:19.676900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:07:19.676900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:07:19.676900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:07:19.676900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:07:19.676900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:07:19.676900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:07:19.676900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:07:19.676900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:19.681479 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 416/849] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:07:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:19.682509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019cd5e-2446-48c4-82ae-d8fba9e655e3 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:19.687685 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a112fda-5dbd-4248-a210-aa7b3fbc2fed None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:19.750127 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50be5a1-1ab9-4e85-967a-5e9cf8ef2904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:19.751122 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be5a1-1ab9-4e85-967a-5e9cf8ef2904 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:19.751560 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be5a1-1ab9-4e85-967a-5e9cf8ef2904 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:19.751946 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be5a1-1ab9-4e85-967a-5e9cf8ef2904 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:19.753231 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50be5a1-1ab9-4e85-967a-5e9cf8ef2904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:19.753733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50be5a1-1ab9-4e85-967a-5e9cf8ef2904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:19.756167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50be5a1-1ab9-4e85-967a-5e9cf8ef2904 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:19.776059 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:19.779195 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 434/850] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:19.780464 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50be5a1-1ab9-4e85-967a-5e9cf8ef2904 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:19.857559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019cd5e-2446-48c4-82ae-d8fba9e655e3 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:19.930454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac38f0c-8804-4462-bcbe-230f42f9b908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:19.931592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac38f0c-8804-4462-bcbe-230f42f9b908 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:19.932136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac38f0c-8804-4462-bcbe-230f42f9b908 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:19.932606 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac38f0c-8804-4462-bcbe-230f42f9b908 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:19.933773 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac38f0c-8804-4462-bcbe-230f42f9b908 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:19.934291 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac38f0c-8804-4462-bcbe-230f42f9b908 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:19.935528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:19.936896 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac38f0c-8804-4462-bcbe-230f42f9b908 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:19.945953 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 417/851] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:07:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:19.947680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac38f0c-8804-4462-bcbe-230f42f9b908 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:19.963659 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50be5a1-1ab9-4e85-967a-5e9cf8ef2904 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:20.036501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59383faf-bccc-4628-ad59-ecc797a88cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:20.037950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59383faf-bccc-4628-ad59-ecc797a88cdc None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:20.038710 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59383faf-bccc-4628-ad59-ecc797a88cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:20.040086 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59383faf-bccc-4628-ad59-ecc797a88cdc None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:20.041637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59383faf-bccc-4628-ad59-ecc797a88cdc None admin] RBAC: Adding query filter params (name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:20.042423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59383faf-bccc-4628-ad59-ecc797a88cdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:20.045941 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59383faf-bccc-4628-ad59-ecc797a88cdc None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:20.064247 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 435/852] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:07:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:20.074660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59383faf-bccc-4628-ad59-ecc797a88cdc None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:20.142997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac38f0c-8804-4462-bcbe-230f42f9b908 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:20.179596 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:20.217788 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7eed69-216b-4d91-bd4b-3eb01a2121ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:20.219107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eed69-216b-4d91-bd4b-3eb01a2121ce None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:20.219565 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eed69-216b-4d91-bd4b-3eb01a2121ce None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:20.220297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eed69-216b-4d91-bd4b-3eb01a2121ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:20.234246 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7eed69-216b-4d91-bd4b-3eb01a2121ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:20.238895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7eed69-216b-4d91-bd4b-3eb01a2121ce None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:20.245740 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59383faf-bccc-4628-ad59-ecc797a88cdc None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:20.263725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-fe7eed69-216b-4d91-bd4b-3eb01a2121ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:20.263725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:20.263725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:20.263725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:20.263725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:20.263725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:20.263725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:20.263725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:20.263725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:20.263725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:20.263725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:20.263725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:20.263725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:07:20.263725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:07:20.263725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:07:20.265041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:07:20.265041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:20.265041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:20.265041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:20.265041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:20.265041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:20.265041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:20.265041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:20.265041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:20.265041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:20.265041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:20.265041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:20.265041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:20.265041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:20.265041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:20.265041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:20.265041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:20.266342 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:07:20.266342 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:07:20.266342 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:07:20.266342 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:07:20.266342 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:07:20.266342 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:07:20.266342 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:20.266342 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:20.266950 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 418/853] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:07:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:20.276498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7eed69-216b-4d91-bd4b-3eb01a2121ce None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:20.301885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312011b-e17c-4ada-84f4-e83d5453c473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:20.302487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312011b-e17c-4ada-84f4-e83d5453c473 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:20.303045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312011b-e17c-4ada-84f4-e83d5453c473 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:20.303531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312011b-e17c-4ada-84f4-e83d5453c473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:20.335224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312011b-e17c-4ada-84f4-e83d5453c473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:20.338216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312011b-e17c-4ada-84f4-e83d5453c473 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:20.373240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-9312011b-e17c-4ada-84f4-e83d5453c473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:20.373240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:20.373240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:20.373240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:20.373240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:20.373240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:20.373240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:20.373240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:20.373240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:20.373240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:20.373240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:20.373240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:20.373240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:20.373240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:20.373240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:20.373240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:20.374258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:20.374258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:20.374258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:20.374258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:20.374258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:20.374258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:20.374258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:20.374258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:20.374258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:20.374258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:20.374258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:20.374258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:20.374258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:20.374258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:20.374258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:20.374258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:20.374258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:20.375173 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:20.375173 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:20.375173 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:20.377012 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 436/854] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:07:20.391458 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312011b-e17c-4ada-84f4-e83d5453c473 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:20.398440 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:20.514200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7eed69-216b-4d91-bd4b-3eb01a2121ce None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:20.587442 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e0f86-d5c1-478c-b657-43f410a9c77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:20.588246 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312011b-e17c-4ada-84f4-e83d5453c473 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:20.588969 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e0f86-d5c1-478c-b657-43f410a9c77c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:20.588969 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e0f86-d5c1-478c-b657-43f410a9c77c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:20.589402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e0f86-d5c1-478c-b657-43f410a9c77c None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:20.590753 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e0f86-d5c1-478c-b657-43f410a9c77c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:20.591393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e0f86-d5c1-478c-b657-43f410a9c77c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:20.594198 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e0f86-d5c1-478c-b657-43f410a9c77c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:20.630700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 419/855] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:07:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:20.647566 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e0f86-d5c1-478c-b657-43f410a9c77c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:20.675744 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5ac46-82ce-4b99-9d8f-52b844433194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:20.676666 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5ac46-82ce-4b99-9d8f-52b844433194 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:20.677097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5ac46-82ce-4b99-9d8f-52b844433194 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:20.677546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5ac46-82ce-4b99-9d8f-52b844433194 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:20.678652 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5ac46-82ce-4b99-9d8f-52b844433194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:20.679160 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5ac46-82ce-4b99-9d8f-52b844433194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:20.681710 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5ac46-82ce-4b99-9d8f-52b844433194 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:20.705487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 437/856] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:20.715398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5ac46-82ce-4b99-9d8f-52b844433194 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:20.751659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:20.836778 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:20.896381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e0f86-d5c1-478c-b657-43f410a9c77c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:20.915023 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5ac46-82ce-4b99-9d8f-52b844433194 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:20.978852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbff315-5a4f-4839-83a0-6ffe1780c072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:20.980363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbff315-5a4f-4839-83a0-6ffe1780c072 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:20.981247 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbff315-5a4f-4839-83a0-6ffe1780c072 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:20.982067 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbff315-5a4f-4839-83a0-6ffe1780c072 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:20.983532 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbff315-5a4f-4839-83a0-6ffe1780c072 None admin] RBAC: Adding query filter params (role.id=d365054bc34046c5829cd1355f3a31ac, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=c526c7ad227943d1a2bba7b5e2e039e0) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:20.984015 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbff315-5a4f-4839-83a0-6ffe1780c072 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:20.986063 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbff315-5a4f-4839-83a0-6ffe1780c072 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:20.995417 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080b37f-9cb3-4597-a548-94d4ff4194c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:20.996278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080b37f-9cb3-4597-a548-94d4ff4194c5 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:20.996814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080b37f-9cb3-4597-a548-94d4ff4194c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:20.997249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080b37f-9cb3-4597-a548-94d4ff4194c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:21.002158 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 420/857] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:07:20 2022] GET /identity/v3/role_assignments?user.id=c526c7ad227943d1a2bba7b5e2e039e0&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=d365054bc34046c5829cd1355f3a31ac => generated 608 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:21.026300 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080b37f-9cb3-4597-a548-94d4ff4194c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:21.032361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080b37f-9cb3-4597-a548-94d4ff4194c5 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:21.060384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-f080b37f-9cb3-4597-a548-94d4ff4194c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 01:07:21.060384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:21.060384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:21.060384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:21.060384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:21.060384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:21.060384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:21.060384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:21.060384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:21.060384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:21.060384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:21.060384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:21.060384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:07:21.060384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:07:21.060384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:07:21.060384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:07:21.062732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:21.062732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:21.062732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:07:21.062732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:21.062732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:07:21.062732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:21.062732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:21.062732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:21.062732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:21.062732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:21.062732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:21.062732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:21.062732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:21.062732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:21.062732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:21.062732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:21.062732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:21.062732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:21.064919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:21.064919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:21.064919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:07:21.064919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:07:21.064919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:07:21.064919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:07:21.064919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:07:21.064919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:07:21.064919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 01:07:21.064919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:21.069460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 438/858] 10.222.0.83 () {56 vars in 1117 bytes} [Fri Sep 23 01:07:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:07:21.083175 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbff315-5a4f-4839-83a0-6ffe1780c072 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:21.329797 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbff315-5a4f-4839-83a0-6ffe1780c072 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:21.333487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:21.379024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e05f08-2d5a-4dc1-8034-dca561a22f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:21.379660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e05f08-2d5a-4dc1-8034-dca561a22f9d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:21.379930 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e05f08-2d5a-4dc1-8034-dca561a22f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:21.380195 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e05f08-2d5a-4dc1-8034-dca561a22f9d None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:21.380940 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e05f08-2d5a-4dc1-8034-dca561a22f9d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:21.381244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e05f08-2d5a-4dc1-8034-dca561a22f9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:21.382843 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e05f08-2d5a-4dc1-8034-dca561a22f9d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:21.400920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffc318-4661-4319-9432-59e1f6ac48e3 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:21.401225 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffc318-4661-4319-9432-59e1f6ac48e3 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:21.401552 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffc318-4661-4319-9432-59e1f6ac48e3 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:21.403383 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 439/859] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:21.407106 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 421/860] 10.222.0.83 () {56 vars in 1149 bytes} [Fri Sep 23 01:07:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:21.414300 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790d47d-07ff-4348-8e90-0af3a631ecd9 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:21.415114 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790d47d-07ff-4348-8e90-0af3a631ecd9 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:21.415573 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790d47d-07ff-4348-8e90-0af3a631ecd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:21.416010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e05f08-2d5a-4dc1-8034-dca561a22f9d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:21.436816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-a790d47d-07ff-4348-8e90-0af3a631ecd9 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:21.438084 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a790d47d-07ff-4348-8e90-0af3a631ecd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:21.530742 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 440/861] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:21.628541 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e05f08-2d5a-4dc1-8034-dca561a22f9d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:21.689240 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84301537-c4d2-47ab-a847-5c0b7334adbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:21.690074 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84301537-c4d2-47ab-a847-5c0b7334adbb None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:21.690951 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84301537-c4d2-47ab-a847-5c0b7334adbb None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:21.691390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84301537-c4d2-47ab-a847-5c0b7334adbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:21.743591 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:21.810541 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790d47d-07ff-4348-8e90-0af3a631ecd9 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:21.825545 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84301537-c4d2-47ab-a847-5c0b7334adbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:21.827802 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84301537-c4d2-47ab-a847-5c0b7334adbb None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:21.880384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:21.949768 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790d47d-07ff-4348-8e90-0af3a631ecd9 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:21.993754 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9d197-7039-4e5c-8884-6d4993d3c6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:21.994442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9d197-7039-4e5c-8884-6d4993d3c6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:21.994944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9d197-7039-4e5c-8884-6d4993d3c6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:21.995240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9d197-7039-4e5c-8884-6d4993d3c6a1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:21.995841 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9d197-7039-4e5c-8884-6d4993d3c6a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:21.997589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9d197-7039-4e5c-8884-6d4993d3c6a1 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:22.009596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-e5d9d197-7039-4e5c-8884-6d4993d3c6a1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 01:07:22.009596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:22.009596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:22.009596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:22.009596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:22.009596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:22.009596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:22.009596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:22.009596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 01:07:22.009596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:22.009596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:22.009596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:22.009596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:22.009596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:22.009596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:22.009596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:22.010719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:22.010719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:22.010719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:22.010719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:22.010719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:22.010719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:22.010719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:22.010719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:22.010719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:22.010719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:22.010719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:22.010719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:22.010719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:22.010719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:22.010719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:22.010719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:22.010719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:22.012064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:22.012064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:22.012064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:22.012064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:22.012064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:22.012064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:22.012064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:22.012064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:22.012064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:22.012064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:22.012064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:22.012064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:22.012064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 01:07:22.012064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:22.012064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 441/862] 10.222.0.83 () {56 vars in 1132 bytes} [Fri Sep 23 01:07:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:07:22.019576 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 422/863] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:07:21 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 23 01:07:22.020140 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9d197-7039-4e5c-8884-6d4993d3c6a1 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:22.026564 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84301537-c4d2-47ab-a847-5c0b7334adbb None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:22.115557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:22.168360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84301537-c4d2-47ab-a847-5c0b7334adbb None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:22.179540 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9d197-7039-4e5c-8884-6d4993d3c6a1 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:22.210411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:22.214158 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621d592-db13-4a32-9f6e-9f7d1ed8cdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:22.215478 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621d592-db13-4a32-9f6e-9f7d1ed8cdfb None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:22.216011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621d592-db13-4a32-9f6e-9f7d1ed8cdfb None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:22.216473 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621d592-db13-4a32-9f6e-9f7d1ed8cdfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:22.230093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621d592-db13-4a32-9f6e-9f7d1ed8cdfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:22.232041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621d592-db13-4a32-9f6e-9f7d1ed8cdfb None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:22.234287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a498de6-e8bb-4e2b-902d-ad359a157322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:22.235303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a498de6-e8bb-4e2b-902d-ad359a157322 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:22.235709 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a498de6-e8bb-4e2b-902d-ad359a157322 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:22.236172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a498de6-e8bb-4e2b-902d-ad359a157322 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:22.237524 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a498de6-e8bb-4e2b-902d-ad359a157322 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:22.237916 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a498de6-e8bb-4e2b-902d-ad359a157322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:22.239906 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a498de6-e8bb-4e2b-902d-ad359a157322 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:22.250646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 442/864] 10.222.0.83 () {56 vars in 1126 bytes} [Fri Sep 23 01:07:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:22.254800 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a498de6-e8bb-4e2b-902d-ad359a157322 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:22.260030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-a621d592-db13-4a32-9f6e-9f7d1ed8cdfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:22.260030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:22.260030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:22.260030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:22.260030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:22.260030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:22.260030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:22.260030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:22.260030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:22.260030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:22.260030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:22.260030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:22.260030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:22.260030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:22.260030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:22.260030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:22.261207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:22.261207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:22.261207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:22.261207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:22.261207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:22.261207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:22.261207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:22.261207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:22.261207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:22.261207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:22.261207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:22.261207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:22.261207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:22.261207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:22.261207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:22.261207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:22.261207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:22.262169 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:22.262169 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:22.262169 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:22.265864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 423/865] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:22.267413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621d592-db13-4a32-9f6e-9f7d1ed8cdfb None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:22.432034 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a498de6-e8bb-4e2b-902d-ad359a157322 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:22.435148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621d592-db13-4a32-9f6e-9f7d1ed8cdfb None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:22.457080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:22.491855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b69d10-003c-4418-845c-ed676a8466e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:22.493045 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b69d10-003c-4418-845c-ed676a8466e6 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:22.493726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b69d10-003c-4418-845c-ed676a8466e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:22.494464 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b69d10-003c-4418-845c-ed676a8466e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:22.494849 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45724a9-b417-47b5-bdde-c672f4bf212f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:22.495686 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45724a9-b417-47b5-bdde-c672f4bf212f None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:22.495967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45724a9-b417-47b5-bdde-c672f4bf212f None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:22.496245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45724a9-b417-47b5-bdde-c672f4bf212f None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:22.496353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b69d10-003c-4418-845c-ed676a8466e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:22.496868 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b69d10-003c-4418-845c-ed676a8466e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:22.497926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45724a9-b417-47b5-bdde-c672f4bf212f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:22.498230 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45724a9-b417-47b5-bdde-c672f4bf212f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:22.499299 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b69d10-003c-4418-845c-ed676a8466e6 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:22.499940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45724a9-b417-47b5-bdde-c672f4bf212f None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:22.515303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 443/866] 10.222.0.83 () {56 vars in 1126 bytes} [Fri Sep 23 01:07:22 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:22.526407 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 424/867] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:22.532957 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45724a9-b417-47b5-bdde-c672f4bf212f None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:22.630446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:22.725548 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45724a9-b417-47b5-bdde-c672f4bf212f None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:22.784417 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55e125-c6f4-4886-ac79-b1c0c6ddc972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:22.785819 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55e125-c6f4-4886-ac79-b1c0c6ddc972 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:22.786371 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55e125-c6f4-4886-ac79-b1c0c6ddc972 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:22.786893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55e125-c6f4-4886-ac79-b1c0c6ddc972 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:22.798001 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55e125-c6f4-4886-ac79-b1c0c6ddc972 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:22.800464 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55e125-c6f4-4886-ac79-b1c0c6ddc972 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:22.814669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-dd55e125-c6f4-4886-ac79-b1c0c6ddc972 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:22.814669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:22.814669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:22.814669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:22.814669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:22.814669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:22.814669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:22.814669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:22.814669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:22.814669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:22.814669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:22.814669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:22.814669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:07:22.814669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:07:22.814669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:07:22.816081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:07:22.816081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:22.816081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:22.816081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:22.816081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:22.816081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:22.816081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:22.816081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:22.816081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:22.816081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:22.816081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:22.816081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:22.816081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:22.816081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:22.816081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:22.816081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:22.816081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:22.817013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:07:22.817013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:07:22.817013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:07:22.817013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:07:22.817013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:07:22.817013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:07:22.817013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:22.817013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:22.819867 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 444/868] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:07:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:22.829211 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b69d10-003c-4418-845c-ed676a8466e6 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:23.077872 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b69d10-003c-4418-845c-ed676a8466e6 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:23.115688 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a278b-3b5e-4188-9f84-7a58ce040353 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:23.116647 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a278b-3b5e-4188-9f84-7a58ce040353 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:23.117229 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a278b-3b5e-4188-9f84-7a58ce040353 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:23.120252 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 445/869] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:23.130524 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe553671-24d5-4c8d-943d-bb1278330c45 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:23.130869 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe553671-24d5-4c8d-943d-bb1278330c45 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:23.131309 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe553671-24d5-4c8d-943d-bb1278330c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:23.156187 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-fe553671-24d5-4c8d-943d-bb1278330c45 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:23.157531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-fe553671-24d5-4c8d-943d-bb1278330c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:23.204814 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742450a-3aa6-4bc7-939c-e814c7b20767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:23.206449 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742450a-3aa6-4bc7-939c-e814c7b20767 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:23.207457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742450a-3aa6-4bc7-939c-e814c7b20767 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:23.208844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742450a-3aa6-4bc7-939c-e814c7b20767 None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:23.210350 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742450a-3aa6-4bc7-939c-e814c7b20767 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:23.212683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742450a-3aa6-4bc7-939c-e814c7b20767 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:23.215233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742450a-3aa6-4bc7-939c-e814c7b20767 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:23.259009 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 446/871] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:23.259346 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 425/871] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:07:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:23.263906 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe553671-24d5-4c8d-943d-bb1278330c45 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:23.312408 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:23.400651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe553671-24d5-4c8d-943d-bb1278330c45 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:23.458521 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328dc27-bbc9-4dcb-b7e6-065ef08f29c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:23.459278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328dc27-bbc9-4dcb-b7e6-065ef08f29c7 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:23.459555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328dc27-bbc9-4dcb-b7e6-065ef08f29c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:23.460049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328dc27-bbc9-4dcb-b7e6-065ef08f29c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:23.460852 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328dc27-bbc9-4dcb-b7e6-065ef08f29c7 None admin] RBAC: Adding query filter params (role.id=2e8d92bd39634bbdad03d67d3fc439f0, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=f2cea4c08f324769bf6dcea58c9394b3) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:23.461269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328dc27-bbc9-4dcb-b7e6-065ef08f29c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:23.462989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328dc27-bbc9-4dcb-b7e6-065ef08f29c7 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:23.473707 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 447/872] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:07:23 2022] GET /identity/v3/role_assignments?user.id=f2cea4c08f324769bf6dcea58c9394b3&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=2e8d92bd39634bbdad03d67d3fc439f0 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:23.585986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742450a-3aa6-4bc7-939c-e814c7b20767 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:23.626813 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:23.738991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742450a-3aa6-4bc7-939c-e814c7b20767 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:23.794262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcd4b4-f5ee-4221-b0c3-45b42a19b2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:23.795412 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd4b4-f5ee-4221-b0c3-45b42a19b2cc None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:23.796170 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd4b4-f5ee-4221-b0c3-45b42a19b2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:23.796674 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd4b4-f5ee-4221-b0c3-45b42a19b2cc None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:23.797595 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcd4b4-f5ee-4221-b0c3-45b42a19b2cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:23.800204 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcd4b4-f5ee-4221-b0c3-45b42a19b2cc None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:23.949178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 426/873] 10.222.0.83 () {60 vars in 1141 bytes} [Fri Sep 23 01:07:23 2022] POST /identity/v3/services => generated 251 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:07:24.284453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b0bb3-9ef7-45d6-98d1-1d58c0cf11f1 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:24.285031 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b0bb3-9ef7-45d6-98d1-1d58c0cf11f1 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:24.285031 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b0bb3-9ef7-45d6-98d1-1d58c0cf11f1 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:24.286724 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 448/874] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:24.294141 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cfc94-781e-4be2-86df-53e6cbc33832 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:24.294860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cfc94-781e-4be2-86df-53e6cbc33832 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:24.295482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cfc94-781e-4be2-86df-53e6cbc33832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:24.325822 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-f29cfc94-781e-4be2-86df-53e6cbc33832 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:24.327930 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f29cfc94-781e-4be2-86df-53e6cbc33832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:24.459749 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 427/875] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:24 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:24.750750 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b0bb3-9ef7-45d6-98d1-1d58c0cf11f1 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:24.901806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b0bb3-9ef7-45d6-98d1-1d58c0cf11f1 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:24.904545 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:24.947835 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e558805-c612-4c7b-afbf-20d97893fb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:24.948926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e558805-c612-4c7b-afbf-20d97893fb5c None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:24.949421 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e558805-c612-4c7b-afbf-20d97893fb5c None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:24.949982 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e558805-c612-4c7b-afbf-20d97893fb5c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:24.950930 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e558805-c612-4c7b-afbf-20d97893fb5c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:24.952632 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e558805-c612-4c7b-afbf-20d97893fb5c None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:24.963569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-9e558805-c612-4c7b-afbf-20d97893fb5c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 01:07:24.963569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:24.963569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:24.963569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:24.963569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:24.963569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:24.963569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:24.963569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:24.963569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 01:07:24.963569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:24.963569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:24.963569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:24.963569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:24.963569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:24.963569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:24.963569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:24.963569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:24.964605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:24.964605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:24.964605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:24.964605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:24.964605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:24.964605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:24.964605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:24.964605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:24.964605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:24.964605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:24.964605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:24.964605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:24.964605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:24.964605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:24.964605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:24.964605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:24.965543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:24.965543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:24.965543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:24.965543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:24.965543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:24.965543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:24.965543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:24.965543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:24.965543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:24.965543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:24.965543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:24.965543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:24.965543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 01:07:24.965543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:24.969028 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 449/876] 10.222.0.83 () {56 vars in 1126 bytes} [Fri Sep 23 01:07:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:24.986549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29cfc94-781e-4be2-86df-53e6cbc33832 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:25.043141 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:25.134294 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29cfc94-781e-4be2-86df-53e6cbc33832 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:25.178088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba3db5-1767-4074-9232-1737f9481e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:25.178743 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba3db5-1767-4074-9232-1737f9481e8a None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:25.179122 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba3db5-1767-4074-9232-1737f9481e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:25.179300 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba3db5-1767-4074-9232-1737f9481e8a None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:25.180022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba3db5-1767-4074-9232-1737f9481e8a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:25.180399 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba3db5-1767-4074-9232-1737f9481e8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:25.181826 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba3db5-1767-4074-9232-1737f9481e8a None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:25.187709 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 428/877] 10.222.0.83 () {56 vars in 1122 bytes} [Fri Sep 23 01:07:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:25.197575 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e558805-c612-4c7b-afbf-20d97893fb5c None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:25.397942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e558805-c612-4c7b-afbf-20d97893fb5c None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:25.441958 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3847c3c-2e50-4c42-b8a6-8f8e72475e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:25.442606 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3847c3c-2e50-4c42-b8a6-8f8e72475e3e None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:25.442888 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3847c3c-2e50-4c42-b8a6-8f8e72475e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:25.443171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3847c3c-2e50-4c42-b8a6-8f8e72475e3e None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:25.443825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3847c3c-2e50-4c42-b8a6-8f8e72475e3e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:25.444127 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3847c3c-2e50-4c42-b8a6-8f8e72475e3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:25.445671 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3847c3c-2e50-4c42-b8a6-8f8e72475e3e None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:25.452179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 450/878] 10.222.0.83 () {56 vars in 1122 bytes} [Fri Sep 23 01:07:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:25.504515 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ae32f-35cf-4a56-8a6a-2091b225ae52 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:25.505007 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ae32f-35cf-4a56-8a6a-2091b225ae52 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:25.505505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ae32f-35cf-4a56-8a6a-2091b225ae52 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:25.508697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 429/879] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:25.515501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3b792-7ad3-4e8b-8b91-d52396223484 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:25.516000 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3b792-7ad3-4e8b-8b91-d52396223484 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:25.516488 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3b792-7ad3-4e8b-8b91-d52396223484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:25.548393 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-5bb3b792-7ad3-4e8b-8b91-d52396223484 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:25.551184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-5bb3b792-7ad3-4e8b-8b91-d52396223484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:25.594112 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:25.650854 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 451/880] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:25 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:25.972507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ae32f-35cf-4a56-8a6a-2091b225ae52 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:26.089548 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:26.115466 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ae32f-35cf-4a56-8a6a-2091b225ae52 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:26.161691 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6107e88-e426-4686-b94c-dde8a0e287ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:26.162346 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6107e88-e426-4686-b94c-dde8a0e287ce None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:26.163014 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6107e88-e426-4686-b94c-dde8a0e287ce None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:26.163331 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6107e88-e426-4686-b94c-dde8a0e287ce None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:26.164017 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6107e88-e426-4686-b94c-dde8a0e287ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:26.165528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6107e88-e426-4686-b94c-dde8a0e287ce None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:26.298370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 430/881] 10.222.0.83 () {60 vars in 1141 bytes} [Fri Sep 23 01:07:25 2022] POST /identity/v3/services => generated 269 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:07:26.538798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa124724-461b-455a-a1e4-a6853446bbe7 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:26.539646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa124724-461b-455a-a1e4-a6853446bbe7 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:26.539825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa124724-461b-455a-a1e4-a6853446bbe7 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:26.542788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 452/882] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:26.551745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050ea55-3e08-4bbc-8374-426cc36443d2 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:26.552143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050ea55-3e08-4bbc-8374-426cc36443d2 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:26.552615 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050ea55-3e08-4bbc-8374-426cc36443d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:26.579536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-8050ea55-3e08-4bbc-8374-426cc36443d2 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:26.581655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-8050ea55-3e08-4bbc-8374-426cc36443d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:26.726576 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 431/883] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:26.726940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782737f0-ddc3-45bf-a799-2d2ef6830c4a None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:26.726940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782737f0-ddc3-45bf-a799-2d2ef6830c4a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:26.726940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782737f0-ddc3-45bf-a799-2d2ef6830c4a None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:26.727833 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 453/884] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:26.734353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae541594-c1af-48cb-b74a-72ad4abc9eff None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:26.735016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae541594-c1af-48cb-b74a-72ad4abc9eff None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:26.735524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae541594-c1af-48cb-b74a-72ad4abc9eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:26.759463 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-ae541594-c1af-48cb-b74a-72ad4abc9eff None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:26.761091 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ae541594-c1af-48cb-b74a-72ad4abc9eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:26.882356 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:26.892917 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 432/885] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:27.027883 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782737f0-ddc3-45bf-a799-2d2ef6830c4a None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:27.189140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae541594-c1af-48cb-b74a-72ad4abc9eff None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:27.216713 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782737f0-ddc3-45bf-a799-2d2ef6830c4a None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:27.289217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2739e50-49f0-40ca-b450-483373c26fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:27.290787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2739e50-49f0-40ca-b450-483373c26fff None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:27.291323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2739e50-49f0-40ca-b450-483373c26fff None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:27.291791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2739e50-49f0-40ca-b450-483373c26fff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:27.316192 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2739e50-49f0-40ca-b450-483373c26fff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:07:27.325305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-f2739e50-49f0-40ca-b450-483373c26fff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 01:07:27.325305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:27.325305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:27.325305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:27.325305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:27.325305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:27.325305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:27.325305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:27.325305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:27.325305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:27.325305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:27.325305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:27.325305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:07:27.325305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:07:27.325305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:07:27.325305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:07:27.326565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:07:27.326565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:07:27.326565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:07:27.326565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:07:27.326565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:27.326565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:27.326565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:27.326565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:27.326565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:27.326565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:27.326565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:27.326565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:27.326565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:27.326565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:27.326565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:27.326565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:27.327514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:27.327514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:27.327514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:27.327514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:27.327514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:07:27.327514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:07:27.327514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:07:27.327514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:07:27.327514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:07:27.327514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:07:27.327514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 01:07:27.327514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:27.327514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 454/886] 10.222.0.83 () {56 vars in 1120 bytes} [Fri Sep 23 01:07:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:27.338842 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2739e50-49f0-40ca-b450-483373c26fff None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:27.360596 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae541594-c1af-48cb-b74a-72ad4abc9eff None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:27.413281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fafcf2-f685-4a41-9f55-8df072fab0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:27.415150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:27.415288 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fafcf2-f685-4a41-9f55-8df072fab0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:27.415699 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fafcf2-f685-4a41-9f55-8df072fab0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:27.416375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fafcf2-f685-4a41-9f55-8df072fab0c8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:27.418894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fafcf2-f685-4a41-9f55-8df072fab0c8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:27.421746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fafcf2-f685-4a41-9f55-8df072fab0c8 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:27.439542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-34fafcf2-f685-4a41-9f55-8df072fab0c8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 01:07:27.439542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:27.439542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:27.439542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:27.439542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:27.439542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:27.439542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:27.439542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:27.439542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 01:07:27.439542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:27.439542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:27.439542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:27.439542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:27.439542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:27.439542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:27.439542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:27.439542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:27.441716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:27.441716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:27.441716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:27.441716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:27.441716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:27.441716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:27.441716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:27.441716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:27.441716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:27.441716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:27.441716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:27.441716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:27.441716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:27.441716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:27.441716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:27.441716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:27.442799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:27.442799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:27.442799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:27.442799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:27.442799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:27.442799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:27.442799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:27.442799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:27.442799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:27.442799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:27.442799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:27.442799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:27.442799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 01:07:27.442799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:27.447462 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 433/887] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:07:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:07:27.452699 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fafcf2-f685-4a41-9f55-8df072fab0c8 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:27.522230 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2739e50-49f0-40ca-b450-483373c26fff None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:27.577342 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:27.577607 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec5043-1d43-4cb6-9e41-4c543446d9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:27.578311 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec5043-1d43-4cb6-9e41-4c543446d9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:27.578737 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec5043-1d43-4cb6-9e41-4c543446d9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:27.578998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec5043-1d43-4cb6-9e41-4c543446d9b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:27.580331 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec5043-1d43-4cb6-9e41-4c543446d9b3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:27.580331 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec5043-1d43-4cb6-9e41-4c543446d9b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:27.583091 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec5043-1d43-4cb6-9e41-4c543446d9b3 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:27.603176 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 455/888] 10.222.0.83 () {56 vars in 1115 bytes} [Fri Sep 23 01:07:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:27.607858 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec5043-1d43-4cb6-9e41-4c543446d9b3 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:27.653035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fafcf2-f685-4a41-9f55-8df072fab0c8 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:27.700452 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e71757-ec81-48c5-81fc-2b2a609f545f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:27.701720 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e71757-ec81-48c5-81fc-2b2a609f545f None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:27.702233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e71757-ec81-48c5-81fc-2b2a609f545f None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:27.702798 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e71757-ec81-48c5-81fc-2b2a609f545f None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:27.703680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e71757-ec81-48c5-81fc-2b2a609f545f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:27.704212 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e71757-ec81-48c5-81fc-2b2a609f545f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:27.706664 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e71757-ec81-48c5-81fc-2b2a609f545f None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:27.713428 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 434/889] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:07:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:27.720039 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e71757-ec81-48c5-81fc-2b2a609f545f None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:27.737834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:27.765953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec5043-1d43-4cb6-9e41-4c543446d9b3 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:27.835049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdb2c5-1996-46bf-961b-6f9da32bcc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:27.836712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdb2c5-1996-46bf-961b-6f9da32bcc6d None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:27.837473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdb2c5-1996-46bf-961b-6f9da32bcc6d None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:27.838210 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdb2c5-1996-46bf-961b-6f9da32bcc6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:27.856889 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bdb2c5-1996-46bf-961b-6f9da32bcc6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:27.859685 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bdb2c5-1996-46bf-961b-6f9da32bcc6d None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:27.872666 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e71757-ec81-48c5-81fc-2b2a609f545f None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:27.895798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-e8bdb2c5-1996-46bf-961b-6f9da32bcc6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:27.895798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:27.895798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:27.895798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:27.895798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:27.895798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:27.895798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:27.895798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:27.895798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:27.895798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:27.895798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:27.895798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:27.895798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:27.895798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:27.895798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:27.895798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:27.897682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:27.897682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:27.897682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:27.897682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:27.897682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:27.897682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:27.897682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:27.897682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:27.897682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:27.897682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:27.897682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:27.897682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:27.897682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:27.897682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:27.897682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:27.897682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:27.897682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:27.899473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:27.899473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:27.899473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:27.907868 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:27.908937 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 456/890] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:27.913122 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdb2c5-1996-46bf-961b-6f9da32bcc6d None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:27.924697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c00b48-42a2-4f3a-9da1-292634d74497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:27.925636 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c00b48-42a2-4f3a-9da1-292634d74497 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:27.926151 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c00b48-42a2-4f3a-9da1-292634d74497 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:27.926762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c00b48-42a2-4f3a-9da1-292634d74497 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:27.927816 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c00b48-42a2-4f3a-9da1-292634d74497 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:27.928334 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c00b48-42a2-4f3a-9da1-292634d74497 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:27.930366 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c00b48-42a2-4f3a-9da1-292634d74497 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:27.937536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 435/891] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:07:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:27.948268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c00b48-42a2-4f3a-9da1-292634d74497 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:28.093071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c00b48-42a2-4f3a-9da1-292634d74497 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:28.139303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890d86f-2c5b-4686-99e4-a650ebbc8fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:28.140276 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890d86f-2c5b-4686-99e4-a650ebbc8fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:28.140705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890d86f-2c5b-4686-99e4-a650ebbc8fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:28.141187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890d86f-2c5b-4686-99e4-a650ebbc8fb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:28.142205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890d86f-2c5b-4686-99e4-a650ebbc8fb8 None admin] RBAC: Adding query filter params (interface=public, service_id=6242df35f8e64adbaf72483f8bd9c222, region_id=RegionOne) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:28.142795 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890d86f-2c5b-4686-99e4-a650ebbc8fb8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:28.145221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890d86f-2c5b-4686-99e4-a650ebbc8fb8 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:28.149629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdb2c5-1996-46bf-961b-6f9da32bcc6d None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:28.152797 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 436/892] 10.222.0.83 () {56 vars in 1251 bytes} [Fri Sep 23 01:07:27 2022] GET /identity/v3/endpoints?service_id=6242df35f8e64adbaf72483f8bd9c222&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:28.163931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890d86f-2c5b-4686-99e4-a650ebbc8fb8 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:28.217138 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:28.227302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3245dd-ead4-4459-9e2c-35f81116fad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:28.228331 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3245dd-ead4-4459-9e2c-35f81116fad1 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:28.228803 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3245dd-ead4-4459-9e2c-35f81116fad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:28.229753 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3245dd-ead4-4459-9e2c-35f81116fad1 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:28.230904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3245dd-ead4-4459-9e2c-35f81116fad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:28.231449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3245dd-ead4-4459-9e2c-35f81116fad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:28.234194 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3245dd-ead4-4459-9e2c-35f81116fad1 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:28.251278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:28.267146 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 457/893] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:28.272199 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3245dd-ead4-4459-9e2c-35f81116fad1 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:28.351536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890d86f-2c5b-4686-99e4-a650ebbc8fb8 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:28.402221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43461dad-5d17-428e-a82b-dfb59f94ee87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:28.403532 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43461dad-5d17-428e-a82b-dfb59f94ee87 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:28.404089 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43461dad-5d17-428e-a82b-dfb59f94ee87 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:28.404561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43461dad-5d17-428e-a82b-dfb59f94ee87 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:28.405520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43461dad-5d17-428e-a82b-dfb59f94ee87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:28.407564 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43461dad-5d17-428e-a82b-dfb59f94ee87 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:28.415429 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 437/894] 10.222.0.83 () {56 vars in 1087 bytes} [Fri Sep 23 01:07:28 2022] GET /identity/v3/services => generated 1268 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:07:28.483858 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3245dd-ead4-4459-9e2c-35f81116fad1 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:28.536652 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7621ac-22e2-4bf5-a4bb-3206d48b09fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:28.537884 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7621ac-22e2-4bf5-a4bb-3206d48b09fe None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:28.538417 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7621ac-22e2-4bf5-a4bb-3206d48b09fe None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:28.538931 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7621ac-22e2-4bf5-a4bb-3206d48b09fe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:28.548958 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7621ac-22e2-4bf5-a4bb-3206d48b09fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:28.552190 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7621ac-22e2-4bf5-a4bb-3206d48b09fe None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:28.570257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-bd7621ac-22e2-4bf5-a4bb-3206d48b09fe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 01:07:28.570257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:28.570257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:28.570257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:28.570257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:28.570257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:28.570257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:28.570257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:28.570257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:28.570257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:28.570257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:28.570257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:28.570257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:07:28.570257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:07:28.570257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:07:28.570257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:07:28.571651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:28.571651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:28.571651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:07:28.571651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:28.571651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:07:28.571651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:28.571651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:28.571651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:28.571651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:28.571651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:28.571651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:28.571651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:28.571651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:28.571651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:28.571651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:28.571651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:28.571651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:28.571651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:28.572648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:28.572648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:28.572648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:07:28.572648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:07:28.572648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:07:28.572648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:07:28.572648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:07:28.572648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:07:28.572648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 01:07:28.572648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:28.575760 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 458/895] 10.222.0.83 () {56 vars in 1117 bytes} [Fri Sep 23 01:07:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:28.583876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43461dad-5d17-428e-a82b-dfb59f94ee87 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:28.775854 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43461dad-5d17-428e-a82b-dfb59f94ee87 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:28.809819 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:28.841939 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8ed81-9a47-44c0-8e0d-fe08bb04d942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:28.843093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8ed81-9a47-44c0-8e0d-fe08bb04d942 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:28.843578 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8ed81-9a47-44c0-8e0d-fe08bb04d942 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:28.844064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8ed81-9a47-44c0-8e0d-fe08bb04d942 None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:28.845438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8ed81-9a47-44c0-8e0d-fe08bb04d942 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:28.846554 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8ed81-9a47-44c0-8e0d-fe08bb04d942 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:28.849687 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8ed81-9a47-44c0-8e0d-fe08bb04d942 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:28.898120 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 438/896] 10.222.0.83 () {56 vars in 1149 bytes} [Fri Sep 23 01:07:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:28.899385 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7621ac-22e2-4bf5-a4bb-3206d48b09fe None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:29.018165 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:29.125077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7621ac-22e2-4bf5-a4bb-3206d48b09fe None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:29.198853 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef43e7-f21a-430f-902e-726dfc8d3552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:29.199578 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef43e7-f21a-430f-902e-726dfc8d3552 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:29.199856 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef43e7-f21a-430f-902e-726dfc8d3552 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:29.200120 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef43e7-f21a-430f-902e-726dfc8d3552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:29.209418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a1dff-6536-4a5b-bc3e-a359a3d18400 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:29.209919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a1dff-6536-4a5b-bc3e-a359a3d18400 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:29.210413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a1dff-6536-4a5b-bc3e-a359a3d18400 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:29.213611 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 439/897] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:29.223966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12333f6b-352b-4466-8637-853095b01ad2 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:29.224892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12333f6b-352b-4466-8637-853095b01ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:29.225652 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12333f6b-352b-4466-8637-853095b01ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:29.265140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-12333f6b-352b-4466-8637-853095b01ad2 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:29.268844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-12333f6b-352b-4466-8637-853095b01ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:29.323080 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef43e7-f21a-430f-902e-726dfc8d3552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:29.326273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef43e7-f21a-430f-902e-726dfc8d3552 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:29.370050 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 440/898] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:29 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 01:07:29.412369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:29.500501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 459/899] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:07:28 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 23 01:07:29.508863 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12333f6b-352b-4466-8637-853095b01ad2 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:29.726384 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12333f6b-352b-4466-8637-853095b01ad2 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:29.742903 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:29.794741 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ef115-b4b3-467f-a6db-acf187041452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:29.796202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ef115-b4b3-467f-a6db-acf187041452 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:29.797018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ef115-b4b3-467f-a6db-acf187041452 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:29.797775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ef115-b4b3-467f-a6db-acf187041452 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:29.818539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ef115-b4b3-467f-a6db-acf187041452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:29.822441 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ef115-b4b3-467f-a6db-acf187041452 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:29.854849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-666ef115-b4b3-467f-a6db-acf187041452 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:29.854849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:29.854849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:29.854849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:29.854849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:29.854849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:29.854849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:29.854849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:29.854849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:29.854849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:29.854849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:29.854849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:29.854849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:29.854849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:29.854849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:29.854849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:29.856730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:29.856730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:29.856730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:29.856730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:29.856730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:29.856730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:29.856730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:29.856730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:29.856730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:29.856730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:29.856730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:29.856730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:29.856730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:29.856730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:29.856730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:29.856730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:29.856730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:29.858573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:29.858573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:29.858573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:29.862765 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 441/900] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:07:29.872290 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef43e7-f21a-430f-902e-726dfc8d3552 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:29.888100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ef115-b4b3-467f-a6db-acf187041452 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:30.098708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef43e7-f21a-430f-902e-726dfc8d3552 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:30.114191 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ef115-b4b3-467f-a6db-acf187041452 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:30.160798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea76ce-3c6d-4615-a6f0-584097e40208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:30.161818 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea76ce-3c6d-4615-a6f0-584097e40208 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:30.162265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea76ce-3c6d-4615-a6f0-584097e40208 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:30.162427 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed17059-7b76-446a-9dec-2ee31a69999c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:30.162602 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea76ce-3c6d-4615-a6f0-584097e40208 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:30.163245 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed17059-7b76-446a-9dec-2ee31a69999c None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:30.163435 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea76ce-3c6d-4615-a6f0-584097e40208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:30.163720 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed17059-7b76-446a-9dec-2ee31a69999c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:30.163899 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea76ce-3c6d-4615-a6f0-584097e40208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:30.164200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed17059-7b76-446a-9dec-2ee31a69999c None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:30.165013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed17059-7b76-446a-9dec-2ee31a69999c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:30.165941 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea76ce-3c6d-4615-a6f0-584097e40208 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:30.166783 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed17059-7b76-446a-9dec-2ee31a69999c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:30.181903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 460/901] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:30.183510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3493d73-f34e-4046-846d-7f2e950a1446 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:30.188889 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3493d73-f34e-4046-846d-7f2e950a1446 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:30.188889 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3493d73-f34e-4046-846d-7f2e950a1446 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:30.188889 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 461/902] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:30.192210 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3493d73-f34e-4046-846d-7f2e950a1446 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:30.213772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:30.279264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 442/903] 10.222.0.83 () {60 vars in 1141 bytes} [Fri Sep 23 01:07:29 2022] POST /identity/v3/services => generated 241 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:07:30.281602 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb42f01-3e2e-4acd-8bb2-bcf6e0ccfa29 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:30.282095 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb42f01-3e2e-4acd-8bb2-bcf6e0ccfa29 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:30.282573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb42f01-3e2e-4acd-8bb2-bcf6e0ccfa29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:30.315962 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-2eb42f01-3e2e-4acd-8bb2-bcf6e0ccfa29 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:30.317961 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-2eb42f01-3e2e-4acd-8bb2-bcf6e0ccfa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:30.344258 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:30.386686 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3493d73-f34e-4046-846d-7f2e950a1446 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:30.458626 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 443/904] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:30.463672 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fe7fb-d465-479d-85a0-9b6de31cc19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:30.464722 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fe7fb-d465-479d-85a0-9b6de31cc19f None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:30.465174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fe7fb-d465-479d-85a0-9b6de31cc19f None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:30.465621 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fe7fb-d465-479d-85a0-9b6de31cc19f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:30.479354 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8fe7fb-d465-479d-85a0-9b6de31cc19f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:30.482020 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8fe7fb-d465-479d-85a0-9b6de31cc19f None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:30.504326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-8e8fe7fb-d465-479d-85a0-9b6de31cc19f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:30.504326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:30.504326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:30.504326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:30.504326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:30.504326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:30.504326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:30.504326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:30.504326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:30.504326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:30.504326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:30.504326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:30.504326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:07:30.504326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:07:30.504326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:07:30.505317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:07:30.505317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:30.505317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:30.505317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:30.505317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:30.505317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:30.505317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:30.505317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:30.505317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:30.505317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:30.505317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:30.505317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:30.505317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:30.505317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:30.505317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:30.505317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:30.505317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:30.506362 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:07:30.506362 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:07:30.506362 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:07:30.506362 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:07:30.506362 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:07:30.506362 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:07:30.506362 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:30.506362 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:30.507367 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 462/905] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:07:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:07:30.516318 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb42f01-3e2e-4acd-8bb2-bcf6e0ccfa29 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:30.702548 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb42f01-3e2e-4acd-8bb2-bcf6e0ccfa29 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:30.772682 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3641bf5-b1ae-454d-a84d-fc3ee4b8073d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:30.773821 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3641bf5-b1ae-454d-a84d-fc3ee4b8073d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:30.774297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3641bf5-b1ae-454d-a84d-fc3ee4b8073d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:30.774834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3641bf5-b1ae-454d-a84d-fc3ee4b8073d None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:30.776295 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3641bf5-b1ae-454d-a84d-fc3ee4b8073d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:30.776895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3641bf5-b1ae-454d-a84d-fc3ee4b8073d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:30.779804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3641bf5-b1ae-454d-a84d-fc3ee4b8073d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:30.805130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 444/906] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:07:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:30.806253 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fe7fb-d465-479d-85a0-9b6de31cc19f None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:30.815813 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3641bf5-b1ae-454d-a84d-fc3ee4b8073d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:30.837956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:30.913047 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:30.962297 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fe7fb-d465-479d-85a0-9b6de31cc19f None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:31.026371 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657120cf-5c64-466b-b7bb-68ed05654c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:31.027124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657120cf-5c64-466b-b7bb-68ed05654c85 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:31.027424 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657120cf-5c64-466b-b7bb-68ed05654c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:31.027697 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657120cf-5c64-466b-b7bb-68ed05654c85 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:31.028344 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657120cf-5c64-466b-b7bb-68ed05654c85 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:31.030245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657120cf-5c64-466b-b7bb-68ed05654c85 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:31.042306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-657120cf-5c64-466b-b7bb-68ed05654c85 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 01:07:31.042306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:31.042306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:31.042306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:31.042306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:31.042306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:31.042306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:31.042306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:31.042306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 01:07:31.042306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:31.042306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:31.042306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:31.042306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:31.042306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:31.042306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:31.042306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:31.044119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:31.044119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:31.044119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:31.044119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:31.044119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:31.044119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:31.044119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:31.044119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:31.044119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:31.044119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:31.044119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:31.044119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:31.044119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:31.044119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:31.044119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:31.044119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:31.044119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:31.045844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:31.045844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:31.045844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:31.045844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:31.045844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:31.045844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:31.045844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:31.045844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:31.045844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:31.045844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:31.045844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:31.045844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:31.045844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 01:07:31.045844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:31.049739 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 463/907] 10.222.0.83 () {56 vars in 1132 bytes} [Fri Sep 23 01:07:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:31.050843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657120cf-5c64-466b-b7bb-68ed05654c85 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:31.075097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3641bf5-b1ae-454d-a84d-fc3ee4b8073d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:31.121232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554d22e-3ade-43e0-bc0d-30e4309c168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:31.121894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554d22e-3ade-43e0-bc0d-30e4309c168e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:31.122187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554d22e-3ade-43e0-bc0d-30e4309c168e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:31.122468 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554d22e-3ade-43e0-bc0d-30e4309c168e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:31.123530 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554d22e-3ade-43e0-bc0d-30e4309c168e None admin] RBAC: Adding query filter params (role.id=186fd04868e2437abf77f8ffdeec44a5, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=f2cea4c08f324769bf6dcea58c9394b3) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:31.123844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554d22e-3ade-43e0-bc0d-30e4309c168e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:31.125547 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554d22e-3ade-43e0-bc0d-30e4309c168e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:31.133174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 445/908] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:07:30 2022] GET /identity/v3/role_assignments?user.id=f2cea4c08f324769bf6dcea58c9394b3&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=186fd04868e2437abf77f8ffdeec44a5 => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:31.201498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657120cf-5c64-466b-b7bb-68ed05654c85 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:31.243206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:31.247886 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d75af-b568-43a9-aca6-0ef5e2b26bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:31.248529 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d75af-b568-43a9-aca6-0ef5e2b26bed None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:31.248789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d75af-b568-43a9-aca6-0ef5e2b26bed None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:31.249050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d75af-b568-43a9-aca6-0ef5e2b26bed None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:31.249702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d75af-b568-43a9-aca6-0ef5e2b26bed None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:31.250010 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d75af-b568-43a9-aca6-0ef5e2b26bed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:31.251663 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d75af-b568-43a9-aca6-0ef5e2b26bed None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:31.257733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 464/909] 10.222.0.83 () {56 vars in 1126 bytes} [Fri Sep 23 01:07:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:31.264648 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554d22e-3ade-43e0-bc0d-30e4309c168e None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:31.397055 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:31.438093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554d22e-3ade-43e0-bc0d-30e4309c168e None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:31.501122 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ca8f0-e007-46ee-83d2-02f8fff537a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:31.502258 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ca8f0-e007-46ee-83d2-02f8fff537a1 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:31.502752 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ca8f0-e007-46ee-83d2-02f8fff537a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:31.503227 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ca8f0-e007-46ee-83d2-02f8fff537a1 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:31.504439 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ca8f0-e007-46ee-83d2-02f8fff537a1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:31.504983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ca8f0-e007-46ee-83d2-02f8fff537a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:31.507557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ca8f0-e007-46ee-83d2-02f8fff537a1 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:31.517622 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 446/910] 10.222.0.83 () {56 vars in 1126 bytes} [Fri Sep 23 01:07:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:31.524926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d75af-b568-43a9-aca6-0ef5e2b26bed None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:31.600039 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563b23a-5f01-4273-83d0-204e84779d3c None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:31.600587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563b23a-5f01-4273-83d0-204e84779d3c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:31.601009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563b23a-5f01-4273-83d0-204e84779d3c None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:31.603870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 447/911] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:31.614671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1196e5-56b5-43fd-a2de-129d7603acc5 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:31.614980 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1196e5-56b5-43fd-a2de-129d7603acc5 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:31.615329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1196e5-56b5-43fd-a2de-129d7603acc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:31.636469 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-aa1196e5-56b5-43fd-a2de-129d7603acc5 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:31.637864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-aa1196e5-56b5-43fd-a2de-129d7603acc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:31.689254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d75af-b568-43a9-aca6-0ef5e2b26bed None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:31.759222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 448/912] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:31.771942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8b8d8-90ab-4dda-b9ca-fd3c9bbee9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:31.773335 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8b8d8-90ab-4dda-b9ca-fd3c9bbee9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:31.774046 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8b8d8-90ab-4dda-b9ca-fd3c9bbee9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:31.774783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8b8d8-90ab-4dda-b9ca-fd3c9bbee9a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:31.776461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8b8d8-90ab-4dda-b9ca-fd3c9bbee9a8 None admin] RBAC: Adding query filter params (interface=public, service_id=324868f233eb4a5f9ab85c9e4f6936c7, region_id=RegionOne) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:31.777301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8b8d8-90ab-4dda-b9ca-fd3c9bbee9a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:31.779571 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8b8d8-90ab-4dda-b9ca-fd3c9bbee9a8 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:31.791190 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 465/913] 10.222.0.83 () {56 vars in 1251 bytes} [Fri Sep 23 01:07:31 2022] GET /identity/v3/endpoints?service_id=324868f233eb4a5f9ab85c9e4f6936c7&interface=public®ion_id=RegionOne => generated 194 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:31.801050 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1196e5-56b5-43fd-a2de-129d7603acc5 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:31.928448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:31.986884 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1196e5-56b5-43fd-a2de-129d7603acc5 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:32.032669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07765e5d-6dd1-42ba-b680-ba2e99572fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:32.033697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07765e5d-6dd1-42ba-b680-ba2e99572fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:32.034145 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07765e5d-6dd1-42ba-b680-ba2e99572fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:32.034573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07765e5d-6dd1-42ba-b680-ba2e99572fb1 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:32.035383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07765e5d-6dd1-42ba-b680-ba2e99572fb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:32.037160 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07765e5d-6dd1-42ba-b680-ba2e99572fb1 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:32.045360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 449/914] 10.222.0.83 () {56 vars in 1087 bytes} [Fri Sep 23 01:07:31 2022] GET /identity/v3/services => generated 1497 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:07:32.253820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8b8d8-90ab-4dda-b9ca-fd3c9bbee9a8 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:32.336722 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:32.391288 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8b8d8-90ab-4dda-b9ca-fd3c9bbee9a8 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:32.434724 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee7295-4d44-46cc-b051-11d1c9d02f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:32.435835 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee7295-4d44-46cc-b051-11d1c9d02f01 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:32.436267 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee7295-4d44-46cc-b051-11d1c9d02f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:32.436719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee7295-4d44-46cc-b051-11d1c9d02f01 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:32.437462 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee7295-4d44-46cc-b051-11d1c9d02f01 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:32.439238 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee7295-4d44-46cc-b051-11d1c9d02f01 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:32.452894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-81ee7295-4d44-46cc-b051-11d1c9d02f01 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 01:07:32.452894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:32.452894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:32.452894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:32.452894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:32.452894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:32.452894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:32.452894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:32.452894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 01:07:32.452894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:32.452894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:32.452894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:32.452894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:32.452894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:32.452894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:32.452894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:32.452894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:32.454130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:32.454130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:32.454130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:32.454130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:32.454130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:32.454130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:32.454130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:32.454130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:32.454130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:32.454130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:32.454130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:32.454130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:32.454130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:32.454130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:32.454130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:32.454130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:32.455378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:32.455378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:32.455378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:32.455378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:32.455378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:32.455378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:32.455378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:32.455378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:32.455378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:32.455378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:32.455378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:32.455378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:32.455378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 01:07:32.455378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:32.459481 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 466/915] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:07:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:32.470092 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07765e5d-6dd1-42ba-b680-ba2e99572fb1 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:32.680375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07765e5d-6dd1-42ba-b680-ba2e99572fb1 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:32.743363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:32.753261 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819ce12-8816-45f0-a11b-f21b5ce364a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:32.754260 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819ce12-8816-45f0-a11b-f21b5ce364a6 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:32.754756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819ce12-8816-45f0-a11b-f21b5ce364a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:32.755219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819ce12-8816-45f0-a11b-f21b5ce364a6 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:32.756349 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819ce12-8816-45f0-a11b-f21b5ce364a6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:32.756858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819ce12-8816-45f0-a11b-f21b5ce364a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:32.759390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819ce12-8816-45f0-a11b-f21b5ce364a6 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:32.768814 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 450/916] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:07:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:32.778128 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee7295-4d44-46cc-b051-11d1c9d02f01 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:32.980222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee7295-4d44-46cc-b051-11d1c9d02f01 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:33.028888 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:33.048868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f617b16-2fd0-464d-b2cc-abee1eb3a371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:33.049927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f617b16-2fd0-464d-b2cc-abee1eb3a371 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:33.050402 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f617b16-2fd0-464d-b2cc-abee1eb3a371 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:33.050928 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f617b16-2fd0-464d-b2cc-abee1eb3a371 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:33.052073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f617b16-2fd0-464d-b2cc-abee1eb3a371 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:33.052610 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f617b16-2fd0-464d-b2cc-abee1eb3a371 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:33.055242 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f617b16-2fd0-464d-b2cc-abee1eb3a371 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:33.065314 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 467/917] 10.222.0.83 () {56 vars in 1114 bytes} [Fri Sep 23 01:07:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:33.072220 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819ce12-8816-45f0-a11b-f21b5ce364a6 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:33.202621 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819ce12-8816-45f0-a11b-f21b5ce364a6 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:33.249398 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f81bf9-42ed-4d7a-a329-90aa064a3975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:33.249943 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f81bf9-42ed-4d7a-a329-90aa064a3975 None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:33.250225 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f81bf9-42ed-4d7a-a329-90aa064a3975 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:33.250489 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f81bf9-42ed-4d7a-a329-90aa064a3975 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:33.251269 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f81bf9-42ed-4d7a-a329-90aa064a3975 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:33.253392 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f81bf9-42ed-4d7a-a329-90aa064a3975 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:33.361425 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 451/918] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:07:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:07:33.710630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc83eb-9186-4feb-a6c6-37481fb04728 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:33.710630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc83eb-9186-4feb-a6c6-37481fb04728 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:33.710630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc83eb-9186-4feb-a6c6-37481fb04728 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:33.713417 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 468/919] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:33.723365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee8976-8837-4a37-96aa-9c8343d6394e None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:33.724880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee8976-8837-4a37-96aa-9c8343d6394e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:33.725686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee8976-8837-4a37-96aa-9c8343d6394e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:33.758751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-b5ee8976-8837-4a37-96aa-9c8343d6394e None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:33.761620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b5ee8976-8837-4a37-96aa-9c8343d6394e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:33.839217 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:33.894531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 452/920] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 01:07:33.959411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48272bfe-6c02-4f42-be45-21ea93b6076f None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:33.960366 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48272bfe-6c02-4f42-be45-21ea93b6076f None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:33.961231 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48272bfe-6c02-4f42-be45-21ea93b6076f None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:33.966170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 469/921] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:33.973931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a44197-c363-4b15-98ae-bcbc22afcde6 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:33.974188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a44197-c363-4b15-98ae-bcbc22afcde6 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:33.974536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a44197-c363-4b15-98ae-bcbc22afcde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:33.997114 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-c9a44197-c363-4b15-98ae-bcbc22afcde6 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:33.998854 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-c9a44197-c363-4b15-98ae-bcbc22afcde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:34.121555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 453/922] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 01:07:34.227885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48272bfe-6c02-4f42-be45-21ea93b6076f None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:34.354420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48272bfe-6c02-4f42-be45-21ea93b6076f None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:34.397054 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0c288-8ddd-4fdc-8bdd-ac3827892cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:34.398336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0c288-8ddd-4fdc-8bdd-ac3827892cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:34.398793 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0c288-8ddd-4fdc-8bdd-ac3827892cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:34.399419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0c288-8ddd-4fdc-8bdd-ac3827892cc7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:34.400336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0c288-8ddd-4fdc-8bdd-ac3827892cc7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:34.401881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0c288-8ddd-4fdc-8bdd-ac3827892cc7 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:34.413336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-4af0c288-8ddd-4fdc-8bdd-ac3827892cc7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 01:07:34.413336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:34.413336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:34.413336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:34.413336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:34.413336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:34.413336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:34.413336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:34.413336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 01:07:34.413336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:34.413336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:34.413336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:34.413336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:34.413336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:34.413336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:34.413336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:34.413336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:34.414463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:34.414463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:34.414463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:34.414463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:34.414463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:34.414463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:34.414463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:34.414463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:34.414463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:34.414463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:34.414463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:34.414463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:34.414463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:34.414463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:34.414463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:34.414463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:34.415506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:34.415506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:34.415506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:34.415506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:34.415506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:34.415506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:34.415506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:34.415506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:34.415506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:34.415506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:34.415506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:34.415506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:34.415506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 01:07:34.415506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:34.416967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 470/923] 10.222.0.83 () {56 vars in 1126 bytes} [Fri Sep 23 01:07:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:07:34.424126 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a44197-c363-4b15-98ae-bcbc22afcde6 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:34.561197 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a44197-c363-4b15-98ae-bcbc22afcde6 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:34.577023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:34.633788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0c288-8ddd-4fdc-8bdd-ac3827892cc7 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:34.635405 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002a61f-ed5e-46b5-8c7b-cd8f2d718d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:34.636459 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002a61f-ed5e-46b5-8c7b-cd8f2d718d78 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:34.636953 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002a61f-ed5e-46b5-8c7b-cd8f2d718d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:34.637523 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002a61f-ed5e-46b5-8c7b-cd8f2d718d78 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:34.638803 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002a61f-ed5e-46b5-8c7b-cd8f2d718d78 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:34.639325 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002a61f-ed5e-46b5-8c7b-cd8f2d718d78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:34.642260 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002a61f-ed5e-46b5-8c7b-cd8f2d718d78 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:34.654775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 454/924] 10.222.0.83 () {56 vars in 1122 bytes} [Fri Sep 23 01:07:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:34.662140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002a61f-ed5e-46b5-8c7b-cd8f2d718d78 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:34.772995 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:34.811866 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002a61f-ed5e-46b5-8c7b-cd8f2d718d78 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:34.859515 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e9780-db0b-4c2f-a1cb-53cc3c77acdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:34.860578 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e9780-db0b-4c2f-a1cb-53cc3c77acdf None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:34.861061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e9780-db0b-4c2f-a1cb-53cc3c77acdf None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:34.861604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e9780-db0b-4c2f-a1cb-53cc3c77acdf None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:34.863283 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e9780-db0b-4c2f-a1cb-53cc3c77acdf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:34.863894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e9780-db0b-4c2f-a1cb-53cc3c77acdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:34.865648 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e9780-db0b-4c2f-a1cb-53cc3c77acdf None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:34.877308 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 455/925] 10.222.0.83 () {56 vars in 1122 bytes} [Fri Sep 23 01:07:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:34.878955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e9780-db0b-4c2f-a1cb-53cc3c77acdf None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:34.888349 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0c288-8ddd-4fdc-8bdd-ac3827892cc7 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:34.942300 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:34.966861 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbe8e3-165e-4b39-89e9-a56af629e363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:34.968436 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbe8e3-165e-4b39-89e9-a56af629e363 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:34.969372 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbe8e3-165e-4b39-89e9-a56af629e363 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:34.970185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbe8e3-165e-4b39-89e9-a56af629e363 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:34.996569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbe8e3-165e-4b39-89e9-a56af629e363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:07:35.009829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-8ecbe8e3-165e-4b39-89e9-a56af629e363 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 01:07:35.009829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:35.009829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:35.009829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:35.009829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:35.009829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:35.009829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:35.009829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:35.009829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:35.009829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:35.009829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:35.009829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:35.009829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:07:35.009829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:07:35.009829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:07:35.009829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:07:35.011831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:07:35.011831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:07:35.011831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:07:35.011831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:07:35.011831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:35.011831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:35.011831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:35.011831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:35.011831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:35.011831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:35.011831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:35.011831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:35.011831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:35.011831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:35.011831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:35.011831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:35.015880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:35.015880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:35.015880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:35.015880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:35.015880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:07:35.015880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:07:35.015880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:07:35.015880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:07:35.015880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:07:35.015880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:07:35.015880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 01:07:35.015880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:35.015880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 471/926] 10.222.0.83 () {56 vars in 1120 bytes} [Fri Sep 23 01:07:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:35.024591 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbe8e3-165e-4b39-89e9-a56af629e363 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:35.073430 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e9780-db0b-4c2f-a1cb-53cc3c77acdf None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:35.161622 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3871197-3cdd-4e1c-a16d-4ba61d7d21cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:35.163483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3871197-3cdd-4e1c-a16d-4ba61d7d21cf None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:35.164575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3871197-3cdd-4e1c-a16d-4ba61d7d21cf None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:35.165394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3871197-3cdd-4e1c-a16d-4ba61d7d21cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:35.167347 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3871197-3cdd-4e1c-a16d-4ba61d7d21cf None admin] RBAC: Adding query filter params (interface=public, service_id=3b043805194a4ab6abc35a0bbade0145, region_id=RegionOne) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:35.168486 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3871197-3cdd-4e1c-a16d-4ba61d7d21cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:35.171964 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3871197-3cdd-4e1c-a16d-4ba61d7d21cf None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:35.189106 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 456/927] 10.222.0.83 () {56 vars in 1251 bytes} [Fri Sep 23 01:07:34 2022] GET /identity/v3/endpoints?service_id=3b043805194a4ab6abc35a0bbade0145&interface=public®ion_id=RegionOne => generated 194 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:35.195772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3871197-3cdd-4e1c-a16d-4ba61d7d21cf None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:35.207511 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbe8e3-165e-4b39-89e9-a56af629e363 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:35.233546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:35.260594 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349a9f1-aa5a-41df-b9fc-ca8fe7842a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:35.261232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349a9f1-aa5a-41df-b9fc-ca8fe7842a61 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:35.261514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349a9f1-aa5a-41df-b9fc-ca8fe7842a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:35.261791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349a9f1-aa5a-41df-b9fc-ca8fe7842a61 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:35.262715 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349a9f1-aa5a-41df-b9fc-ca8fe7842a61 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:35.262914 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349a9f1-aa5a-41df-b9fc-ca8fe7842a61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:35.264366 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349a9f1-aa5a-41df-b9fc-ca8fe7842a61 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:35.283622 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 472/928] 10.222.0.83 () {56 vars in 1115 bytes} [Fri Sep 23 01:07:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:35.285595 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349a9f1-aa5a-41df-b9fc-ca8fe7842a61 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:35.402282 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:35.407112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3871197-3cdd-4e1c-a16d-4ba61d7d21cf None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:35.421363 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349a9f1-aa5a-41df-b9fc-ca8fe7842a61 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:35.456875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4da21a-3045-4db8-bfdb-5e031efef833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:35.457864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4da21a-3045-4db8-bfdb-5e031efef833 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:35.458346 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4da21a-3045-4db8-bfdb-5e031efef833 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:35.458883 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4da21a-3045-4db8-bfdb-5e031efef833 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:35.459637 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4da21a-3045-4db8-bfdb-5e031efef833 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:35.461280 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4da21a-3045-4db8-bfdb-5e031efef833 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:35.478161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 457/929] 10.222.0.83 () {56 vars in 1087 bytes} [Fri Sep 23 01:07:35 2022] GET /identity/v3/services => generated 1497 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:07:35.478161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec22de4-b342-4192-9963-624695bad783 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:35.478161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec22de4-b342-4192-9963-624695bad783 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:35.478161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec22de4-b342-4192-9963-624695bad783 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:35.478161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 458/930] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:35.480007 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b8263-4b48-4abd-b12c-7ddce534c835 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:35.480284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b8263-4b48-4abd-b12c-7ddce534c835 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:35.480559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b8263-4b48-4abd-b12c-7ddce534c835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:35.496143 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a522d-6542-4dbe-8717-15bb864a2210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:35.497320 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a522d-6542-4dbe-8717-15bb864a2210 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:35.497799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a522d-6542-4dbe-8717-15bb864a2210 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:35.498281 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a522d-6542-4dbe-8717-15bb864a2210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:35.505477 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-741b8263-4b48-4abd-b12c-7ddce534c835 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:35.507105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-741b8263-4b48-4abd-b12c-7ddce534c835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:35.519846 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a522d-6542-4dbe-8717-15bb864a2210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:35.522163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a522d-6542-4dbe-8717-15bb864a2210 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:35.548669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-f47a522d-6542-4dbe-8717-15bb864a2210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:35.548669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:35.548669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:35.548669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:35.548669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:35.548669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:35.548669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:35.548669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:35.548669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:35.548669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:35.548669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:35.548669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:35.548669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:35.548669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:35.548669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:35.548669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:35.557339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:35.557339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:35.557339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:35.557339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:35.557339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:35.557339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:35.557339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:35.557339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:35.557339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:35.557339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:35.557339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:35.557339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:35.557339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:35.557339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:35.557339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:35.557339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:35.557339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:35.559171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:35.559171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:35.559171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:35.559171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 473/931] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:35.566383 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a522d-6542-4dbe-8717-15bb864a2210 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:35.629100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:35.654761 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 459/932] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 01:07:35.747050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a522d-6542-4dbe-8717-15bb864a2210 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:35.804160 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9000a2-4ad6-424c-8465-91273c91d92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:35.805375 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9000a2-4ad6-424c-8465-91273c91d92d None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:35.806180 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9000a2-4ad6-424c-8465-91273c91d92d None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:35.806180 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9000a2-4ad6-424c-8465-91273c91d92d None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:35.807558 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9000a2-4ad6-424c-8465-91273c91d92d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:35.808059 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9000a2-4ad6-424c-8465-91273c91d92d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:35.810913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9000a2-4ad6-424c-8465-91273c91d92d None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:35.836197 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 474/933] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:35.847039 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b8263-4b48-4abd-b12c-7ddce534c835 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:36.047062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:36.063675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b8263-4b48-4abd-b12c-7ddce534c835 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:36.133811 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2501f-9bbb-416e-bbb5-2ff1fdb48622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:36.135071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2501f-9bbb-416e-bbb5-2ff1fdb48622 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:36.135562 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2501f-9bbb-416e-bbb5-2ff1fdb48622 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:36.136049 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2501f-9bbb-416e-bbb5-2ff1fdb48622 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:36.150664 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2501f-9bbb-416e-bbb5-2ff1fdb48622 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:36.153524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2501f-9bbb-416e-bbb5-2ff1fdb48622 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:36.162813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9000a2-4ad6-424c-8465-91273c91d92d None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:36.178268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-3aa2501f-9bbb-416e-bbb5-2ff1fdb48622 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 01:07:36.178268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:36.178268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:36.178268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:36.178268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:36.178268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:36.178268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:36.178268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:36.178268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:36.178268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:36.178268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:36.178268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:36.178268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:07:36.178268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:07:36.178268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:07:36.178268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:07:36.180010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:36.180010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:36.180010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:07:36.180010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:36.180010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:07:36.180010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:36.180010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:36.180010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:36.180010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:36.180010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:36.180010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:36.180010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:36.180010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:36.180010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:36.180010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:36.180010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:36.180010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:36.180010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:36.181785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:36.181785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:36.181785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:07:36.181785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:07:36.181785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:07:36.181785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:07:36.181785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:07:36.181785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:07:36.181785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 01:07:36.181785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:36.194800 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 460/934] 10.222.0.83 () {56 vars in 1117 bytes} [Fri Sep 23 01:07:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:36.197676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2501f-9bbb-416e-bbb5-2ff1fdb48622 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:36.356230 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:36.369363 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9000a2-4ad6-424c-8465-91273c91d92d None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:36.418131 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2501f-9bbb-416e-bbb5-2ff1fdb48622 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:36.455328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98078f-ebdb-48cd-961d-7ac33ecc9774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:36.457946 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98078f-ebdb-48cd-961d-7ac33ecc9774 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:36.458450 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98078f-ebdb-48cd-961d-7ac33ecc9774 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:36.459022 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98078f-ebdb-48cd-961d-7ac33ecc9774 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:36.460158 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98078f-ebdb-48cd-961d-7ac33ecc9774 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:36.463386 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98078f-ebdb-48cd-961d-7ac33ecc9774 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:36.480283 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5afa00-a62c-4b68-9d0a-95e5170ecfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:36.480766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-4b98078f-ebdb-48cd-961d-7ac33ecc9774 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 01:07:36.480766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:36.480766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:36.480766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:36.480766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:36.480766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:36.480766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:36.480766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:36.480766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 01:07:36.480766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:36.480766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:36.480766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:36.480766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:36.480766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:36.480766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:36.480766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:36.482532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:36.482532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:36.482532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:36.482532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:36.482532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:36.482532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:36.482532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:36.482532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:36.482532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:36.482532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:36.482532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:36.482532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:36.482532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:36.482532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:36.482532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:36.482532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:36.482532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:36.484747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:36.484747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:36.484747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:36.484747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:36.484747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:36.484747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:36.484747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:36.484747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:36.484747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:36.484747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:36.484747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:36.484747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:36.484747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 01:07:36.484747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:36.486161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5afa00-a62c-4b68-9d0a-95e5170ecfdc None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:36.486161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5afa00-a62c-4b68-9d0a-95e5170ecfdc None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:36.486161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5afa00-a62c-4b68-9d0a-95e5170ecfdc None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:36.486519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 475/935] 10.222.0.83 () {56 vars in 1132 bytes} [Fri Sep 23 01:07:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:36.486519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b5270-b7bd-4e87-af50-d779107465db None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:36.486519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b5270-b7bd-4e87-af50-d779107465db None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:36.486519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b5270-b7bd-4e87-af50-d779107465db None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:36.493959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 476/936] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:36.494255 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5afa00-a62c-4b68-9d0a-95e5170ecfdc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:36.494255 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5afa00-a62c-4b68-9d0a-95e5170ecfdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:36.495083 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b5270-b7bd-4e87-af50-d779107465db None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:36.495544 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5afa00-a62c-4b68-9d0a-95e5170ecfdc None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:36.517527 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 461/937] 10.222.0.83 () {56 vars in 1149 bytes} [Fri Sep 23 01:07:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:36.521598 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d8f15-01c8-4fb0-b0b4-013f137c6602 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:36.521598 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d8f15-01c8-4fb0-b0b4-013f137c6602 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:36.521961 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d8f15-01c8-4fb0-b0b4-013f137c6602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:36.548528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-021d8f15-01c8-4fb0-b0b4-013f137c6602 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:36.550679 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-021d8f15-01c8-4fb0-b0b4-013f137c6602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:36.556019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:36.660984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b5270-b7bd-4e87-af50-d779107465db None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:36.691457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 462/938] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:36.693601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d8f15-01c8-4fb0-b0b4-013f137c6602 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:36.726668 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c8916-fe87-48d6-8d3a-1b4400024d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:36.727777 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c8916-fe87-48d6-8d3a-1b4400024d59 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:36.728263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c8916-fe87-48d6-8d3a-1b4400024d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:36.728742 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c8916-fe87-48d6-8d3a-1b4400024d59 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:36.730306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c8916-fe87-48d6-8d3a-1b4400024d59 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:36.730872 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c8916-fe87-48d6-8d3a-1b4400024d59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:36.734513 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c8916-fe87-48d6-8d3a-1b4400024d59 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:36.754208 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 477/939] 10.222.0.83 () {56 vars in 1126 bytes} [Fri Sep 23 01:07:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:36.755908 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c8916-fe87-48d6-8d3a-1b4400024d59 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:36.792031 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:36.856970 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d8f15-01c8-4fb0-b0b4-013f137c6602 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:36.921974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a1d39-0359-4f69-9520-c09bc08ef964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:36.923241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a1d39-0359-4f69-9520-c09bc08ef964 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:36.924797 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a1d39-0359-4f69-9520-c09bc08ef964 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:36.924990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a1d39-0359-4f69-9520-c09bc08ef964 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:36.943487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:36.951412 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a1d39-0359-4f69-9520-c09bc08ef964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:36.954836 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a1d39-0359-4f69-9520-c09bc08ef964 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:36.961305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c8916-fe87-48d6-8d3a-1b4400024d59 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:36.986190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-a09a1d39-0359-4f69-9520-c09bc08ef964 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:36.986190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:36.986190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:36.986190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:36.986190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:36.986190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:36.986190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:36.986190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:36.986190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:36.986190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:36.986190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:36.986190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:36.986190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:36.986190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:36.986190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:36.986190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:36.989018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:36.989018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:36.989018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:36.989018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:36.989018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:36.989018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:36.989018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:36.989018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:36.989018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:36.989018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:36.989018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:36.989018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:36.989018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:36.989018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:36.989018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:36.989018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:36.989018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:36.991476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:36.991476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:36.991476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:36.996328 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 463/940] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:36.999721 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a1d39-0359-4f69-9520-c09bc08ef964 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:37.038822 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aae3d-9ce9-4f5c-ad68-fc4d505889a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:37.040225 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aae3d-9ce9-4f5c-ad68-fc4d505889a6 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:37.040922 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aae3d-9ce9-4f5c-ad68-fc4d505889a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:37.041646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aae3d-9ce9-4f5c-ad68-fc4d505889a6 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:37.043411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4aae3d-9ce9-4f5c-ad68-fc4d505889a6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:37.044597 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4aae3d-9ce9-4f5c-ad68-fc4d505889a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:37.047953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4aae3d-9ce9-4f5c-ad68-fc4d505889a6 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:37.058127 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 478/941] 10.222.0.83 () {56 vars in 1126 bytes} [Fri Sep 23 01:07:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:37.066205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aae3d-9ce9-4f5c-ad68-fc4d505889a6 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:37.200545 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a1d39-0359-4f69-9520-c09bc08ef964 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:37.228725 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:37.270761 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b2dc7-7565-406f-ad61-bb92ea0e6367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:37.271027 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aae3d-9ce9-4f5c-ad68-fc4d505889a6 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:37.271838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b2dc7-7565-406f-ad61-bb92ea0e6367 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:37.272333 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b2dc7-7565-406f-ad61-bb92ea0e6367 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:37.272793 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b2dc7-7565-406f-ad61-bb92ea0e6367 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:37.274017 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b2dc7-7565-406f-ad61-bb92ea0e6367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:37.274513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b2dc7-7565-406f-ad61-bb92ea0e6367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:37.277247 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b2dc7-7565-406f-ad61-bb92ea0e6367 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:37.308901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 464/942] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:37.308901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b2dc7-7565-406f-ad61-bb92ea0e6367 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:37.347488 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae88d0-214b-4c19-b10e-14732002dd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:37.348503 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae88d0-214b-4c19-b10e-14732002dd9f None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:37.348986 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae88d0-214b-4c19-b10e-14732002dd9f None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:37.349456 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae88d0-214b-4c19-b10e-14732002dd9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:37.350736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae88d0-214b-4c19-b10e-14732002dd9f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:37.354133 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae88d0-214b-4c19-b10e-14732002dd9f None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:37.412972 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:37.481143 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 479/943] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:07:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:07:37.482747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae88d0-214b-4c19-b10e-14732002dd9f None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:37.513861 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b2dc7-7565-406f-ad61-bb92ea0e6367 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:37.588237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c569f5b-4454-405b-aef1-c6e6cfc62adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:37.589143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c569f5b-4454-405b-aef1-c6e6cfc62adb None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:37.589551 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c569f5b-4454-405b-aef1-c6e6cfc62adb None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:37.589945 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c569f5b-4454-405b-aef1-c6e6cfc62adb None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:37.590995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c569f5b-4454-405b-aef1-c6e6cfc62adb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:37.593380 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c569f5b-4454-405b-aef1-c6e6cfc62adb None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:37.598624 dv-cinder-849143-7-smb devstack@keystone.service[81924]: WARNING keystone.server.flask.common [None req-6c569f5b-4454-405b-aef1-c6e6cfc62adb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 23 01:07:37.662553 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.sql.core [None req-6c569f5b-4454-405b-aef1-c6e6cfc62adb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 23 01:07:37.662553 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 23 01:07:37.662553 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [parameters: {'id': '71eba067e59f48d59dbca80f9bc3feee', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 23 01:07:37.662553 dv-cinder-849143-7-smb devstack@keystone.service[81924]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81924) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 23 01:07:37.693889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-6c569f5b-4454-405b-aef1-c6e6cfc62adb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 71eba067e59f48d59dbca80f9bc3feee.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 71eba067e59f48d59dbca80f9bc3feee. Sep 23 01:07:37.693889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:37.693889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 01:07:37.693889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 01:07:37.693889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 01:07:37.693889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 01:07:37.693889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 01:07:37.693889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 01:07:37.693889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 01:07:37.693889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application conn.query(q) Sep 23 01:07:37.693889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 01:07:37.693889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 01:07:37.693889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 01:07:37.695729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application result.read() Sep 23 01:07:37.695729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 01:07:37.695729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 01:07:37.695729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 01:07:37.695729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 01:07:37.695729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 01:07:37.695729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 01:07:37.695729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 01:07:37.695729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 01:07:37.695729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 23 01:07:37.695729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:37.695729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 23 01:07:37.695729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:37.695729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:37.695729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 23 01:07:37.695729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 23 01:07:37.695729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 23 01:07:37.695729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 23 01:07:37.704434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 01:07:37.704434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application next(self.gen) Sep 23 01:07:37.704434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 23 01:07:37.704434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application yield resource Sep 23 01:07:37.704434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 01:07:37.704434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application next(self.gen) Sep 23 01:07:37.704434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 23 01:07:37.704434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self.session.rollback() Sep 23 01:07:37.704434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 01:07:37.704434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self.force_reraise() Sep 23 01:07:37.704434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 01:07:37.704434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise self.value Sep 23 01:07:37.704434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 23 01:07:37.704434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 23 01:07:37.704434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 23 01:07:37.704434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application session.commit() Sep 23 01:07:37.704434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 23 01:07:37.706967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 23 01:07:37.706967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 23 01:07:37.706967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._prepare_impl() Sep 23 01:07:37.706967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 23 01:07:37.706967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self.session.flush() Sep 23 01:07:37.706967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 23 01:07:37.706967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._flush(objects) Sep 23 01:07:37.706967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 23 01:07:37.706967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 23 01:07:37.706967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 23 01:07:37.706967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application compat.raise_( Sep 23 01:07:37.706967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 01:07:37.706967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception Sep 23 01:07:37.706967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 23 01:07:37.706967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application flush_context.execute() Sep 23 01:07:37.706967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 23 01:07:37.706967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rec.execute(self) Sep 23 01:07:37.708746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 23 01:07:37.708746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 23 01:07:37.708746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 23 01:07:37.708746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 23 01:07:37.708746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 23 01:07:37.708746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 23 01:07:37.708746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 23 01:07:37.708746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 23 01:07:37.708746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 23 01:07:37.708746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 23 01:07:37.708746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 23 01:07:37.708746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 23 01:07:37.708746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 23 01:07:37.708746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 23 01:07:37.708746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 23 01:07:37.710362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 23 01:07:37.710362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 01:07:37.710362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception Sep 23 01:07:37.710362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 01:07:37.710362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 01:07:37.710362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 01:07:37.710362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 01:07:37.710362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 01:07:37.710362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 01:07:37.710362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 01:07:37.710362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application conn.query(q) Sep 23 01:07:37.710362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 01:07:37.710362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 01:07:37.710362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 01:07:37.710362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application result.read() Sep 23 01:07:37.710362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 01:07:37.710362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 01:07:37.712061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 01:07:37.712061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 01:07:37.712061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 01:07:37.712061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 01:07:37.712061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 01:07:37.712061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 01:07:37.712061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 23 01:07:37.712061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 23 01:07:37.712061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [parameters: {'id': '71eba067e59f48d59dbca80f9bc3feee', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 23 01:07:37.712061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 23 01:07:37.712061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:37.712061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:37.712061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:37.712061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:37.712061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 23 01:07:37.713993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 23 01:07:37.713993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 23 01:07:37.713993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 23 01:07:37.713993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 23 01:07:37.713993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:37.713993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:37.713993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:37.713993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:37.713993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:37.713993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:37.713993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:37.713993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:37.713993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:37.713993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:37.713993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:37.713993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:37.713993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:37.717370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:37.717370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 23 01:07:37.717370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 23 01:07:37.717370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:37.717370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:37.717370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 23 01:07:37.717370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 23 01:07:37.717370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 71eba067e59f48d59dbca80f9bc3feee. Sep 23 01:07:37.717370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:37.717370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 465/944] 10.222.0.83 () {60 vars in 1140 bytes} [Fri Sep 23 01:07:37 2022] POST /identity/v3/projects => generated 262 bytes in 394 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:37.717370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c569f5b-4454-405b-aef1-c6e6cfc62adb None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:37.756678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae88d0-214b-4c19-b10e-14732002dd9f None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:37.817052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fa475-2e12-4967-a7a3-d275dc88a5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:37.818749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fa475-2e12-4967-a7a3-d275dc88a5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:37.819559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fa475-2e12-4967-a7a3-d275dc88a5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:37.820121 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fa475-2e12-4967-a7a3-d275dc88a5b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:37.823878 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:37.833597 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fa475-2e12-4967-a7a3-d275dc88a5b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:37.838077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fa475-2e12-4967-a7a3-d275dc88a5b6 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:37.859006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-c31fa475-2e12-4967-a7a3-d275dc88a5b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:37.859006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:37.859006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:37.859006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:37.859006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:37.859006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:37.859006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:37.859006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:37.859006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:37.859006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:37.859006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:37.859006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:37.859006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:07:37.859006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:07:37.859006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:07:37.860284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:07:37.860284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:37.860284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:37.860284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:37.860284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:37.860284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:37.860284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:37.860284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:37.860284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:37.860284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:37.860284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:37.860284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:37.860284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:37.860284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:37.860284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:37.860284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:37.860284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:37.861387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:07:37.861387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:07:37.861387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:07:37.861387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:07:37.861387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:07:37.861387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:07:37.861387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:37.861387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:37.861387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 480/945] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:07:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:37.870683 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fa475-2e12-4967-a7a3-d275dc88a5b6 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:37.933516 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c569f5b-4454-405b-aef1-c6e6cfc62adb None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:37.948502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:38.014576 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ad247-f9e4-44e3-b427-680282f875c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:38.015725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ad247-f9e4-44e3-b427-680282f875c3 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:38.016333 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ad247-f9e4-44e3-b427-680282f875c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:38.016928 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ad247-f9e4-44e3-b427-680282f875c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:38.032457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ad247-f9e4-44e3-b427-680282f875c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:38.036501 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ad247-f9e4-44e3-b427-680282f875c3 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:38.071090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-cf2ad247-f9e4-44e3-b427-680282f875c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:38.071090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:38.071090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:38.071090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:38.071090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:38.071090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:38.071090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:38.071090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:38.071090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:38.071090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:38.071090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:38.071090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:38.071090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:07:38.071090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:07:38.071090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:07:38.073700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:07:38.073700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:38.073700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:38.073700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:38.073700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:38.073700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:38.073700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:38.073700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:38.073700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:38.073700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:38.073700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:38.073700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:38.073700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:38.073700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:38.073700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:38.073700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:38.073700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:38.076596 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:07:38.076596 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:07:38.076596 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:07:38.076596 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:07:38.076596 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:07:38.076596 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:07:38.076596 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:38.076596 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:38.077589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fa475-2e12-4967-a7a3-d275dc88a5b6 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:38.086294 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 466/946] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:07:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:38.091712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ad247-f9e4-44e3-b427-680282f875c3 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:38.128155 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7bea8-1f61-4bc0-9152-14daf63058af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:38.139762 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7bea8-1f61-4bc0-9152-14daf63058af None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:38.139762 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7bea8-1f61-4bc0-9152-14daf63058af None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:38.139762 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7bea8-1f61-4bc0-9152-14daf63058af None admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:38.139762 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7bea8-1f61-4bc0-9152-14daf63058af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:38.139762 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7bea8-1f61-4bc0-9152-14daf63058af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:38.139762 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7bea8-1f61-4bc0-9152-14daf63058af None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:38.159742 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 481/947] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:07:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:38.170360 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7bea8-1f61-4bc0-9152-14daf63058af None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:38.290428 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:38.308010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ad247-f9e4-44e3-b427-680282f875c3 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:38.370138 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7bea8-1f61-4bc0-9152-14daf63058af None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:38.379628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6349beb-03fe-4e99-827c-c215aa4b64cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:38.380851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6349beb-03fe-4e99-827c-c215aa4b64cf None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:38.383032 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6349beb-03fe-4e99-827c-c215aa4b64cf None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:38.384002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6349beb-03fe-4e99-827c-c215aa4b64cf None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:38.386664 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6349beb-03fe-4e99-827c-c215aa4b64cf None admin] RBAC: Adding query filter params (name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:38.388378 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6349beb-03fe-4e99-827c-c215aa4b64cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:38.391118 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6349beb-03fe-4e99-827c-c215aa4b64cf None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:38.427210 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 467/948] 10.222.0.83 () {56 vars in 1112 bytes} [Fri Sep 23 01:07:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:38.445725 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e8e72-2545-481c-88a6-22fdbfe5377c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:38.447368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e8e72-2545-481c-88a6-22fdbfe5377c None admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:38.448076 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e8e72-2545-481c-88a6-22fdbfe5377c None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:38.448683 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e8e72-2545-481c-88a6-22fdbfe5377c None admin] PATH_INFO: `/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/f2cea4c08f324769bf6dcea58c9394b3/roles/186fd04868e2437abf77f8ffdeec44a5` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:38.452116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e8e72-2545-481c-88a6-22fdbfe5377c None admin] RBAC: Authorizing `identity:create_grant(project_id=78d0895fea004a02b1d8338f5fb0250c, user_id=f2cea4c08f324769bf6dcea58c9394b3, role_id=186fd04868e2437abf77f8ffdeec44a5)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:38.454746 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e8e72-2545-481c-88a6-22fdbfe5377c None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:38.596957 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 482/949] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:07:38 2022] PUT /identity/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/f2cea4c08f324769bf6dcea58c9394b3/roles/186fd04868e2437abf77f8ffdeec44a5 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:07:39.106189 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462842b5-de58-4771-9564-af2e91404832 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:39.107009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462842b5-de58-4771-9564-af2e91404832 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:39.107177 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462842b5-de58-4771-9564-af2e91404832 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:39.110186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 468/950] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:39.119835 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b29d76-7bdc-4cda-a10e-b5f60ee2b4f8 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:39.120665 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b29d76-7bdc-4cda-a10e-b5f60ee2b4f8 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:39.120799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b29d76-7bdc-4cda-a10e-b5f60ee2b4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:39.153377 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-c9b29d76-7bdc-4cda-a10e-b5f60ee2b4f8 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:39.155404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-c9b29d76-7bdc-4cda-a10e-b5f60ee2b4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:39.276048 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 483/951] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:39.576548 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462842b5-de58-4771-9564-af2e91404832 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:39.609509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:39.734032 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462842b5-de58-4771-9564-af2e91404832 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:39.777148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1000d-11c4-45c9-8ac4-c99e54e92c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:39.778165 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1000d-11c4-45c9-8ac4-c99e54e92c3d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:39.778686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1000d-11c4-45c9-8ac4-c99e54e92c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:39.779167 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1000d-11c4-45c9-8ac4-c99e54e92c3d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:39.779944 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1000d-11c4-45c9-8ac4-c99e54e92c3d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:39.781657 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1000d-11c4-45c9-8ac4-c99e54e92c3d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:39.796628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-7da1000d-11c4-45c9-8ac4-c99e54e92c3d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 01:07:39.796628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:39.796628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:39.796628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:39.796628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:39.796628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:39.796628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:39.796628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:39.796628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 01:07:39.796628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:39.796628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:39.796628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:39.796628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:39.796628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:39.796628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:39.796628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:39.796628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:39.797799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:39.797799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:39.797799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:39.797799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:39.797799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:39.797799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:39.797799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:39.797799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:39.797799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:39.797799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:39.797799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:39.797799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:39.797799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:39.797799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:39.797799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:39.797799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:39.799723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:39.799723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:39.799723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:39.799723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:39.799723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:39.799723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:39.799723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:39.799723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:39.799723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:39.799723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:39.799723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:39.799723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:39.799723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 01:07:39.799723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:39.803931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 469/952] 10.222.0.83 () {56 vars in 1126 bytes} [Fri Sep 23 01:07:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:39.814493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b29d76-7bdc-4cda-a10e-b5f60ee2b4f8 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:39.905067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:39.997098 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b29d76-7bdc-4cda-a10e-b5f60ee2b4f8 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:40.068455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7bc81-8e75-4baf-9cf6-256ff72c8f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:40.069489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7bc81-8e75-4baf-9cf6-256ff72c8f69 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:40.069987 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7bc81-8e75-4baf-9cf6-256ff72c8f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:40.070475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7bc81-8e75-4baf-9cf6-256ff72c8f69 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:40.071681 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7bc81-8e75-4baf-9cf6-256ff72c8f69 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:40.072482 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7bc81-8e75-4baf-9cf6-256ff72c8f69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:40.074813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7bc81-8e75-4baf-9cf6-256ff72c8f69 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:40.084914 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 484/953] 10.222.0.83 () {56 vars in 1122 bytes} [Fri Sep 23 01:07:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:40.090807 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1000d-11c4-45c9-8ac4-c99e54e92c3d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:40.209783 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:40.223556 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1000d-11c4-45c9-8ac4-c99e54e92c3d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:40.269405 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f3acc-36c7-4aee-b1a9-4021f0362636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:40.270037 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f3acc-36c7-4aee-b1a9-4021f0362636 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:40.270314 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f3acc-36c7-4aee-b1a9-4021f0362636 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:40.270626 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f3acc-36c7-4aee-b1a9-4021f0362636 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:40.271273 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f3acc-36c7-4aee-b1a9-4021f0362636 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:40.271572 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f3acc-36c7-4aee-b1a9-4021f0362636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:40.272985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f3acc-36c7-4aee-b1a9-4021f0362636 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:40.279943 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 470/954] 10.222.0.83 () {56 vars in 1122 bytes} [Fri Sep 23 01:07:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:40.286277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7bc81-8e75-4baf-9cf6-256ff72c8f69 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:40.435209 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7bc81-8e75-4baf-9cf6-256ff72c8f69 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:40.447418 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:40.489972 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593faef3-010c-49f6-b8e0-e6caeebb5e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:40.490558 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593faef3-010c-49f6-b8e0-e6caeebb5e39 None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:40.491040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593faef3-010c-49f6-b8e0-e6caeebb5e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:40.491325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593faef3-010c-49f6-b8e0-e6caeebb5e39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:40.492497 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593faef3-010c-49f6-b8e0-e6caeebb5e39 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:40.494348 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593faef3-010c-49f6-b8e0-e6caeebb5e39 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:40.593160 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b960af-b170-4447-a8f1-9555d9a449b4 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:40.593489 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b960af-b170-4447-a8f1-9555d9a449b4 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:40.593921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b960af-b170-4447-a8f1-9555d9a449b4 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:40.595424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 471/955] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:40.602000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcda68-77a2-4ca2-aae2-ef5996b2f9d2 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:40.602283 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcda68-77a2-4ca2-aae2-ef5996b2f9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:40.602672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcda68-77a2-4ca2-aae2-ef5996b2f9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:40.610856 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 485/956] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:07:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:07:40.642085 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-f9fcda68-77a2-4ca2-aae2-ef5996b2f9d2 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:40.646398 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f9fcda68-77a2-4ca2-aae2-ef5996b2f9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:40.805146 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 472/957] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 01:07:41.221059 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593faef3-010c-49f6-b8e0-e6caeebb5e39 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:41.432535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593faef3-010c-49f6-b8e0-e6caeebb5e39 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:41.501869 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88375c1-845e-4578-b2df-e19d02481aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:41.503602 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88375c1-845e-4578-b2df-e19d02481aca None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:41.504175 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88375c1-845e-4578-b2df-e19d02481aca None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:41.504742 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88375c1-845e-4578-b2df-e19d02481aca None admin] PATH_INFO: `/v3/services/compute` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:41.505891 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88375c1-845e-4578-b2df-e19d02481aca None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:41.508640 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88375c1-845e-4578-b2df-e19d02481aca None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:41.527534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-f88375c1-845e-4578-b2df-e19d02481aca None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 01:07:41.527534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:41.527534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:41.527534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:41.527534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:41.527534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:41.527534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:41.527534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:41.527534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 01:07:41.527534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:41.527534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:41.527534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:41.527534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:41.527534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:41.527534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:41.527534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:41.527534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:41.528816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:41.528816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:41.528816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:41.528816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:41.528816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:41.528816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:41.528816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:41.528816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:41.528816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:41.528816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:41.528816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:41.528816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:41.528816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:41.528816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:41.528816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:41.528816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:41.530478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:41.530478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:41.530478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:41.530478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:41.530478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:41.530478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:41.530478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:41.530478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:41.530478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:41.530478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:41.530478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:41.530478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:41.530478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 01:07:41.530478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:41.530478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 486/958] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:07:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:41.537175 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcda68-77a2-4ca2-aae2-ef5996b2f9d2 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:41.659909 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:41.703613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcda68-77a2-4ca2-aae2-ef5996b2f9d2 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:41.757091 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291c30e-f45e-4b57-9baf-27df9ab255af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:41.757731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291c30e-f45e-4b57-9baf-27df9ab255af None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:41.758161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291c30e-f45e-4b57-9baf-27df9ab255af None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:41.758450 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291c30e-f45e-4b57-9baf-27df9ab255af None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:41.759194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291c30e-f45e-4b57-9baf-27df9ab255af None admin] RBAC: Adding query filter params (name=compute) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:41.759497 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291c30e-f45e-4b57-9baf-27df9ab255af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:41.761140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291c30e-f45e-4b57-9baf-27df9ab255af None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:41.768237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 473/959] 10.222.0.83 () {56 vars in 1112 bytes} [Fri Sep 23 01:07:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:41.775460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88375c1-845e-4578-b2df-e19d02481aca None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:41.832383 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:41.970833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3ecd8-d194-4ffd-b150-8cf56c4c8e33 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:41.970833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3ecd8-d194-4ffd-b150-8cf56c4c8e33 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:41.970833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3ecd8-d194-4ffd-b150-8cf56c4c8e33 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:41.972193 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 474/960] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:41.986648 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3947742-f370-4f73-891f-129a4396ae73 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:41.986648 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3947742-f370-4f73-891f-129a4396ae73 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:41.986648 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3947742-f370-4f73-891f-129a4396ae73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:41.987662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88375c1-845e-4578-b2df-e19d02481aca None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:42.020988 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-a3947742-f370-4f73-891f-129a4396ae73 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:42.023017 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a3947742-f370-4f73-891f-129a4396ae73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:42.055563 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38ca4b-69bb-41bd-86b7-03499ffebf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:42.056471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38ca4b-69bb-41bd-86b7-03499ffebf91 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:42.056935 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38ca4b-69bb-41bd-86b7-03499ffebf91 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:42.057382 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38ca4b-69bb-41bd-86b7-03499ffebf91 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:42.058445 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38ca4b-69bb-41bd-86b7-03499ffebf91 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:42.059014 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38ca4b-69bb-41bd-86b7-03499ffebf91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:42.061825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38ca4b-69bb-41bd-86b7-03499ffebf91 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:42.072487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 487/961] 10.222.0.83 () {56 vars in 1112 bytes} [Fri Sep 23 01:07:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:42.173254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 475/962] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:42.237424 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4f07e-870e-4044-8683-5027f8e6bda3 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:42.237947 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4f07e-870e-4044-8683-5027f8e6bda3 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:42.238446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4f07e-870e-4044-8683-5027f8e6bda3 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:42.241557 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 488/963] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:42.251200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadc750-b6db-43e3-a53f-14fdc711f2fb None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:42.251714 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadc750-b6db-43e3-a53f-14fdc711f2fb None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:42.252226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadc750-b6db-43e3-a53f-14fdc711f2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:42.297033 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-3dadc750-b6db-43e3-a53f-14fdc711f2fb None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:42.298947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-3dadc750-b6db-43e3-a53f-14fdc711f2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:42.427449 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 476/964] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:42.613520 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4f07e-870e-4044-8683-5027f8e6bda3 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:42.796765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:42.816061 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4f07e-870e-4044-8683-5027f8e6bda3 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:42.883309 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8b71d-5dfd-43b7-8296-3f9f6a6e2f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:42.884329 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8b71d-5dfd-43b7-8296-3f9f6a6e2f62 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:42.884905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8b71d-5dfd-43b7-8296-3f9f6a6e2f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:42.885391 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8b71d-5dfd-43b7-8296-3f9f6a6e2f62 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:42.906971 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8b71d-5dfd-43b7-8296-3f9f6a6e2f62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:07:42.917568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-68b8b71d-5dfd-43b7-8296-3f9f6a6e2f62 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 01:07:42.917568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:42.917568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:42.917568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:42.917568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:42.917568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:42.917568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:42.917568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:42.917568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:42.917568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:42.917568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:42.917568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:42.917568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:07:42.917568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:07:42.917568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:07:42.917568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:07:42.918626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:07:42.918626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:07:42.918626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:07:42.918626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:07:42.918626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:42.918626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:42.918626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:42.918626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:42.918626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:42.918626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:42.918626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:42.918626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:42.918626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:42.918626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:42.918626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:42.918626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:42.919486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:42.919486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:42.919486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:42.919486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:42.919486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:07:42.919486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:07:42.919486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:07:42.919486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:07:42.919486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:07:42.919486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:07:42.919486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 01:07:42.919486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:42.920744 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 489/965] 10.222.0.83 () {56 vars in 1120 bytes} [Fri Sep 23 01:07:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:07:42.927248 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadc750-b6db-43e3-a53f-14fdc711f2fb None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:42.931916 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:42.957768 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8b71d-5dfd-43b7-8296-3f9f6a6e2f62 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:43.122886 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8b71d-5dfd-43b7-8296-3f9f6a6e2f62 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:43.136756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadc750-b6db-43e3-a53f-14fdc711f2fb None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:43.173443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd839f5e-b64b-41c2-9002-e1e4eb15af3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:43.174439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd839f5e-b64b-41c2-9002-e1e4eb15af3b None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:43.174898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd839f5e-b64b-41c2-9002-e1e4eb15af3b None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:43.175338 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd839f5e-b64b-41c2-9002-e1e4eb15af3b None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:43.176132 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd839f5e-b64b-41c2-9002-e1e4eb15af3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:43.177899 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd839f5e-b64b-41c2-9002-e1e4eb15af3b None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:43.181215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: WARNING keystone.server.flask.common [None req-dd839f5e-b64b-41c2-9002-e1e4eb15af3b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 23 01:07:43.203036 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcd238-3b2e-4851-b794-7ff2ef3f92f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:43.204046 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcd238-3b2e-4851-b794-7ff2ef3f92f8 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:43.208892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcd238-3b2e-4851-b794-7ff2ef3f92f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:43.208892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcd238-3b2e-4851-b794-7ff2ef3f92f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:43.208892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcd238-3b2e-4851-b794-7ff2ef3f92f8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:43.208892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcd238-3b2e-4851-b794-7ff2ef3f92f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:43.210022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcd238-3b2e-4851-b794-7ff2ef3f92f8 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:43.227235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 477/966] 10.222.0.83 () {56 vars in 1115 bytes} [Fri Sep 23 01:07:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:43.236395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcd238-3b2e-4851-b794-7ff2ef3f92f8 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:43.246206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.sql.core [None req-dd839f5e-b64b-41c2-9002-e1e4eb15af3b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 23 01:07:43.246206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 23 01:07:43.246206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [parameters: {'user_id': '2f5690bfd1c24f7b98e4641ee9f5e5a7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 23 01:07:43.246206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81923) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 23 01:07:43.265286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-dd839f5e-b64b-41c2-9002-e1e4eb15af3b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 23 01:07:43.265286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:43.265286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 01:07:43.265286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 01:07:43.265286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 01:07:43.265286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 01:07:43.265286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 01:07:43.265286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 01:07:43.265286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 01:07:43.265286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application conn.query(q) Sep 23 01:07:43.265286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 01:07:43.265286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 01:07:43.265286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 01:07:43.265286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application result.read() Sep 23 01:07:43.265286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 01:07:43.267050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 01:07:43.267050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 01:07:43.267050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 01:07:43.267050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 01:07:43.267050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 01:07:43.267050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 01:07:43.267050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 01:07:43.267050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 23 01:07:43.267050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:43.267050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 23 01:07:43.267050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:43.267050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:43.267050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 23 01:07:43.267050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 23 01:07:43.267050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 23 01:07:43.267050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 23 01:07:43.267050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 01:07:43.267050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application next(self.gen) Sep 23 01:07:43.269510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 23 01:07:43.269510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application yield resource Sep 23 01:07:43.269510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 01:07:43.269510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application next(self.gen) Sep 23 01:07:43.269510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 23 01:07:43.269510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self.session.rollback() Sep 23 01:07:43.269510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 01:07:43.269510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self.force_reraise() Sep 23 01:07:43.269510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 01:07:43.269510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise self.value Sep 23 01:07:43.269510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 23 01:07:43.269510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 23 01:07:43.269510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 23 01:07:43.269510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application session.commit() Sep 23 01:07:43.269510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 23 01:07:43.269510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 23 01:07:43.269510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 23 01:07:43.273156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._prepare_impl() Sep 23 01:07:43.273156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 23 01:07:43.273156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self.session.flush() Sep 23 01:07:43.273156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 23 01:07:43.273156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._flush(objects) Sep 23 01:07:43.273156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 23 01:07:43.273156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 23 01:07:43.273156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 23 01:07:43.273156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application compat.raise_( Sep 23 01:07:43.273156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 01:07:43.273156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception Sep 23 01:07:43.273156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 23 01:07:43.273156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application flush_context.execute() Sep 23 01:07:43.273156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 23 01:07:43.273156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rec.execute(self) Sep 23 01:07:43.273156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 23 01:07:43.273156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 23 01:07:43.277168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 23 01:07:43.277168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 23 01:07:43.277168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 23 01:07:43.277168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 23 01:07:43.277168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 23 01:07:43.277168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 23 01:07:43.277168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 23 01:07:43.277168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 23 01:07:43.277168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 23 01:07:43.277168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 23 01:07:43.277168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 23 01:07:43.277168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 23 01:07:43.277168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 23 01:07:43.277168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 23 01:07:43.277168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 01:07:43.277168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception Sep 23 01:07:43.282115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 01:07:43.282115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 01:07:43.282115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 01:07:43.282115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 01:07:43.282115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 01:07:43.282115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 01:07:43.282115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 01:07:43.282115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application conn.query(q) Sep 23 01:07:43.282115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 01:07:43.282115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 01:07:43.282115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 01:07:43.282115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application result.read() Sep 23 01:07:43.282115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 01:07:43.282115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 01:07:43.282115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 01:07:43.282115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 01:07:43.287055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 01:07:43.287055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 01:07:43.287055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 01:07:43.287055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 01:07:43.287055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 23 01:07:43.287055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 23 01:07:43.287055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [parameters: {'user_id': '2f5690bfd1c24f7b98e4641ee9f5e5a7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 23 01:07:43.287055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 23 01:07:43.287055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:43.287055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:43.287055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:43.287055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:43.287055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:43.287055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:43.287055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:43.289374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:43.289374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:43.289374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:43.289374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:43.289374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:43.289374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:43.289374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:43.289374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 23 01:07:43.289374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 23 01:07:43.289374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:43.289374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:43.289374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:07:43.289374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:43.289374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:07:43.289374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:43.289374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 23 01:07:43.289374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 23 01:07:43.292457 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 23 01:07:43.292457 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 23 01:07:43.292457 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 23 01:07:43.292457 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 23 01:07:43.292457 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 23 01:07:43.292457 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:43.292457 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 490/967] 10.222.0.83 () {60 vars in 1131 bytes} [Fri Sep 23 01:07:42 2022] POST /identity/v3/users => generated 160 bytes in 335 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:07:43.299909 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd839f5e-b64b-41c2-9002-e1e4eb15af3b None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:43.343424 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:43.372716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:43.457473 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcd238-3b2e-4851-b794-7ff2ef3f92f8 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:43.519035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3c4ba-66ed-4bea-b0ef-51e6434db15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:43.520530 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3c4ba-66ed-4bea-b0ef-51e6434db15b None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:43.521006 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3c4ba-66ed-4bea-b0ef-51e6434db15b None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:43.521432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3c4ba-66ed-4bea-b0ef-51e6434db15b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:43.536119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd839f5e-b64b-41c2-9002-e1e4eb15af3b None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:43.538678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3c4ba-66ed-4bea-b0ef-51e6434db15b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:43.542546 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3c4ba-66ed-4bea-b0ef-51e6434db15b None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:43.572518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-ace3c4ba-66ed-4bea-b0ef-51e6434db15b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:43.572518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:43.572518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:43.572518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:43.572518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:43.572518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:43.572518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:43.572518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:43.572518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:43.572518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:43.572518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:43.572518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:43.572518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:43.572518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:43.572518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:43.572518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:43.574365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:43.574365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:43.574365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:43.574365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:43.574365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:43.574365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:43.574365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:43.574365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:43.574365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:43.574365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:43.574365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:43.574365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:43.574365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:43.574365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:43.574365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:43.574365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:43.574365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:43.576730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:43.576730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:43.576730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:43.576730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 478/968] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:07:43.585542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3c4ba-66ed-4bea-b0ef-51e6434db15b None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:43.610069 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8d7c9-abc8-4944-8b89-721cfbd3815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:43.611155 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8d7c9-abc8-4944-8b89-721cfbd3815b None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:43.611613 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8d7c9-abc8-4944-8b89-721cfbd3815b None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:43.612676 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8d7c9-abc8-4944-8b89-721cfbd3815b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:43.624099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8d7c9-abc8-4944-8b89-721cfbd3815b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:43.626924 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8d7c9-abc8-4944-8b89-721cfbd3815b None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:43.646299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-a7f8d7c9-abc8-4944-8b89-721cfbd3815b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 01:07:43.646299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:43.646299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:43.646299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:43.646299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:43.646299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:43.646299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:43.646299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:43.646299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:43.646299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:43.646299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:43.646299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:43.646299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:07:43.646299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:07:43.646299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:07:43.646299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:07:43.647507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:43.647507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:43.647507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:07:43.647507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:43.647507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:07:43.647507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:43.647507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:43.647507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:43.647507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:43.647507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:43.647507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:43.647507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:43.647507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:43.647507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:43.647507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:43.647507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:43.647507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:43.647507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:43.648539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:43.648539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:43.648539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:07:43.648539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:07:43.648539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:07:43.648539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:07:43.648539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:07:43.648539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:07:43.648539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 01:07:43.648539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:43.657279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 491/969] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:07:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:43.661205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8d7c9-abc8-4944-8b89-721cfbd3815b None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:43.772363 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:43.792777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3c4ba-66ed-4bea-b0ef-51e6434db15b None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:43.807481 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8d7c9-abc8-4944-8b89-721cfbd3815b None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:43.834431 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:43.885493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a20c9-8a65-403f-9f01-0d1c4994d851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:43.885493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a20c9-8a65-403f-9f01-0d1c4994d851 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:43.885493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a20c9-8a65-403f-9f01-0d1c4994d851 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:43.885493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a20c9-8a65-403f-9f01-0d1c4994d851 None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:43.886177 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a20c9-8a65-403f-9f01-0d1c4994d851 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:43.886320 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a20c9-8a65-403f-9f01-0d1c4994d851 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:43.888147 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a20c9-8a65-403f-9f01-0d1c4994d851 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:43.894949 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85d2f5-3ed2-40e2-93d7-80685b931b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:43.896656 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85d2f5-3ed2-40e2-93d7-80685b931b8a None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:43.897537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85d2f5-3ed2-40e2-93d7-80685b931b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:43.898363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85d2f5-3ed2-40e2-93d7-80685b931b8a None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:43.900205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85d2f5-3ed2-40e2-93d7-80685b931b8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:43.901175 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85d2f5-3ed2-40e2-93d7-80685b931b8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:43.904420 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85d2f5-3ed2-40e2-93d7-80685b931b8a None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:43.934101 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 479/970] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:43.947963 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85d2f5-3ed2-40e2-93d7-80685b931b8a None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:43.986986 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 492/971] 10.222.0.83 () {56 vars in 1101 bytes} [Fri Sep 23 01:07:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:44.068497 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca25c2b-7d65-45e6-a41f-b870780dbb69 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:44.069081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca25c2b-7d65-45e6-a41f-b870780dbb69 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:44.069384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca25c2b-7d65-45e6-a41f-b870780dbb69 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:44.079153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 493/972] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:44 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:07:44.083058 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10ab87-a072-471c-967b-25b83ee10b5d None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:44.083555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10ab87-a072-471c-967b-25b83ee10b5d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:44.084023 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10ab87-a072-471c-967b-25b83ee10b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:44.116980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-4c10ab87-a072-471c-967b-25b83ee10b5d None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:44.119764 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4c10ab87-a072-471c-967b-25b83ee10b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:44.136854 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85d2f5-3ed2-40e2-93d7-80685b931b8a None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:44.193774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696869f1-87cf-4e10-8b30-318c500d3442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:44.195562 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696869f1-87cf-4e10-8b30-318c500d3442 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:44.196326 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696869f1-87cf-4e10-8b30-318c500d3442 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:44.197024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696869f1-87cf-4e10-8b30-318c500d3442 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:44.215326 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696869f1-87cf-4e10-8b30-318c500d3442 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:44.218877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696869f1-87cf-4e10-8b30-318c500d3442 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:44.249249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-696869f1-87cf-4e10-8b30-318c500d3442 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 01:07:44.249249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:44.249249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:44.249249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:44.249249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:44.249249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:44.249249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:44.249249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:44.249249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:44.249249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:44.249249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:44.249249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:44.249249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:07:44.249249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:07:44.249249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:07:44.249249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:07:44.251455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:44.251455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:44.251455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:07:44.251455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:44.251455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:07:44.251455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:44.251455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:44.251455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:44.251455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:44.251455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:44.251455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:44.251455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:44.251455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:44.251455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:44.251455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:44.251455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:44.251455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:44.251455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:44.253948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:44.253948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:44.253948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:07:44.253948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:07:44.253948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:07:44.253948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:07:44.253948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:07:44.253948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:07:44.253948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 01:07:44.253948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:44.253948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 480/973] 10.222.0.83 () {56 vars in 1117 bytes} [Fri Sep 23 01:07:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:44.259039 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696869f1-87cf-4e10-8b30-318c500d3442 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:44.278437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 494/974] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 01:07:44.310474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:44.432945 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696869f1-87cf-4e10-8b30-318c500d3442 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:44.493803 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f4092-20c0-44cf-9e35-4a1433203b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:44.494882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f4092-20c0-44cf-9e35-4a1433203b9d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:44.495374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f4092-20c0-44cf-9e35-4a1433203b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:44.495933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f4092-20c0-44cf-9e35-4a1433203b9d None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:44.497311 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f4092-20c0-44cf-9e35-4a1433203b9d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:44.497854 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f4092-20c0-44cf-9e35-4a1433203b9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:44.500811 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f4092-20c0-44cf-9e35-4a1433203b9d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:44.535002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 481/975] 10.222.0.83 () {56 vars in 1149 bytes} [Fri Sep 23 01:07:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:44.544747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10ab87-a072-471c-967b-25b83ee10b5d None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:44.677005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:44.751913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10ab87-a072-471c-967b-25b83ee10b5d None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:44.805397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f4092-20c0-44cf-9e35-4a1433203b9d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:44.820739 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715072e-3c6c-4bd8-8cce-71ece41741b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:44.822001 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715072e-3c6c-4bd8-8cce-71ece41741b3 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:44.822656 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715072e-3c6c-4bd8-8cce-71ece41741b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:44.823139 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715072e-3c6c-4bd8-8cce-71ece41741b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:44.986739 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715072e-3c6c-4bd8-8cce-71ece41741b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:44.990627 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715072e-3c6c-4bd8-8cce-71ece41741b3 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:44.990871 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:45.005567 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f4092-20c0-44cf-9e35-4a1433203b9d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:45.074927 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5b28a-7d76-4e40-b37e-085e7380af90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:45.076079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5b28a-7d76-4e40-b37e-085e7380af90 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:45.076564 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5b28a-7d76-4e40-b37e-085e7380af90 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:45.077055 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5b28a-7d76-4e40-b37e-085e7380af90 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:45.078205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5b28a-7d76-4e40-b37e-085e7380af90 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:45.080909 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5b28a-7d76-4e40-b37e-085e7380af90 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:45.099329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-4ba5b28a-7d76-4e40-b37e-085e7380af90 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 01:07:45.099329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:45.099329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:45.099329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:45.099329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:45.099329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:45.099329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:45.099329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:45.099329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 01:07:45.099329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:45.099329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:45.099329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:45.099329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:45.099329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:45.099329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:45.099329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:45.099329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:45.101313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:45.101313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:45.101313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:45.101313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:45.101313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:45.101313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:45.101313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:45.101313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:45.101313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:45.101313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:45.101313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:45.101313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:45.101313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:45.101313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:45.101313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:45.101313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:45.103815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:45.103815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:45.103815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:45.103815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:45.103815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:45.103815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:45.103815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:45.103815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:45.103815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:45.103815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:45.103815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:45.103815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:45.103815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 01:07:45.103815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:45.106830 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 482/976] 10.222.0.83 () {56 vars in 1126 bytes} [Fri Sep 23 01:07:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:45.111387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5b28a-7d76-4e40-b37e-085e7380af90 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:45.125109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:45.194604 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 495/977] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:07:44 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 01:07:45.196919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715072e-3c6c-4bd8-8cce-71ece41741b3 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:45.285098 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5b28a-7d76-4e40-b37e-085e7380af90 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:45.329539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1bfea-aefb-4d19-9015-f18c9185e445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:45.330729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1bfea-aefb-4d19-9015-f18c9185e445 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:45.330729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1bfea-aefb-4d19-9015-f18c9185e445 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:45.330940 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1bfea-aefb-4d19-9015-f18c9185e445 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:45.331532 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1bfea-aefb-4d19-9015-f18c9185e445 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:45.331850 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1bfea-aefb-4d19-9015-f18c9185e445 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:45.333492 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1bfea-aefb-4d19-9015-f18c9185e445 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:45.339513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 483/978] 10.222.0.83 () {56 vars in 1122 bytes} [Fri Sep 23 01:07:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:45.339922 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715072e-3c6c-4bd8-8cce-71ece41741b3 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:45.340925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad3af5-cf70-4aa8-90ab-4adeae1846ab None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:45.341217 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad3af5-cf70-4aa8-90ab-4adeae1846ab None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:45.341474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad3af5-cf70-4aa8-90ab-4adeae1846ab None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:45.343120 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 484/979] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:45.349759 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143db7b1-c780-41ff-af0d-fa099816696c None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:45.350116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143db7b1-c780-41ff-af0d-fa099816696c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:45.350631 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143db7b1-c780-41ff-af0d-fa099816696c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:45.372028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-143db7b1-c780-41ff-af0d-fa099816696c None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:45.373322 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-143db7b1-c780-41ff-af0d-fa099816696c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:45.393395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:45.398392 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e70a23-f38f-4752-b43f-b1292279a673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:45.399256 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e70a23-f38f-4752-b43f-b1292279a673 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:45.399634 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e70a23-f38f-4752-b43f-b1292279a673 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:45.399976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e70a23-f38f-4752-b43f-b1292279a673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:45.413181 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e70a23-f38f-4752-b43f-b1292279a673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:45.415055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e70a23-f38f-4752-b43f-b1292279a673 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:45.432950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-11e70a23-f38f-4752-b43f-b1292279a673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:45.432950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:45.432950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:45.432950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:45.432950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:45.432950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:45.432950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:45.432950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:45.432950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:45.432950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:45.432950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:45.432950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:45.432950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:45.432950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:45.432950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:45.432950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:45.434755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:45.434755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:45.434755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:45.434755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:45.434755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:45.434755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:45.434755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:45.434755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:45.434755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:45.434755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:45.434755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:45.434755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:45.434755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:45.434755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:45.434755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:45.434755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:45.434755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:45.436788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:45.436788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:45.436788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:45.436788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 496/980] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:45.436788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e70a23-f38f-4752-b43f-b1292279a673 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:45.455711 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 485/981] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 01:07:45.456943 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143db7b1-c780-41ff-af0d-fa099816696c None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:45.460291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:45.598507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e70a23-f38f-4752-b43f-b1292279a673 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:45.619029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143db7b1-c780-41ff-af0d-fa099816696c None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:45.649082 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a54432-6c11-4466-a4eb-c1c2e6110f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:45.649785 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a54432-6c11-4466-a4eb-c1c2e6110f7d None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:45.650141 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a54432-6c11-4466-a4eb-c1c2e6110f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:45.650556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a54432-6c11-4466-a4eb-c1c2e6110f7d None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:45.651548 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a54432-6c11-4466-a4eb-c1c2e6110f7d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:45.652050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a54432-6c11-4466-a4eb-c1c2e6110f7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:45.654506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a54432-6c11-4466-a4eb-c1c2e6110f7d None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:45.670794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 497/982] 10.222.0.83 () {56 vars in 1122 bytes} [Fri Sep 23 01:07:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:45.674711 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a54432-6c11-4466-a4eb-c1c2e6110f7d None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:45.684666 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b13d6-4f1c-42fb-9126-dd13d82ef029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:45.685539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b13d6-4f1c-42fb-9126-dd13d82ef029 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:45.685866 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b13d6-4f1c-42fb-9126-dd13d82ef029 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:45.686140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b13d6-4f1c-42fb-9126-dd13d82ef029 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:45.686836 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b13d6-4f1c-42fb-9126-dd13d82ef029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:45.687148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b13d6-4f1c-42fb-9126-dd13d82ef029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:45.688562 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b13d6-4f1c-42fb-9126-dd13d82ef029 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:45.702053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 486/983] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:45.708013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b13d6-4f1c-42fb-9126-dd13d82ef029 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:45.725591 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:45.808098 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:45.842415 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b13d6-4f1c-42fb-9126-dd13d82ef029 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:45.859591 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a54432-6c11-4466-a4eb-c1c2e6110f7d None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:45.888952 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48349c75-dec1-437a-95fb-2e5b4e8fd98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:45.889161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48349c75-dec1-437a-95fb-2e5b4e8fd98a None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:45.889503 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48349c75-dec1-437a-95fb-2e5b4e8fd98a None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:45.889662 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48349c75-dec1-437a-95fb-2e5b4e8fd98a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:45.899187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48349c75-dec1-437a-95fb-2e5b4e8fd98a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:45.900731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48349c75-dec1-437a-95fb-2e5b4e8fd98a None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:45.921413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-48349c75-dec1-437a-95fb-2e5b4e8fd98a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:45.921413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:45.921413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:45.921413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:45.921413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:45.921413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:45.921413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:45.921413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:45.921413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:45.921413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:45.921413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:45.921413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:45.921413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:07:45.921413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:07:45.921413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:07:45.923353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:07:45.923353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:45.923353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:45.923353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:45.923353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:45.923353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:45.923353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:45.923353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:45.923353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:45.923353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:45.923353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:45.923353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:45.923353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:45.923353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:45.923353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:45.923353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:45.923353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:45.925357 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:07:45.925357 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:07:45.925357 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:07:45.925357 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:07:45.925357 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:07:45.925357 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:07:45.925357 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:07:45.925357 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:45.928356 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 487/984] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:07:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:07:45.929954 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42850d-77f0-4112-a563-98215293a489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:45.930244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48349c75-dec1-437a-95fb-2e5b4e8fd98a None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:45.931117 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42850d-77f0-4112-a563-98215293a489 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:45.931626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42850d-77f0-4112-a563-98215293a489 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:45.932563 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42850d-77f0-4112-a563-98215293a489 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:45.933387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42850d-77f0-4112-a563-98215293a489 None admin] RBAC: Adding query filter params (interface=admin, service_id=3b043805194a4ab6abc35a0bbade0145, region_id=RegionOne) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:45.934023 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42850d-77f0-4112-a563-98215293a489 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:45.936771 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42850d-77f0-4112-a563-98215293a489 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:45.950273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 498/985] 10.222.0.83 () {56 vars in 1249 bytes} [Fri Sep 23 01:07:45 2022] GET /identity/v3/endpoints?service_id=3b043805194a4ab6abc35a0bbade0145&interface=admin®ion_id=RegionOne => generated 193 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:45.951920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42850d-77f0-4112-a563-98215293a489 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:46.061809 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:46.105164 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42850d-77f0-4112-a563-98215293a489 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:46.118412 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48349c75-dec1-437a-95fb-2e5b4e8fd98a None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:46.151963 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562efab6-0e1f-4cba-af1b-df9b8e0b5efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:46.152611 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562efab6-0e1f-4cba-af1b-df9b8e0b5efb None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:46.152964 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562efab6-0e1f-4cba-af1b-df9b8e0b5efb None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:46.153244 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562efab6-0e1f-4cba-af1b-df9b8e0b5efb None admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:46.153967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562efab6-0e1f-4cba-af1b-df9b8e0b5efb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:46.154265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562efab6-0e1f-4cba-af1b-df9b8e0b5efb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:46.156013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562efab6-0e1f-4cba-af1b-df9b8e0b5efb None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:46.162431 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f51c1-25f6-48dd-9e61-4acb339a5519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:46.163223 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f51c1-25f6-48dd-9e61-4acb339a5519 None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:46.163587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f51c1-25f6-48dd-9e61-4acb339a5519 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:46.163967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f51c1-25f6-48dd-9e61-4acb339a5519 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:46.164776 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f51c1-25f6-48dd-9e61-4acb339a5519 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:46.166294 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f51c1-25f6-48dd-9e61-4acb339a5519 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:46.172891 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 499/986] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:07:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:46.174327 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562efab6-0e1f-4cba-af1b-df9b8e0b5efb None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:46.178150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:46.282714 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 488/987] 10.222.0.83 () {60 vars in 1141 bytes} [Fri Sep 23 01:07:45 2022] POST /identity/v3/services => generated 242 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:07:46.285028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f51c1-25f6-48dd-9e61-4acb339a5519 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:46.318721 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562efab6-0e1f-4cba-af1b-df9b8e0b5efb None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:46.411725 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb6376-8e9c-41f1-ad65-f06c7324158f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:46.413141 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb6376-8e9c-41f1-ad65-f06c7324158f None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:46.413922 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb6376-8e9c-41f1-ad65-f06c7324158f None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:46.414411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb6376-8e9c-41f1-ad65-f06c7324158f None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:46.415566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb6376-8e9c-41f1-ad65-f06c7324158f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:46.418259 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb6376-8e9c-41f1-ad65-f06c7324158f None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:46.431266 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 500/988] 10.222.0.83 () {56 vars in 1087 bytes} [Fri Sep 23 01:07:46 2022] GET /identity/v3/services => generated 1727 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:07:46.470366 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f51c1-25f6-48dd-9e61-4acb339a5519 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:46.527925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:46.537016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3794b17-d6ff-4dd6-97a6-98438866d660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:46.538512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3794b17-d6ff-4dd6-97a6-98438866d660 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:46.539021 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3794b17-d6ff-4dd6-97a6-98438866d660 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:46.544090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3794b17-d6ff-4dd6-97a6-98438866d660 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:46.544090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3794b17-d6ff-4dd6-97a6-98438866d660 None admin] RBAC: Adding query filter params (role.id=186fd04868e2437abf77f8ffdeec44a5, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=f2cea4c08f324769bf6dcea58c9394b3) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:46.544090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3794b17-d6ff-4dd6-97a6-98438866d660 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:46.544362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3794b17-d6ff-4dd6-97a6-98438866d660 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:46.555982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 489/989] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:07:46 2022] GET /identity/v3/role_assignments?user.id=f2cea4c08f324769bf6dcea58c9394b3&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=186fd04868e2437abf77f8ffdeec44a5 => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:48.908606 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b7721-6202-4af9-ac18-40cc9c3341d4 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:48.909240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b7721-6202-4af9-ac18-40cc9c3341d4 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:48.909240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b7721-6202-4af9-ac18-40cc9c3341d4 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:48.910876 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 501/990] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:48.917053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a17ba-35d2-4b48-83b1-c7608226c4fe None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:48.917586 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a17ba-35d2-4b48-83b1-c7608226c4fe None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:48.917832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a17ba-35d2-4b48-83b1-c7608226c4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:48.940516 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-282a17ba-35d2-4b48-83b1-c7608226c4fe None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:48.942672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-282a17ba-35d2-4b48-83b1-c7608226c4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:49.074910 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 490/991] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:49.202265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff10a0b-6375-4006-ae64-c8d660743b44 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:49.202806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff10a0b-6375-4006-ae64-c8d660743b44 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:49.203212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff10a0b-6375-4006-ae64-c8d660743b44 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:49.206215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 502/992] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:49.215292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f199936-e3e8-43b0-86e1-3a812392cdb8 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:49.215730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f199936-e3e8-43b0-86e1-3a812392cdb8 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:49.216260 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f199936-e3e8-43b0-86e1-3a812392cdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:49.248336 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-8f199936-e3e8-43b0-86e1-3a812392cdb8 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:49.250472 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-8f199936-e3e8-43b0-86e1-3a812392cdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:49.383350 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 491/993] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:49 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:49.390124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff10a0b-6375-4006-ae64-c8d660743b44 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:49.510493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:49.649002 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff10a0b-6375-4006-ae64-c8d660743b44 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:49.711583 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a313cf4-38b8-4fc6-8b29-8949473ca840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:49.712292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a313cf4-38b8-4fc6-8b29-8949473ca840 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:49.712548 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a313cf4-38b8-4fc6-8b29-8949473ca840 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:49.712812 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a313cf4-38b8-4fc6-8b29-8949473ca840 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:49.713413 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a313cf4-38b8-4fc6-8b29-8949473ca840 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:49.714849 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a313cf4-38b8-4fc6-8b29-8949473ca840 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:49.726245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-9a313cf4-38b8-4fc6-8b29-8949473ca840 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 01:07:49.726245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:49.726245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:49.726245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:49.726245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:49.726245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:49.726245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:49.726245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:49.726245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 01:07:49.726245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:49.726245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:49.726245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:49.726245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:49.726245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:49.726245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:49.726245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:49.726245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:49.732108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:49.732108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:49.732108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:49.732108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:49.732108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:49.732108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:49.732108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:49.732108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:49.732108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:49.732108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:49.732108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:49.732108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:49.732108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:49.732108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:49.732108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:49.732108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:49.733881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:49.733881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:49.733881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:49.733881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:49.733881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:49.733881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:49.733881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:49.733881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:49.733881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:49.733881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:49.733881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:49.733881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:49.733881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 01:07:49.733881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:49.733881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 503/994] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:07:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:07:49.738201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f199936-e3e8-43b0-86e1-3a812392cdb8 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:49.758521 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ba209-5b06-48e0-aab3-ef377ca0964c None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:49.759018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ba209-5b06-48e0-aab3-ef377ca0964c None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:49.760619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ba209-5b06-48e0-aab3-ef377ca0964c None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:49.761659 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 504/995] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:07:49.770322 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b0f41-c5c0-4bf6-8f98-cbe97c47e71e None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:49.770692 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b0f41-c5c0-4bf6-8f98-cbe97c47e71e None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:49.770956 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b0f41-c5c0-4bf6-8f98-cbe97c47e71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:49.791801 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-627b0f41-c5c0-4bf6-8f98-cbe97c47e71e None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:49.793082 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-627b0f41-c5c0-4bf6-8f98-cbe97c47e71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:49.853353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:49.884083 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 505/996] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:49 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 01:07:49.885260 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b0f41-c5c0-4bf6-8f98-cbe97c47e71e None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:49.929264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f199936-e3e8-43b0-86e1-3a812392cdb8 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:49.974432 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:50.005042 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af046f9-8119-47cc-81e7-1269e65f066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:50.006092 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af046f9-8119-47cc-81e7-1269e65f066e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:50.006561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af046f9-8119-47cc-81e7-1269e65f066e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:50.007056 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af046f9-8119-47cc-81e7-1269e65f066e None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:50.008244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af046f9-8119-47cc-81e7-1269e65f066e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:50.009008 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af046f9-8119-47cc-81e7-1269e65f066e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:50.011914 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af046f9-8119-47cc-81e7-1269e65f066e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:50.022640 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 492/997] 10.222.0.83 () {56 vars in 1112 bytes} [Fri Sep 23 01:07:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:50.031602 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af046f9-8119-47cc-81e7-1269e65f066e None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:50.048465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b0f41-c5c0-4bf6-8f98-cbe97c47e71e None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:50.099786 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde86c74-9737-47c7-b9cd-3e02e846d16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:50.100869 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde86c74-9737-47c7-b9cd-3e02e846d16f None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:50.101427 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde86c74-9737-47c7-b9cd-3e02e846d16f None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:50.101906 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde86c74-9737-47c7-b9cd-3e02e846d16f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:50.103776 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde86c74-9737-47c7-b9cd-3e02e846d16f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:50.106908 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde86c74-9737-47c7-b9cd-3e02e846d16f None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:50.126035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-cde86c74-9737-47c7-b9cd-3e02e846d16f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 01:07:50.126035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:50.126035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:50.126035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:50.126035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:50.126035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:50.126035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:50.126035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:50.126035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 01:07:50.126035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:50.126035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:50.126035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:50.126035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:50.126035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:50.126035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:50.126035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:50.126035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:50.128013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:50.128013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:50.128013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:50.128013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:50.128013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:50.128013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:50.128013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:50.128013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:50.128013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:50.128013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:50.128013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:50.128013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:50.128013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:50.128013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:50.128013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:50.128013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:50.137480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:50.137480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:50.137480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:50.137480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:50.137480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:50.137480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:50.137480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:50.137480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:50.137480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:50.137480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:50.137480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:50.137480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:50.137480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 01:07:50.137480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:50.137480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 506/998] 10.222.0.83 () {56 vars in 1126 bytes} [Fri Sep 23 01:07:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:50.141269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde86c74-9737-47c7-b9cd-3e02e846d16f None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:50.200299 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af046f9-8119-47cc-81e7-1269e65f066e None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:50.239880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:50.258140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b970d40-c708-413a-a7ad-bde9ce096a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:50.258815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b970d40-c708-413a-a7ad-bde9ce096a81 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:50.259091 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b970d40-c708-413a-a7ad-bde9ce096a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:50.259364 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b970d40-c708-413a-a7ad-bde9ce096a81 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:50.260012 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b970d40-c708-413a-a7ad-bde9ce096a81 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:50.260313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b970d40-c708-413a-a7ad-bde9ce096a81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:50.261751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b970d40-c708-413a-a7ad-bde9ce096a81 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:50.267436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 493/999] 10.222.0.83 () {56 vars in 1112 bytes} [Fri Sep 23 01:07:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:50.267985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b970d40-c708-413a-a7ad-bde9ce096a81 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:50.288352 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde86c74-9737-47c7-b9cd-3e02e846d16f None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:50.315159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:50.335149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac73b39-bcb3-41d5-9eb1-5701cfaba9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:50.335776 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73b39-bcb3-41d5-9eb1-5701cfaba9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:50.336178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73b39-bcb3-41d5-9eb1-5701cfaba9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:50.336546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73b39-bcb3-41d5-9eb1-5701cfaba9f9 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:50.337286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac73b39-bcb3-41d5-9eb1-5701cfaba9f9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:50.337687 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac73b39-bcb3-41d5-9eb1-5701cfaba9f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:50.339401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac73b39-bcb3-41d5-9eb1-5701cfaba9f9 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:50.345404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 507/1000] 10.222.0.83 () {56 vars in 1122 bytes} [Fri Sep 23 01:07:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:50.347263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac73b39-bcb3-41d5-9eb1-5701cfaba9f9 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:50.411328 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b970d40-c708-413a-a7ad-bde9ce096a81 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:50.458503 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf394f5-d234-4815-9b11-114dc12b6208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:50.459642 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf394f5-d234-4815-9b11-114dc12b6208 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:50.460273 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf394f5-d234-4815-9b11-114dc12b6208 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:50.460630 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf394f5-d234-4815-9b11-114dc12b6208 None admin] PATH_INFO: `/v3/services/image` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:50.461689 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf394f5-d234-4815-9b11-114dc12b6208 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:50.464352 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf394f5-d234-4815-9b11-114dc12b6208 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:50.482680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-ebf394f5-d234-4815-9b11-114dc12b6208 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 01:07:50.482680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:50.482680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:50.482680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:50.482680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:50.482680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:50.482680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:50.482680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:50.482680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 01:07:50.482680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:50.482680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:50.482680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:50.482680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:50.482680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:50.482680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:50.482680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:50.482680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:50.484277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:50.484277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:50.484277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:50.484277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:50.484277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:50.484277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:50.484277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:50.484277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:50.484277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:50.484277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:50.484277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:50.484277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:50.484277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:50.484277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:50.484277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:50.484277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:50.485734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:50.485734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:50.485734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:50.485734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:50.485734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:50.485734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:50.485734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:50.485734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:50.485734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:50.485734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:50.485734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:50.485734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:50.485734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 01:07:50.485734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:50.485734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 494/1001] 10.222.0.83 () {56 vars in 1105 bytes} [Fri Sep 23 01:07:50 2022] GET /identity/v3/services/image => generated 86 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:50.488899 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf394f5-d234-4815-9b11-114dc12b6208 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:50.526043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac73b39-bcb3-41d5-9eb1-5701cfaba9f9 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:50.571523 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:50.594138 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415814b-46ff-4a7f-81f4-8fbf9e033eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:50.595118 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415814b-46ff-4a7f-81f4-8fbf9e033eca None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:50.595566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415814b-46ff-4a7f-81f4-8fbf9e033eca None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:50.595997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415814b-46ff-4a7f-81f4-8fbf9e033eca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:50.597159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415814b-46ff-4a7f-81f4-8fbf9e033eca None admin] RBAC: Adding query filter params (interface=public, service_id=8d8be69ef7374af6a350923fe68a9c80, region_id=RegionOne) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:50.597644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415814b-46ff-4a7f-81f4-8fbf9e033eca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:50.599992 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415814b-46ff-4a7f-81f4-8fbf9e033eca None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:50.609278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 508/1002] 10.222.0.83 () {56 vars in 1251 bytes} [Fri Sep 23 01:07:50 2022] GET /identity/v3/endpoints?service_id=8d8be69ef7374af6a350923fe68a9c80&interface=public®ion_id=RegionOne => generated 194 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:50.610820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415814b-46ff-4a7f-81f4-8fbf9e033eca None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:50.656266 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf394f5-d234-4815-9b11-114dc12b6208 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:50.700888 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:50.703151 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040f908-cbbb-455b-ab81-60720531e4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:50.703938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040f908-cbbb-455b-ab81-60720531e4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:50.704280 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040f908-cbbb-455b-ab81-60720531e4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:50.704615 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040f908-cbbb-455b-ab81-60720531e4e0 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:50.705500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040f908-cbbb-455b-ab81-60720531e4e0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:50.705869 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040f908-cbbb-455b-ab81-60720531e4e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:50.708322 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040f908-cbbb-455b-ab81-60720531e4e0 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:50.715419 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 495/1003] 10.222.0.83 () {56 vars in 1122 bytes} [Fri Sep 23 01:07:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:50.717419 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040f908-cbbb-455b-ab81-60720531e4e0 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:50.782299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415814b-46ff-4a7f-81f4-8fbf9e033eca None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:50.845254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bb154-c20a-4b4b-a1c0-055bb0397c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:50.846167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bb154-c20a-4b4b-a1c0-055bb0397c7c None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:50.846788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bb154-c20a-4b4b-a1c0-055bb0397c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:50.847262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bb154-c20a-4b4b-a1c0-055bb0397c7c None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:50.848166 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bb154-c20a-4b4b-a1c0-055bb0397c7c None admin] RBAC: Adding query filter params (name=image) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:50.848512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bb154-c20a-4b4b-a1c0-055bb0397c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:50.850190 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bb154-c20a-4b4b-a1c0-055bb0397c7c None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:50.856538 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 509/1004] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:50.857370 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bb154-c20a-4b4b-a1c0-055bb0397c7c None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:50.868533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040f908-cbbb-455b-ab81-60720531e4e0 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:50.894302 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:50.930369 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694f3f6-2330-43ba-8805-f6a57377ff1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:50.931824 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694f3f6-2330-43ba-8805-f6a57377ff1d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:50.932274 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694f3f6-2330-43ba-8805-f6a57377ff1d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:50.932682 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694f3f6-2330-43ba-8805-f6a57377ff1d None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:50.933528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694f3f6-2330-43ba-8805-f6a57377ff1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:50.936094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694f3f6-2330-43ba-8805-f6a57377ff1d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:50.945660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 496/1005] 10.222.0.83 () {56 vars in 1087 bytes} [Fri Sep 23 01:07:50 2022] GET /identity/v3/services => generated 1727 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:07:50.946384 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694f3f6-2330-43ba-8805-f6a57377ff1d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:51.023668 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bb154-c20a-4b4b-a1c0-055bb0397c7c None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:51.040062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:51.091137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1b662-bf0b-45b2-9c73-876b123fd8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:51.093743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1b662-bf0b-45b2-9c73-876b123fd8bd None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:51.094187 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1b662-bf0b-45b2-9c73-876b123fd8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:51.094647 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1b662-bf0b-45b2-9c73-876b123fd8bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:51.096853 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1b662-bf0b-45b2-9c73-876b123fd8bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:51.100299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1b662-bf0b-45b2-9c73-876b123fd8bd None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:51.137064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694f3f6-2330-43ba-8805-f6a57377ff1d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:51.193226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698c559-cb57-4a20-8ee8-cc44739cb886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:51.194045 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698c559-cb57-4a20-8ee8-cc44739cb886 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:51.194510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698c559-cb57-4a20-8ee8-cc44739cb886 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:51.194996 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698c559-cb57-4a20-8ee8-cc44739cb886 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:51.195818 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698c559-cb57-4a20-8ee8-cc44739cb886 None admin] RBAC: Adding query filter params (type=image) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:51.196134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698c559-cb57-4a20-8ee8-cc44739cb886 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:51.198704 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698c559-cb57-4a20-8ee8-cc44739cb886 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:51.205680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 497/1006] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:51.230383 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 510/1007] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:07:50 2022] POST /identity/v3/endpoints => generated 325 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:07:53.517352 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd61ed5-1ed5-4e1b-9d37-b2d5f3802914 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:53.518184 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd61ed5-1ed5-4e1b-9d37-b2d5f3802914 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:53.518647 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd61ed5-1ed5-4e1b-9d37-b2d5f3802914 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:53.521259 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 498/1008] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:53.531715 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107723-6ac1-4076-bc4b-2fc9c012c8cb None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:53.532428 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107723-6ac1-4076-bc4b-2fc9c012c8cb None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:53.532675 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107723-6ac1-4076-bc4b-2fc9c012c8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:53.561804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e96c0-da2f-4792-97c5-eae4b79af1ad None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:53.562101 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e96c0-da2f-4792-97c5-eae4b79af1ad None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:53.566887 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e96c0-da2f-4792-97c5-eae4b79af1ad None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:53.566887 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 499/1009] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:07:53.568463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-4b107723-6ac1-4076-bc4b-2fc9c012c8cb None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:53.570404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85d8c6-2680-48c0-99ad-8b34b5ab2e58 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:53.570723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85d8c6-2680-48c0-99ad-8b34b5ab2e58 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:53.571074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4b107723-6ac1-4076-bc4b-2fc9c012c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:53.571182 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85d8c6-2680-48c0-99ad-8b34b5ab2e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:53.601030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-0b85d8c6-2680-48c0-99ad-8b34b5ab2e58 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:53.603061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-0b85d8c6-2680-48c0-99ad-8b34b5ab2e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:53.663454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:53.705770 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 511/1010] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:53 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:53.712740 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 500/1011] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:53 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:53.996512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b107723-6ac1-4076-bc4b-2fc9c012c8cb None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:54.119521 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:54.124925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b107723-6ac1-4076-bc4b-2fc9c012c8cb None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:54.176262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b63cc9-4a40-437b-ac81-36da9c0e66f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:54.176874 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b63cc9-4a40-437b-ac81-36da9c0e66f4 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:54.177248 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b63cc9-4a40-437b-ac81-36da9c0e66f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:54.177601 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b63cc9-4a40-437b-ac81-36da9c0e66f4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:54.178211 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b63cc9-4a40-437b-ac81-36da9c0e66f4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:54.179736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b63cc9-4a40-437b-ac81-36da9c0e66f4 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:54.189962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-15b63cc9-4a40-437b-ac81-36da9c0e66f4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 01:07:54.189962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:54.189962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:54.189962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:54.189962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:54.189962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:54.189962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:54.189962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:54.189962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 01:07:54.189962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:54.189962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:54.189962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:54.189962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:54.189962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:54.189962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:54.189962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:54.189962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:54.192461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:54.192461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:54.192461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:54.192461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:54.192461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:54.192461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:54.192461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:54.192461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:54.192461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:54.192461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:54.192461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:54.192461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:54.192461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:54.192461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:54.192461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:54.192461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:54.193543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:54.193543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:54.193543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:54.193543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:54.193543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:54.193543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:54.193543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:54.193543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:54.193543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:54.193543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:54.193543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:54.193543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:54.193543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 01:07:54.193543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:54.193543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 512/1012] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:07:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:54.201579 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85d8c6-2680-48c0-99ad-8b34b5ab2e58 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:54.211286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b63cc9-4a40-437b-ac81-36da9c0e66f4 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:54.370025 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b63cc9-4a40-437b-ac81-36da9c0e66f4 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:54.383652 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85d8c6-2680-48c0-99ad-8b34b5ab2e58 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:54.423125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3702c-3526-4b8a-829d-c11d817cd898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:54.423792 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3702c-3526-4b8a-829d-c11d817cd898 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:54.424235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3702c-3526-4b8a-829d-c11d817cd898 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:54.424638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3702c-3526-4b8a-829d-c11d817cd898 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:54.426201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3702c-3526-4b8a-829d-c11d817cd898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:54.428771 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3702c-3526-4b8a-829d-c11d817cd898 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:54.430634 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 513/1013] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:54.434064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f2caa-62ee-4a4b-8a9d-f0a9594b3b35 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:54.434385 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f2caa-62ee-4a4b-8a9d-f0a9594b3b35 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:54.434700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f2caa-62ee-4a4b-8a9d-f0a9594b3b35 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:54.436221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 514/1014] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:07:54.436910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f2caa-62ee-4a4b-8a9d-f0a9594b3b35 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:54.444811 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bf0a1-8927-41e1-b499-6c311ad6ee2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:54.445447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bf0a1-8927-41e1-b499-6c311ad6ee2a None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:54.445723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bf0a1-8927-41e1-b499-6c311ad6ee2a None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:54.445989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bf0a1-8927-41e1-b499-6c311ad6ee2a None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:54.446839 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bf0a1-8927-41e1-b499-6c311ad6ee2a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:54.447020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bf0a1-8927-41e1-b499-6c311ad6ee2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:54.448616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bf0a1-8927-41e1-b499-6c311ad6ee2a None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:54.456051 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 501/1015] 10.222.0.83 () {56 vars in 1112 bytes} [Fri Sep 23 01:07:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:54.460787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278b2bf-7c0c-4c7a-ac1a-457e62605b85 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:54.461459 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278b2bf-7c0c-4c7a-ac1a-457e62605b85 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:54.461702 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278b2bf-7c0c-4c7a-ac1a-457e62605b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:54.483817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:54.484719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-0278b2bf-7c0c-4c7a-ac1a-457e62605b85 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:54.486504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-0278b2bf-7c0c-4c7a-ac1a-457e62605b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:54.529893 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:54.589063 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 502/1016] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:54.590298 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278b2bf-7c0c-4c7a-ac1a-457e62605b85 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:54.608925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f2caa-62ee-4a4b-8a9d-f0a9594b3b35 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:54.675860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120b50b-8a3a-4388-9433-97afb0c1d39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:54.676793 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120b50b-8a3a-4388-9433-97afb0c1d39e None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:54.677229 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120b50b-8a3a-4388-9433-97afb0c1d39e None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:54.677691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120b50b-8a3a-4388-9433-97afb0c1d39e None admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:54.678939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120b50b-8a3a-4388-9433-97afb0c1d39e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:54.681483 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120b50b-8a3a-4388-9433-97afb0c1d39e None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:54.770232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278b2bf-7c0c-4c7a-ac1a-457e62605b85 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:54.793377 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 515/1017] 10.222.0.83 () {60 vars in 1141 bytes} [Fri Sep 23 01:07:54 2022] POST /identity/v3/projects => generated 311 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:07:54.828886 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b8c70-8c07-4edd-a770-c171ffec22d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:54.829953 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b8c70-8c07-4edd-a770-c171ffec22d2 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:54.830448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b8c70-8c07-4edd-a770-c171ffec22d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:54.830956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b8c70-8c07-4edd-a770-c171ffec22d2 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:54.832715 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b8c70-8c07-4edd-a770-c171ffec22d2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:54.833256 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b8c70-8c07-4edd-a770-c171ffec22d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:54.835977 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b8c70-8c07-4edd-a770-c171ffec22d2 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:54.853824 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 503/1018] 10.222.0.83 () {56 vars in 1112 bytes} [Fri Sep 23 01:07:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:54.855742 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120b50b-8a3a-4388-9433-97afb0c1d39e None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:54.878773 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b8c70-8c07-4edd-a770-c171ffec22d2 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:54.927988 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:55.004186 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:55.030317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120b50b-8a3a-4388-9433-97afb0c1d39e None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:55.048167 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b8c70-8c07-4edd-a770-c171ffec22d2 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:55.090330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71614e9-f233-4823-a9b6-ded22b5b684b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:55.091001 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71614e9-f233-4823-a9b6-ded22b5b684b None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:55.091461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71614e9-f233-4823-a9b6-ded22b5b684b None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:55.092567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71614e9-f233-4823-a9b6-ded22b5b684b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:55.092716 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71614e9-f233-4823-a9b6-ded22b5b684b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:55.094208 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71614e9-f233-4823-a9b6-ded22b5b684b None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:55.107532 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3052a-fe0f-4c90-b961-e787cc1041f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:55.108334 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3052a-fe0f-4c90-b961-e787cc1041f1 None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:55.108723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3052a-fe0f-4c90-b961-e787cc1041f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:55.109108 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3052a-fe0f-4c90-b961-e787cc1041f1 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:55.109936 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3052a-fe0f-4c90-b961-e787cc1041f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:55.111608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3052a-fe0f-4c90-b961-e787cc1041f1 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:55.167849 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 516/1019] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:07:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:07:55.202921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 504/1020] 10.222.0.83 () {60 vars in 1141 bytes} [Fri Sep 23 01:07:54 2022] POST /identity/v3/services => generated 242 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:07:57.349573 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb23e70-1467-449b-813a-21eab71e528b None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:57.350156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb23e70-1467-449b-813a-21eab71e528b None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:57.350434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb23e70-1467-449b-813a-21eab71e528b None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:57.351948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 517/1021] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:07:57.358198 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9e79d-a81d-483d-a10a-413af65af26b None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:57.358876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9e79d-a81d-483d-a10a-413af65af26b None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:57.358876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9e79d-a81d-483d-a10a-413af65af26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:57.380125 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-b0f9e79d-a81d-483d-a10a-413af65af26b None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:57.381396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b0f9e79d-a81d-483d-a10a-413af65af26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:57.480547 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 505/1022] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:57.720422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f4198-334e-4f65-80db-5a614363912c None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:57.720683 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f4198-334e-4f65-80db-5a614363912c None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:57.721039 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f4198-334e-4f65-80db-5a614363912c None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:57.723102 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 518/1023] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:07:57.728855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab12671-9b95-4668-a703-ac10d6cebc2b None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:57.729129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab12671-9b95-4668-a703-ac10d6cebc2b None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:57.729392 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab12671-9b95-4668-a703-ac10d6cebc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:57.730058 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158c0cc-841f-43ab-8fd2-74593cc41fba None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:57.730439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158c0cc-841f-43ab-8fd2-74593cc41fba None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:57.730882 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158c0cc-841f-43ab-8fd2-74593cc41fba None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:57.733693 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 519/1024] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:07:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:07:57.743521 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530292a-7b1e-49b9-800a-950586cd5722 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:57.743836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530292a-7b1e-49b9-800a-950586cd5722 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:57.744802 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530292a-7b1e-49b9-800a-950586cd5722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:57.751653 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-7ab12671-9b95-4668-a703-ac10d6cebc2b None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:57.752916 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-7ab12671-9b95-4668-a703-ac10d6cebc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:57.765488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:57.778711 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-f530292a-7b1e-49b9-800a-950586cd5722 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:07:57.780801 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f530292a-7b1e-49b9-800a-950586cd5722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:07:57.844433 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 506/1025] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:07:57.845719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab12671-9b95-4668-a703-ac10d6cebc2b None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:57.890901 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 520/1026] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:07:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 01:07:58.010708 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab12671-9b95-4668-a703-ac10d6cebc2b None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:58.069320 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c94d0-6d45-4750-84e0-bc4b23fd169d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:58.070377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c94d0-6d45-4750-84e0-bc4b23fd169d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:58.070952 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c94d0-6d45-4750-84e0-bc4b23fd169d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:58.071375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c94d0-6d45-4750-84e0-bc4b23fd169d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:58.073442 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c94d0-6d45-4750-84e0-bc4b23fd169d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:58.076042 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c94d0-6d45-4750-84e0-bc4b23fd169d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:58.082658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 507/1027] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:58.087609 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530292a-7b1e-49b9-800a-950586cd5722 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:58.138350 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c94d0-6d45-4750-84e0-bc4b23fd169d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:58.164611 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:58.195584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:58.248273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530292a-7b1e-49b9-800a-950586cd5722 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:58.277890 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c94d0-6d45-4750-84e0-bc4b23fd169d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:58.302609 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1359ed-acc1-4f7f-9944-5cf190ad9d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:58.303266 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1359ed-acc1-4f7f-9944-5cf190ad9d10 None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:58.303587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1359ed-acc1-4f7f-9944-5cf190ad9d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:58.303896 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1359ed-acc1-4f7f-9944-5cf190ad9d10 None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:58.304580 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1359ed-acc1-4f7f-9944-5cf190ad9d10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:58.306182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1359ed-acc1-4f7f-9944-5cf190ad9d10 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:58.325278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07873e70-d659-4d03-b1a2-61a86f32883a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:58.325937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07873e70-d659-4d03-b1a2-61a86f32883a None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:58.326214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07873e70-d659-4d03-b1a2-61a86f32883a None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:58.328679 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07873e70-d659-4d03-b1a2-61a86f32883a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:58.338327 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07873e70-d659-4d03-b1a2-61a86f32883a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:07:58.343394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-07873e70-d659-4d03-b1a2-61a86f32883a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 01:07:58.343394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:58.343394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:58.343394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:58.343394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:58.343394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:58.343394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:58.343394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:58.343394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:58.343394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:58.343394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:58.343394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:58.343394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:07:58.343394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:07:58.343394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:07:58.343394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:07:58.345451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:07:58.345451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:07:58.345451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:07:58.345451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:07:58.345451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:58.345451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:58.345451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:58.345451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:58.345451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:58.345451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:58.345451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:58.345451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:58.345451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:58.345451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:58.345451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:58.345451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:58.347984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:58.347984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:58.347984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:58.347984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:58.347984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:07:58.347984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:07:58.347984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:07:58.347984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:07:58.347984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:07:58.347984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:07:58.347984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 01:07:58.347984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:58.347984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 508/1028] 10.222.0.83 () {56 vars in 1120 bytes} [Fri Sep 23 01:07:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:58.347984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07873e70-d659-4d03-b1a2-61a86f32883a None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:58.430085 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 521/1029] 10.222.0.83 () {60 vars in 1132 bytes} [Fri Sep 23 01:07:58 2022] POST /identity/v3/users => generated 285 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:07:58.431309 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1359ed-acc1-4f7f-9944-5cf190ad9d10 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:58.439218 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:58.498510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07873e70-d659-4d03-b1a2-61a86f32883a None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:58.567719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e66a4-d7fa-4c31-8851-1324e5ccd2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:58.568754 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e66a4-d7fa-4c31-8851-1324e5ccd2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:58.569257 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e66a4-d7fa-4c31-8851-1324e5ccd2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:58.569745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e66a4-d7fa-4c31-8851-1324e5ccd2c5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:58.570869 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e66a4-d7fa-4c31-8851-1324e5ccd2c5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:58.573895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e66a4-d7fa-4c31-8851-1324e5ccd2c5 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:58.591153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-3c2e66a4-d7fa-4c31-8851-1324e5ccd2c5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 01:07:58.591153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:58.591153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:07:58.591153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:07:58.591153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:07:58.591153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:07:58.591153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:07:58.591153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:58.591153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 01:07:58.591153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:58.591153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:07:58.591153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:58.591153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:58.591153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:58.591153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:58.591153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:58.591153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:58.593133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:58.593133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:58.593133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:58.593133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:58.593133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:58.593133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:58.593133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:07:58.593133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:07:58.593133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:07:58.593133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:07:58.593133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:58.593133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:58.593133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:58.593133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:58.593133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:58.593133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:58.594888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:58.594888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:58.594888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:58.594888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:58.594888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:58.594888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:58.594888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:58.594888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:58.594888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:58.594888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:58.594888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:07:58.594888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:07:58.594888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 01:07:58.594888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:07:58.594888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 509/1030] 10.222.0.83 () {56 vars in 1105 bytes} [Fri Sep 23 01:07:58 2022] GET /identity/v3/services/image => generated 86 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:07:58.600816 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e66a4-d7fa-4c31-8851-1324e5ccd2c5 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:58.604726 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1359ed-acc1-4f7f-9944-5cf190ad9d10 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:58.654057 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:58.670426 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80c75a-2f68-475d-bccd-3817ac8b63cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:58.671439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80c75a-2f68-475d-bccd-3817ac8b63cf None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:58.671893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80c75a-2f68-475d-bccd-3817ac8b63cf None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:58.672887 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80c75a-2f68-475d-bccd-3817ac8b63cf None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:58.673061 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80c75a-2f68-475d-bccd-3817ac8b63cf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:58.673297 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80c75a-2f68-475d-bccd-3817ac8b63cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:58.676339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80c75a-2f68-475d-bccd-3817ac8b63cf None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:58.692215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 522/1031] 10.222.0.83 () {56 vars in 1115 bytes} [Fri Sep 23 01:07:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:58.700334 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80c75a-2f68-475d-bccd-3817ac8b63cf None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:58.789246 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e66a4-d7fa-4c31-8851-1324e5ccd2c5 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:58.860477 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c28a4-e0c2-43b2-89b2-545d1de7c700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:58.861363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c28a4-e0c2-43b2-89b2-545d1de7c700 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:58.861783 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c28a4-e0c2-43b2-89b2-545d1de7c700 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:58.862220 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c28a4-e0c2-43b2-89b2-545d1de7c700 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:58.863430 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c28a4-e0c2-43b2-89b2-545d1de7c700 None admin] RBAC: Adding query filter params (name=image) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:58.863912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c28a4-e0c2-43b2-89b2-545d1de7c700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:58.866315 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c28a4-e0c2-43b2-89b2-545d1de7c700 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:58.870198 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:58.877917 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 510/1032] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:58.888134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c28a4-e0c2-43b2-89b2-545d1de7c700 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:58.905469 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80c75a-2f68-475d-bccd-3817ac8b63cf None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:58.979244 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8764b-2eaf-4031-b20e-66ec3b152d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:58.979915 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8764b-2eaf-4031-b20e-66ec3b152d50 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:58.980368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8764b-2eaf-4031-b20e-66ec3b152d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:58.980818 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8764b-2eaf-4031-b20e-66ec3b152d50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:58.999422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8764b-2eaf-4031-b20e-66ec3b152d50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:59.001912 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8764b-2eaf-4031-b20e-66ec3b152d50 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:59.036881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-45b8764b-2eaf-4031-b20e-66ec3b152d50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:59.036881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:59.036881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:59.036881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:59.036881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:59.036881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:59.036881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:59.036881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:59.036881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:59.036881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:59.036881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:59.036881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:59.036881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:07:59.036881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:07:59.036881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:07:59.036881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:07:59.038018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:59.038018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:59.038018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:59.038018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:59.038018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:59.038018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:59.038018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:59.038018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:59.038018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:59.038018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:59.038018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:59.038018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:59.038018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:59.038018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:59.038018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:59.038018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:59.038018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:07:59.039925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:07:59.039925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:07:59.039925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:59.039925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 523/1033] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:07:59.046634 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8764b-2eaf-4031-b20e-66ec3b152d50 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:59.078212 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c28a4-e0c2-43b2-89b2-545d1de7c700 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:59.120496 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:59.136598 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3fd76-3c36-4708-88b1-700db911594d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:59.137396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3fd76-3c36-4708-88b1-700db911594d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:59.137740 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3fd76-3c36-4708-88b1-700db911594d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:59.138018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3fd76-3c36-4708-88b1-700db911594d None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:59.139020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3fd76-3c36-4708-88b1-700db911594d None admin] RBAC: Adding query filter params (type=image) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:59.142415 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3fd76-3c36-4708-88b1-700db911594d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:59.142415 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3fd76-3c36-4708-88b1-700db911594d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:59.151557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 511/1034] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:07:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:59.161594 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3fd76-3c36-4708-88b1-700db911594d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:59.198825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8764b-2eaf-4031-b20e-66ec3b152d50 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:59.241053 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68a64-cc14-47c0-b915-f4010ba0b988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:59.241704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68a64-cc14-47c0-b915-f4010ba0b988 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:59.242003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68a64-cc14-47c0-b915-f4010ba0b988 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:59.242280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68a64-cc14-47c0-b915-f4010ba0b988 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:59.243051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe68a64-cc14-47c0-b915-f4010ba0b988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:59.243354 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe68a64-cc14-47c0-b915-f4010ba0b988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:59.244755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe68a64-cc14-47c0-b915-f4010ba0b988 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:59.259634 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 524/1035] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:07:59.266122 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68a64-cc14-47c0-b915-f4010ba0b988 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:59.289330 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:59.349220 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3fd76-3c36-4708-88b1-700db911594d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:59.406210 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b706c7-7d2d-46ec-8385-4acba01512c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:59.406957 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b706c7-7d2d-46ec-8385-4acba01512c5 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:59.407644 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b706c7-7d2d-46ec-8385-4acba01512c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:59.407925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b706c7-7d2d-46ec-8385-4acba01512c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:59.408908 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b706c7-7d2d-46ec-8385-4acba01512c5 None admin] RBAC: Adding query filter params (interface=public, service_id=a1de43bfa7514102abb679a2052c9e53, region_id=RegionOne) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:59.409052 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b706c7-7d2d-46ec-8385-4acba01512c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:59.410771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b706c7-7d2d-46ec-8385-4acba01512c5 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:59.416705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 512/1036] 10.222.0.83 () {56 vars in 1251 bytes} [Fri Sep 23 01:07:59 2022] GET /identity/v3/endpoints?service_id=a1de43bfa7514102abb679a2052c9e53&interface=public®ion_id=RegionOne => generated 194 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:59.421216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:59.422686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b706c7-7d2d-46ec-8385-4acba01512c5 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:59.427982 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68a64-cc14-47c0-b915-f4010ba0b988 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:59.485634 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bbe13-e97e-44d5-a2f6-d1f044ed3e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:59.486598 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bbe13-e97e-44d5-a2f6-d1f044ed3e4e None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:59.487019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bbe13-e97e-44d5-a2f6-d1f044ed3e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:59.488002 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bbe13-e97e-44d5-a2f6-d1f044ed3e4e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:59.500066 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bbe13-e97e-44d5-a2f6-d1f044ed3e4e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:59.502443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bbe13-e97e-44d5-a2f6-d1f044ed3e4e None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:59.522285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-410bbe13-e97e-44d5-a2f6-d1f044ed3e4e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 01:07:59.522285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:07:59.522285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:07:59.522285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:07:59.522285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:07:59.522285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:07:59.522285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:07:59.522285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:07:59.522285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:07:59.522285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:07:59.522285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:07:59.522285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:07:59.522285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:07:59.522285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:07:59.522285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:07:59.522285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:07:59.524343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:07:59.524343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:07:59.524343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:07:59.524343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:59.524343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:07:59.524343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:07:59.524343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:07:59.524343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:07:59.524343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:07:59.524343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:07:59.524343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:07:59.524343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:07:59.524343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:07:59.524343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:07:59.524343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:07:59.524343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:07:59.524343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:07:59.524343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:07:59.526502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:07:59.526502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:07:59.526502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:07:59.526502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:07:59.526502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:07:59.526502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:07:59.526502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:07:59.526502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:07:59.526502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 01:07:59.526502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:07:59.528331 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 525/1037] 10.222.0.83 () {56 vars in 1093 bytes} [Fri Sep 23 01:07:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:07:59.529770 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bbe13-e97e-44d5-a2f6-d1f044ed3e4e None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:59.585621 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b706c7-7d2d-46ec-8385-4acba01512c5 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:59.632439 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:07:59.647867 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa177f5a-937d-4736-af18-281e538700f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:59.648887 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa177f5a-937d-4736-af18-281e538700f9 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:59.649383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa177f5a-937d-4736-af18-281e538700f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:59.649875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa177f5a-937d-4736-af18-281e538700f9 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:59.651105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa177f5a-937d-4736-af18-281e538700f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:59.653843 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa177f5a-937d-4736-af18-281e538700f9 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:59.678958 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 513/1038] 10.222.0.83 () {56 vars in 1087 bytes} [Fri Sep 23 01:07:59 2022] GET /identity/v3/services => generated 1957 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:07:59.710613 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bbe13-e97e-44d5-a2f6-d1f044ed3e4e None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:07:59.767627 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c274c2d-6582-4f91-b0b2-e17aa1b9cf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:07:59.768365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c274c2d-6582-4f91-b0b2-e17aa1b9cf35 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:07:59.768721 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c274c2d-6582-4f91-b0b2-e17aa1b9cf35 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:07:59.769014 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c274c2d-6582-4f91-b0b2-e17aa1b9cf35 None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:07:59.769907 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c274c2d-6582-4f91-b0b2-e17aa1b9cf35 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:07:59.770282 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c274c2d-6582-4f91-b0b2-e17aa1b9cf35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:07:59.771922 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c274c2d-6582-4f91-b0b2-e17aa1b9cf35 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:07:59.797555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 526/1039] 10.222.0.83 () {56 vars in 1133 bytes} [Fri Sep 23 01:07:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:07:59.804891 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa177f5a-937d-4736-af18-281e538700f9 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:07:59.961591 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa177f5a-937d-4736-af18-281e538700f9 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:00.010355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bbebe-e666-4219-9ef8-3aea1f41278e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:00.011331 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bbebe-e666-4219-9ef8-3aea1f41278e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:00.011763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bbebe-e666-4219-9ef8-3aea1f41278e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:00.012215 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bbebe-e666-4219-9ef8-3aea1f41278e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:00.093199 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:00.103995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852bbebe-e666-4219-9ef8-3aea1f41278e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:00.105962 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852bbebe-e666-4219-9ef8-3aea1f41278e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:00.238791 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 514/1040] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:07:59 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 23 01:08:00.240857 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c274c2d-6582-4f91-b0b2-e17aa1b9cf35 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:00.276930 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:00.382367 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c274c2d-6582-4f91-b0b2-e17aa1b9cf35 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:00.428486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0fcbc-7ced-45b2-931e-ef7c5d3fa15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:00.429505 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0fcbc-7ced-45b2-931e-ef7c5d3fa15d None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:00.429961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0fcbc-7ced-45b2-931e-ef7c5d3fa15d None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:00.430416 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0fcbc-7ced-45b2-931e-ef7c5d3fa15d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:00.453455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0fcbc-7ced-45b2-931e-ef7c5d3fa15d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:00.456231 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0fcbc-7ced-45b2-931e-ef7c5d3fa15d None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:00.486216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-5ac0fcbc-7ced-45b2-931e-ef7c5d3fa15d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:08:00.486216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:00.486216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:00.486216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:00.486216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:00.486216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:00.486216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:00.486216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:00.486216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:00.486216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:00.486216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:00.486216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:00.486216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:08:00.486216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:08:00.486216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:08:00.486216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:08:00.488559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:00.488559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:00.488559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:00.488559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:00.488559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:00.488559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:00.488559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:00.488559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:00.488559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:00.488559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:00.488559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:00.488559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:00.488559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:00.488559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:00.488559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:00.488559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:00.488559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:08:00.489503 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:08:00.489503 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:08:00.489503 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:08:00.489503 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 527/1041] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:08:00.496677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bbebe-e666-4219-9ef8-3aea1f41278e None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:00.671100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:00.685175 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bbebe-e666-4219-9ef8-3aea1f41278e None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:00.736589 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd398c69-aa3d-44ce-b5c9-673f9dec174c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:00.737388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd398c69-aa3d-44ce-b5c9-673f9dec174c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:00.738221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd398c69-aa3d-44ce-b5c9-673f9dec174c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:00.738553 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd398c69-aa3d-44ce-b5c9-673f9dec174c None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:00.739255 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd398c69-aa3d-44ce-b5c9-673f9dec174c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:00.739737 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd398c69-aa3d-44ce-b5c9-673f9dec174c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:00.741078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd398c69-aa3d-44ce-b5c9-673f9dec174c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:00.764751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 515/1042] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:00.766322 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0fcbc-7ced-45b2-931e-ef7c5d3fa15d None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:00.845763 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:00.903422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0fcbc-7ced-45b2-931e-ef7c5d3fa15d None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:00.951211 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0e91a-1dab-4bb3-91e4-04b7e08bef3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:00.951956 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0e91a-1dab-4bb3-91e4-04b7e08bef3e None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:00.952228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0e91a-1dab-4bb3-91e4-04b7e08bef3e None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:00.952511 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0e91a-1dab-4bb3-91e4-04b7e08bef3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:00.961446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0e91a-1dab-4bb3-91e4-04b7e08bef3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:00.963161 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0e91a-1dab-4bb3-91e4-04b7e08bef3e None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:00.981502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-cbc0e91a-1dab-4bb3-91e4-04b7e08bef3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:08:00.981502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:00.981502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:00.981502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:00.981502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:00.981502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:00.981502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:00.981502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:00.981502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:00.981502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:00.981502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:00.981502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:00.981502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:08:00.981502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:08:00.981502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:08:00.983270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:08:00.983270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:00.983270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:00.983270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:00.983270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:00.983270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:00.983270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:00.983270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:00.983270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:00.983270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:00.983270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:00.983270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:00.983270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:00.983270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:00.983270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:00.983270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:00.983270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:00.984570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:08:00.984570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:08:00.984570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:08:00.984570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:08:00.984570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:08:00.984570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:08:00.984570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:08:00.984570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:08:00.984570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 528/1043] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:08:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:08:00.989589 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd398c69-aa3d-44ce-b5c9-673f9dec174c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:01.077253 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a3075-185b-4f47-a706-6ce63c56f00e None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:01.077542 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a3075-185b-4f47-a706-6ce63c56f00e None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:01.077852 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a3075-185b-4f47-a706-6ce63c56f00e None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:01.079679 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 529/1044] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:08:01.086631 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e019fcd-2d52-4c6c-912a-3534bcba6393 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:01.087209 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e019fcd-2d52-4c6c-912a-3534bcba6393 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:01.087697 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e019fcd-2d52-4c6c-912a-3534bcba6393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:01.118210 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-8e019fcd-2d52-4c6c-912a-3534bcba6393 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:01.120337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-8e019fcd-2d52-4c6c-912a-3534bcba6393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:01.130180 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd398c69-aa3d-44ce-b5c9-673f9dec174c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:01.196004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b4e25-5826-4eb0-90ce-76e116d2d3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:01.197047 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b4e25-5826-4eb0-90ce-76e116d2d3bc None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:01.197550 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b4e25-5826-4eb0-90ce-76e116d2d3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:01.198088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b4e25-5826-4eb0-90ce-76e116d2d3bc None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:01.199664 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b4e25-5826-4eb0-90ce-76e116d2d3bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:01.200230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b4e25-5826-4eb0-90ce-76e116d2d3bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:01.203084 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b4e25-5826-4eb0-90ce-76e116d2d3bc None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:01.218752 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 516/1045] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:08:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:08:01.224122 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 530/1046] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 01:08:01.228710 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b4e25-5826-4eb0-90ce-76e116d2d3bc None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:01.248893 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:01.377718 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b4e25-5826-4eb0-90ce-76e116d2d3bc None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:01.427186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e04d43-d089-46fe-8d5f-c61dac7114b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:01.427985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e04d43-d089-46fe-8d5f-c61dac7114b7 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:01.428401 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e04d43-d089-46fe-8d5f-c61dac7114b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:01.428847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e04d43-d089-46fe-8d5f-c61dac7114b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:01.429739 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e04d43-d089-46fe-8d5f-c61dac7114b7 None admin] RBAC: Adding query filter params (role.id=186fd04868e2437abf77f8ffdeec44a5, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=824648d693af4b44ae5df853a3d258f5) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:01.430226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e04d43-d089-46fe-8d5f-c61dac7114b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:01.431902 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e04d43-d089-46fe-8d5f-c61dac7114b7 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:01.439575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 517/1047] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:08:01 2022] GET /identity/v3/role_assignments?user.id=824648d693af4b44ae5df853a3d258f5&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=186fd04868e2437abf77f8ffdeec44a5 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:01.525380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e019fcd-2d52-4c6c-912a-3534bcba6393 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:01.608187 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:01.693448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e019fcd-2d52-4c6c-912a-3534bcba6393 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:01.746799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a75ab-3c99-4a8f-b34c-00d034ef2a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:01.747455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a75ab-3c99-4a8f-b34c-00d034ef2a1a None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:01.747729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a75ab-3c99-4a8f-b34c-00d034ef2a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:01.747993 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a75ab-3c99-4a8f-b34c-00d034ef2a1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:01.760701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a75ab-3c99-4a8f-b34c-00d034ef2a1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:08:01.765701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-067a75ab-3c99-4a8f-b34c-00d034ef2a1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:08:01.765701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:01.765701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:01.765701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:01.765701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:01.765701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:01.765701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:01.765701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:01.765701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:01.765701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:01.765701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:01.765701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:01.765701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:08:01.765701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:08:01.765701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:08:01.765701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:08:01.767789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:08:01.767789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:08:01.767789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:08:01.767789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:08:01.767789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:01.767789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:01.767789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:01.767789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:01.767789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:01.767789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:01.767789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:01.767789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:01.767789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:01.767789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:01.767789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:01.767789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:01.769516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:01.769516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:01.769516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:01.769516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:01.769516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:08:01.769516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:08:01.769516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:08:01.769516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:08:01.769516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:08:01.769516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:08:01.769516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:08:01.769516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:08:01.772143 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 531/1048] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:08:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:08:01.775067 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e04d43-d089-46fe-8d5f-c61dac7114b7 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:01.879419 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:01.916361 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e04d43-d089-46fe-8d5f-c61dac7114b7 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:01.961455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3de1d-0a19-4627-8986-09407b94172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:01.962045 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3de1d-0a19-4627-8986-09407b94172b None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:01.962314 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3de1d-0a19-4627-8986-09407b94172b None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:01.962636 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3de1d-0a19-4627-8986-09407b94172b None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:01.963487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3de1d-0a19-4627-8986-09407b94172b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:01.965608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3de1d-0a19-4627-8986-09407b94172b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:01.967422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3de1d-0a19-4627-8986-09407b94172b None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:01.981423 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 518/1049] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:08:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:08:01.989025 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a75ab-3c99-4a8f-b34c-00d034ef2a1a None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:02.140411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a75ab-3c99-4a8f-b34c-00d034ef2a1a None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:02.173627 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:02.207914 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda179ca-8176-4d8c-a4c7-df021e8e3032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:02.209038 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda179ca-8176-4d8c-a4c7-df021e8e3032 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:02.209528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda179ca-8176-4d8c-a4c7-df021e8e3032 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:02.210064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda179ca-8176-4d8c-a4c7-df021e8e3032 None admin] PATH_INFO: `/v3/users/e5ee79f2bab84590a2bf44c13c514675` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:02.242473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda179ca-8176-4d8c-a4c7-df021e8e3032 None admin] RBAC: Authorizing `identity:get_user(user_id=e5ee79f2bab84590a2bf44c13c514675)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:02.245293 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda179ca-8176-4d8c-a4c7-df021e8e3032 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:02.254646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 532/1050] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:08:01 2022] GET /identity/v3/users/e5ee79f2bab84590a2bf44c13c514675 => generated 285 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:02.259964 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3de1d-0a19-4627-8986-09407b94172b None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:02.396474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3de1d-0a19-4627-8986-09407b94172b None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:02.438565 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c74fb-231d-49e5-8b8c-982fff4c059d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:02.439229 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c74fb-231d-49e5-8b8c-982fff4c059d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:02.439501 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c74fb-231d-49e5-8b8c-982fff4c059d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:02.439768 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c74fb-231d-49e5-8b8c-982fff4c059d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:02.450978 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:02.531807 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c74fb-231d-49e5-8b8c-982fff4c059d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:02.533376 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c74fb-231d-49e5-8b8c-982fff4c059d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:02.680760 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda90bb0-e0c7-4956-b62a-3556641ca6e2 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:02.681507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda90bb0-e0c7-4956-b62a-3556641ca6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:02.681825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda90bb0-e0c7-4956-b62a-3556641ca6e2 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:02.684332 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 533/1051] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:08:02.691614 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8875882-009c-48ab-a7d9-9190dc70866b None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:02.691898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8875882-009c-48ab-a7d9-9190dc70866b None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:02.692175 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8875882-009c-48ab-a7d9-9190dc70866b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:02.698271 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 519/1052] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:08:02 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 01:08:02.708301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c74fb-231d-49e5-8b8c-982fff4c059d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:02.715859 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-c8875882-009c-48ab-a7d9-9190dc70866b None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:02.717931 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-c8875882-009c-48ab-a7d9-9190dc70866b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:02.762017 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:02.843724 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 534/1053] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 01:08:02.894661 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c74fb-231d-49e5-8b8c-982fff4c059d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:02.947964 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43b449-1718-4bbd-b3b3-2c4c1e999f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:02.949342 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43b449-1718-4bbd-b3b3-2c4c1e999f01 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:02.949936 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43b449-1718-4bbd-b3b3-2c4c1e999f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:02.950455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43b449-1718-4bbd-b3b3-2c4c1e999f01 None admin] PATH_INFO: `/v3/projects/87fe861ea4e54eb2bee36726fea74e36` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:02.951950 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43b449-1718-4bbd-b3b3-2c4c1e999f01 None admin] RBAC: Authorizing `identity:get_project(project_id=87fe861ea4e54eb2bee36726fea74e36)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:02.953635 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43b449-1718-4bbd-b3b3-2c4c1e999f01 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:02.960586 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 520/1054] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:08:02 2022] GET /identity/v3/projects/87fe861ea4e54eb2bee36726fea74e36 => generated 311 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:08:02.962903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8875882-009c-48ab-a7d9-9190dc70866b None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:03.128002 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8875882-009c-48ab-a7d9-9190dc70866b None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:03.139391 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:03.147686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43b449-1718-4bbd-b3b3-2c4c1e999f01 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:03.176499 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9f471-26ba-448b-9431-52e5e4fab51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:03.319318 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9f471-26ba-448b-9431-52e5e4fab51c None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:03.319318 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9f471-26ba-448b-9431-52e5e4fab51c None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:03.319318 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9f471-26ba-448b-9431-52e5e4fab51c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:03.319318 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9f471-26ba-448b-9431-52e5e4fab51c None admin] RBAC: Adding query filter params (role.id=d365054bc34046c5829cd1355f3a31ac, scope.project.id=87fe861ea4e54eb2bee36726fea74e36, user.id=e5ee79f2bab84590a2bf44c13c514675) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:03.319318 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9f471-26ba-448b-9431-52e5e4fab51c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:03.319318 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9f471-26ba-448b-9431-52e5e4fab51c None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:03.320198 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 535/1055] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:08:02 2022] GET /identity/v3/role_assignments?user.id=e5ee79f2bab84590a2bf44c13c514675&scope.project.id=87fe861ea4e54eb2bee36726fea74e36&role.id=d365054bc34046c5829cd1355f3a31ac => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:03.371076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43b449-1718-4bbd-b3b3-2c4c1e999f01 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:03.386274 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:03.436723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e9b9c-1725-48f4-915f-59f3ef14fb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:03.437578 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e9b9c-1725-48f4-915f-59f3ef14fb2b None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:03.437989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e9b9c-1725-48f4-915f-59f3ef14fb2b None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:03.438392 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e9b9c-1725-48f4-915f-59f3ef14fb2b None admin] PATH_INFO: `/v3/services/image` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:03.439285 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e9b9c-1725-48f4-915f-59f3ef14fb2b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:03.441446 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e9b9c-1725-48f4-915f-59f3ef14fb2b None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:03.453144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-191e9b9c-1725-48f4-915f-59f3ef14fb2b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 01:08:03.453144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:03.453144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:08:03.453144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:08:03.453144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:08:03.453144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:08:03.453144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:08:03.453144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:08:03.453144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 01:08:03.453144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:08:03.453144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:08:03.453144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:08:03.453144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:03.453144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:03.453144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:03.453144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:03.453144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:03.459379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:03.459379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:03.459379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:03.459379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:03.459379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:03.459379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:03.459379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:08:03.459379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:08:03.459379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:08:03.459379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:08:03.459379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:03.459379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:03.459379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:03.459379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:03.459379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:03.459379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:03.460309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:03.460309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:03.460309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:03.460309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:03.460309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:03.460309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:03.460309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:03.460309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:03.460309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:03.460309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:03.460309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:08:03.460309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:08:03.460309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 01:08:03.460309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:08:03.460309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 521/1056] 10.222.0.83 () {56 vars in 1105 bytes} [Fri Sep 23 01:08:03 2022] GET /identity/v3/services/image => generated 86 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:08:03.465874 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9f471-26ba-448b-9431-52e5e4fab51c None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:03.616768 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9f471-26ba-448b-9431-52e5e4fab51c None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:03.659119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad2e2f-8240-43b9-b713-7f623416673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:03.660289 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad2e2f-8240-43b9-b713-7f623416673c None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:03.660649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad2e2f-8240-43b9-b713-7f623416673c None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:03.660997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad2e2f-8240-43b9-b713-7f623416673c None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:03.661787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad2e2f-8240-43b9-b713-7f623416673c None admin] RBAC: Adding query filter params (name=image) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:03.662088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad2e2f-8240-43b9-b713-7f623416673c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:03.663670 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad2e2f-8240-43b9-b713-7f623416673c None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:03.674511 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 536/1057] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:08:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:03.675707 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e9b9c-1725-48f4-915f-59f3ef14fb2b None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:03.803591 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e9b9c-1725-48f4-915f-59f3ef14fb2b None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:03.843545 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934db9a-03ef-45a9-b076-a7bd7394f61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:03.843802 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934db9a-03ef-45a9-b076-a7bd7394f61e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:03.844205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934db9a-03ef-45a9-b076-a7bd7394f61e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:03.847729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934db9a-03ef-45a9-b076-a7bd7394f61e None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:03.847729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934db9a-03ef-45a9-b076-a7bd7394f61e None admin] RBAC: Adding query filter params (type=image) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:03.847729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934db9a-03ef-45a9-b076-a7bd7394f61e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:03.847729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934db9a-03ef-45a9-b076-a7bd7394f61e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:03.858277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 522/1058] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:08:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:08:03.859592 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad2e2f-8240-43b9-b713-7f623416673c None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:03.906549 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:04.004314 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad2e2f-8240-43b9-b713-7f623416673c None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:04.062213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0134d0-7a0d-4fad-ab88-21e4bba191c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:04.063379 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0134d0-7a0d-4fad-ab88-21e4bba191c5 None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:04.063758 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0134d0-7a0d-4fad-ab88-21e4bba191c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:04.064243 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0134d0-7a0d-4fad-ab88-21e4bba191c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:04.065482 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0134d0-7a0d-4fad-ab88-21e4bba191c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:04.068490 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0134d0-7a0d-4fad-ab88-21e4bba191c5 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:04.138764 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824fbf8-13cf-4532-b4dc-13a46e705214 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:04.139383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824fbf8-13cf-4532-b4dc-13a46e705214 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:04.139383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824fbf8-13cf-4532-b4dc-13a46e705214 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:04.142212 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 523/1059] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:08:04.150886 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ed01e-1ce5-486d-96ec-d133487b2971 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:04.151327 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ed01e-1ce5-486d-96ec-d133487b2971 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:04.151671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ed01e-1ce5-486d-96ec-d133487b2971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:04.172630 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-8f8ed01e-1ce5-486d-96ec-d133487b2971 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:04.174017 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-8f8ed01e-1ce5-486d-96ec-d133487b2971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:04.192110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 537/1060] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:08:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:08:04.222311 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:04.296396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 524/1061] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 01:08:04.583407 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0134d0-7a0d-4fad-ab88-21e4bba191c5 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:04.712468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:04.724947 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0134d0-7a0d-4fad-ab88-21e4bba191c5 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:04.764903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682681d-1650-4e71-bf62-81bb71029f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:04.769232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682681d-1650-4e71-bf62-81bb71029f64 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:04.769232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682681d-1650-4e71-bf62-81bb71029f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:04.769232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682681d-1650-4e71-bf62-81bb71029f64 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:04.779286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682681d-1650-4e71-bf62-81bb71029f64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:08:04.785219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-e682681d-1650-4e71-bf62-81bb71029f64 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 01:08:04.785219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:04.785219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:04.785219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:04.785219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:04.785219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:04.785219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:04.785219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:04.785219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:04.785219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:04.785219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:04.785219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:04.785219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:08:04.785219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:08:04.785219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:08:04.785219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:08:04.786439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:08:04.786439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:08:04.786439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:08:04.786439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:08:04.786439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:04.786439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:04.786439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:04.786439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:04.786439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:04.786439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:04.786439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:04.786439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:04.786439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:04.786439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:04.786439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:04.786439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:04.792178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:04.792178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:04.792178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:04.792178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:04.792178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:08:04.792178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:08:04.792178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:08:04.792178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:08:04.792178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:08:04.792178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:08:04.792178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 01:08:04.792178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:08:04.792178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 538/1062] 10.222.0.83 () {56 vars in 1120 bytes} [Fri Sep 23 01:08:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:08:04.793706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ed01e-1ce5-486d-96ec-d133487b2971 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:04.925394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ed01e-1ce5-486d-96ec-d133487b2971 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:04.975584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c31a7-df3b-4953-a399-f7c1d9182c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:04.976639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c31a7-df3b-4953-a399-f7c1d9182c17 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:04.977114 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c31a7-df3b-4953-a399-f7c1d9182c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:04.977586 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c31a7-df3b-4953-a399-f7c1d9182c17 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:04.978829 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c31a7-df3b-4953-a399-f7c1d9182c17 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:04.979376 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c31a7-df3b-4953-a399-f7c1d9182c17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:04.981968 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c31a7-df3b-4953-a399-f7c1d9182c17 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:05.002723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 525/1063] 10.222.0.83 () {56 vars in 1115 bytes} [Fri Sep 23 01:08:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:05.005959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682681d-1650-4e71-bf62-81bb71029f64 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:05.165745 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682681d-1650-4e71-bf62-81bb71029f64 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:05.215242 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695df8f-12d4-49f8-a7b5-5de72b1d68f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:05.216494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695df8f-12d4-49f8-a7b5-5de72b1d68f8 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:05.217007 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695df8f-12d4-49f8-a7b5-5de72b1d68f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:05.217520 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695df8f-12d4-49f8-a7b5-5de72b1d68f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:05.231087 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695df8f-12d4-49f8-a7b5-5de72b1d68f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:05.233165 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695df8f-12d4-49f8-a7b5-5de72b1d68f8 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:05.252446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-d695df8f-12d4-49f8-a7b5-5de72b1d68f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:08:05.252446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:05.252446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:05.252446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:05.252446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:05.252446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:05.252446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:05.252446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:05.252446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:05.252446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:05.252446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:05.252446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:05.252446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:08:05.252446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:08:05.252446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:08:05.252446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:08:05.254124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:05.254124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:05.254124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:05.254124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:05.254124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:05.254124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:05.254124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:05.254124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:05.254124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:05.254124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:05.254124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:05.254124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:05.254124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:05.254124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:05.254124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:05.254124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:05.254124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:08:05.255102 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:08:05.255102 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:08:05.255102 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:08:05.262492 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 539/1064] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:08:05.264410 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c31a7-df3b-4953-a399-f7c1d9182c17 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:05.297184 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:05.397764 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c31a7-df3b-4953-a399-f7c1d9182c17 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:05.442413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1817aa8-38f5-4e2b-8f38-ea0ab636d5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:05.443629 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1817aa8-38f5-4e2b-8f38-ea0ab636d5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:05.444159 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1817aa8-38f5-4e2b-8f38-ea0ab636d5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:05.444634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1817aa8-38f5-4e2b-8f38-ea0ab636d5f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:05.445556 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1817aa8-38f5-4e2b-8f38-ea0ab636d5f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:05.446145 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1817aa8-38f5-4e2b-8f38-ea0ab636d5f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:05.447857 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1817aa8-38f5-4e2b-8f38-ea0ab636d5f9 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:05.471331 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 526/1065] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:05.482913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695df8f-12d4-49f8-a7b5-5de72b1d68f8 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:05.487266 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:05.653378 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedaf96-bf12-43a8-a932-aa54da0ba5f3 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:05.653819 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedaf96-bf12-43a8-a932-aa54da0ba5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:05.654150 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedaf96-bf12-43a8-a932-aa54da0ba5f3 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:05.655793 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 527/1066] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:08:05.664178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f042757-0868-4fb1-b5b1-9b8f958f16fa None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:05.664731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f042757-0868-4fb1-b5b1-9b8f958f16fa None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:05.665289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f042757-0868-4fb1-b5b1-9b8f958f16fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:05.695245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695df8f-12d4-49f8-a7b5-5de72b1d68f8 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:05.702887 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-0f042757-0868-4fb1-b5b1-9b8f958f16fa None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:05.704947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-0f042757-0868-4fb1-b5b1-9b8f958f16fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:05.758428 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f730e3c-9db1-42cc-bcb6-90e652cca0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:05.759109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f730e3c-9db1-42cc-bcb6-90e652cca0af None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:05.759388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f730e3c-9db1-42cc-bcb6-90e652cca0af None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:05.759666 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f730e3c-9db1-42cc-bcb6-90e652cca0af None admin] PATH_INFO: `/v3/users/nova` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:05.769859 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f730e3c-9db1-42cc-bcb6-90e652cca0af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:05.773010 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f730e3c-9db1-42cc-bcb6-90e652cca0af None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:05.786949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-0f730e3c-9db1-42cc-bcb6-90e652cca0af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 01:08:05.786949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:05.786949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:05.786949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:05.786949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:05.786949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:05.786949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:05.786949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:05.786949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:05.786949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:05.786949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:05.786949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:05.786949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:08:05.786949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:08:05.786949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:08:05.786949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:08:05.788893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:05.788893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:05.788893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:08:05.788893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:08:05.788893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:08:05.788893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:08:05.788893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:05.788893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:05.788893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:05.788893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:05.788893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:05.788893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:05.788893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:05.788893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:05.788893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:05.788893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:05.788893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:05.788893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:05.789898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:05.789898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:05.789898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:08:05.789898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:08:05.789898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:08:05.789898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:08:05.789898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:08:05.789898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:08:05.789898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 01:08:05.789898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:08:05.789898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 540/1067] 10.222.0.83 () {56 vars in 1093 bytes} [Fri Sep 23 01:08:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:08:05.796815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f730e3c-9db1-42cc-bcb6-90e652cca0af None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:05.834240 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 528/1068] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:08:05.903839 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:05.976974 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f730e3c-9db1-42cc-bcb6-90e652cca0af None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:06.032769 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7b829-14c1-4304-85db-304881375661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:06.033854 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7b829-14c1-4304-85db-304881375661 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:06.033854 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7b829-14c1-4304-85db-304881375661 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:06.034032 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7b829-14c1-4304-85db-304881375661 None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:06.035932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7b829-14c1-4304-85db-304881375661 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:06.036475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7b829-14c1-4304-85db-304881375661 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:06.039269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7b829-14c1-4304-85db-304881375661 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:06.076232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 541/1069] 10.222.0.83 () {56 vars in 1133 bytes} [Fri Sep 23 01:08:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:06.083689 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f042757-0868-4fb1-b5b1-9b8f958f16fa None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:06.108552 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:06.148463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7b829-14c1-4304-85db-304881375661 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:06.252768 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f042757-0868-4fb1-b5b1-9b8f958f16fa None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:06.321684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8486bd4-0294-480f-a52b-848bf0f7c05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:06.324222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8486bd4-0294-480f-a52b-848bf0f7c05e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:06.324357 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7b829-14c1-4304-85db-304881375661 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:06.324459 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8486bd4-0294-480f-a52b-848bf0f7c05e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:06.324459 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8486bd4-0294-480f-a52b-848bf0f7c05e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:06.349077 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8486bd4-0294-480f-a52b-848bf0f7c05e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:06.351601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8486bd4-0294-480f-a52b-848bf0f7c05e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:06.362709 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:06.371832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-b8486bd4-0294-480f-a52b-848bf0f7c05e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:08:06.371832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:06.371832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:06.371832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:06.371832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:06.371832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:06.371832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:06.371832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:06.371832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:06.371832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:06.371832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:06.371832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:06.371832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:08:06.371832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:08:06.371832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:08:06.371832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:08:06.383675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:06.383675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:06.383675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:06.383675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:06.383675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:06.383675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:06.383675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:06.383675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:06.383675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:06.383675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:06.383675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:06.383675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:06.383675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:06.383675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:06.383675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:06.383675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:06.383675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:08:06.385375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:08:06.385375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:08:06.385375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:08:06.385375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 529/1070] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:08:06.385375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8486bd4-0294-480f-a52b-848bf0f7c05e None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:06.398018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34793471-4a2e-4c26-9afd-c18a9de03e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:06.399376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34793471-4a2e-4c26-9afd-c18a9de03e58 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:06.400412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34793471-4a2e-4c26-9afd-c18a9de03e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:06.400412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34793471-4a2e-4c26-9afd-c18a9de03e58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:06.422922 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34793471-4a2e-4c26-9afd-c18a9de03e58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:08:06.430115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-34793471-4a2e-4c26-9afd-c18a9de03e58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:08:06.430115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:06.430115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:06.430115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:06.430115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:06.430115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:06.430115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:06.430115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:06.430115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:06.430115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:06.430115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:06.430115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:06.430115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:08:06.430115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:08:06.430115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:08:06.430115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:08:06.432278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:08:06.432278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:08:06.432278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:08:06.432278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:08:06.432278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:06.432278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:06.432278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:06.432278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:06.432278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:06.432278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:06.432278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:06.432278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:06.432278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:06.432278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:06.432278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:06.432278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:06.433885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:06.433885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:06.433885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:06.433885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:06.433885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:08:06.433885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:08:06.433885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:08:06.433885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:08:06.433885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:08:06.433885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:08:06.433885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:08:06.433885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:08:06.433885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 542/1071] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:08:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:08:06.441581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34793471-4a2e-4c26-9afd-c18a9de03e58 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:06.485227 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:06.548370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8486bd4-0294-480f-a52b-848bf0f7c05e None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:06.600083 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1624382-5462-41e7-8efc-dcf976dd1a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:06.600999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1624382-5462-41e7-8efc-dcf976dd1a59 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:06.601296 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1624382-5462-41e7-8efc-dcf976dd1a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:06.601771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1624382-5462-41e7-8efc-dcf976dd1a59 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:06.602996 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1624382-5462-41e7-8efc-dcf976dd1a59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:06.603498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1624382-5462-41e7-8efc-dcf976dd1a59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:06.604521 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34793471-4a2e-4c26-9afd-c18a9de03e58 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:06.606037 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1624382-5462-41e7-8efc-dcf976dd1a59 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:06.630956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 530/1072] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:06.634456 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1624382-5462-41e7-8efc-dcf976dd1a59 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:06.669575 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b407c-760d-4d54-8bed-5bcac06a526e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:06.670553 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b407c-760d-4d54-8bed-5bcac06a526e None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:06.671058 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b407c-760d-4d54-8bed-5bcac06a526e None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:06.671491 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b407c-760d-4d54-8bed-5bcac06a526e None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:06.672622 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b407c-760d-4d54-8bed-5bcac06a526e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:06.673117 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b407c-760d-4d54-8bed-5bcac06a526e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:06.676617 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b407c-760d-4d54-8bed-5bcac06a526e None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:06.712252 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 543/1073] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:08:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:06.714536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b407c-760d-4d54-8bed-5bcac06a526e None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:06.801457 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:06.822176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1624382-5462-41e7-8efc-dcf976dd1a59 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:06.864870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:06.884965 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db5c3c-25e7-49e4-89d7-13c04c015f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:06.884965 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db5c3c-25e7-49e4-89d7-13c04c015f13 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:06.884965 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db5c3c-25e7-49e4-89d7-13c04c015f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:06.884965 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db5c3c-25e7-49e4-89d7-13c04c015f13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:06.890011 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b407c-760d-4d54-8bed-5bcac06a526e None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:06.893500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db5c3c-25e7-49e4-89d7-13c04c015f13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:06.895718 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db5c3c-25e7-49e4-89d7-13c04c015f13 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:06.911136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-f3db5c3c-25e7-49e4-89d7-13c04c015f13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:08:06.911136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:06.911136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:06.911136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:06.911136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:06.911136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:06.911136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:06.911136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:06.911136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:06.911136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:06.911136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:06.911136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:06.911136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:08:06.911136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:08:06.911136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:08:06.912363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:08:06.912363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:06.912363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:06.912363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:06.912363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:06.912363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:06.912363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:06.912363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:06.912363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:06.912363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:06.912363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:06.912363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:06.912363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:06.912363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:06.912363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:06.912363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:06.912363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:06.913921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:08:06.913921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:08:06.913921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:08:06.913921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:08:06.913921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:08:06.913921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:08:06.913921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:08:06.913921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:08:06.921755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 531/1074] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:08:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:08:06.921755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2122e8-371b-47f4-a919-e194763c3b53 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:06.921755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2122e8-371b-47f4-a919-e194763c3b53 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:06.921755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2122e8-371b-47f4-a919-e194763c3b53 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:06.921755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 532/1075] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:08:06.923529 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2122e8-371b-47f4-a919-e194763c3b53 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:06.937835 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced0c29-70a8-47db-9b9f-608135c92ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:06.938472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced0c29-70a8-47db-9b9f-608135c92ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:06.938777 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced0c29-70a8-47db-9b9f-608135c92ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:06.939081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced0c29-70a8-47db-9b9f-608135c92ed2 None admin] PATH_INFO: `/v3/users/e5ee79f2bab84590a2bf44c13c514675` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:06.940258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced0c29-70a8-47db-9b9f-608135c92ed2 None admin] RBAC: Authorizing `identity:get_user(user_id=e5ee79f2bab84590a2bf44c13c514675)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:06.941716 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced0c29-70a8-47db-9b9f-608135c92ed2 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:06.944481 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 544/1076] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:08:06 2022] GET /identity/v3/users/e5ee79f2bab84590a2bf44c13c514675 => generated 285 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:08:06.946316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98d855-35d8-4da3-9d75-97469479cc34 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:06.946805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98d855-35d8-4da3-9d75-97469479cc34 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:06.947467 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98d855-35d8-4da3-9d75-97469479cc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:06.974001 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-0a98d855-35d8-4da3-9d75-97469479cc34 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:06.976435 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-0a98d855-35d8-4da3-9d75-97469479cc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:07.078264 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 545/1077] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:08:07.079458 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98d855-35d8-4da3-9d75-97469479cc34 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:07.097594 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2122e8-371b-47f4-a919-e194763c3b53 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:07.141524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0cdac-8105-457c-a29a-ff5a57fb949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:07.142637 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0cdac-8105-457c-a29a-ff5a57fb949d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:07.143161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0cdac-8105-457c-a29a-ff5a57fb949d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:07.143333 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0cdac-8105-457c-a29a-ff5a57fb949d None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:07.144522 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0cdac-8105-457c-a29a-ff5a57fb949d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:07.144834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0cdac-8105-457c-a29a-ff5a57fb949d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:07.146435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0cdac-8105-457c-a29a-ff5a57fb949d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:07.158165 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:07.161831 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 533/1078] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:08:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:07.168539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0cdac-8105-457c-a29a-ff5a57fb949d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:07.228428 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:07.281196 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98d855-35d8-4da3-9d75-97469479cc34 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:07.317302 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0cdac-8105-457c-a29a-ff5a57fb949d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:07.352082 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1af6b0-7042-49f7-9fe7-19e6802a2522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:07.352082 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1af6b0-7042-49f7-9fe7-19e6802a2522 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:07.352082 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1af6b0-7042-49f7-9fe7-19e6802a2522 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:07.352082 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1af6b0-7042-49f7-9fe7-19e6802a2522 None admin] PATH_INFO: `/v3/projects/87fe861ea4e54eb2bee36726fea74e36` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:07.352661 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1af6b0-7042-49f7-9fe7-19e6802a2522 None admin] RBAC: Authorizing `identity:get_project(project_id=87fe861ea4e54eb2bee36726fea74e36)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:07.352661 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1af6b0-7042-49f7-9fe7-19e6802a2522 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:07.352661 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 546/1079] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:08:07 2022] GET /identity/v3/projects/87fe861ea4e54eb2bee36726fea74e36 => generated 311 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:07.358149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1af6b0-7042-49f7-9fe7-19e6802a2522 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:07.373420 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b2775-ab4d-45cc-917a-d2f9b1edd7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:07.374337 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b2775-ab4d-45cc-917a-d2f9b1edd7c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:07.374694 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b2775-ab4d-45cc-917a-d2f9b1edd7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:07.374928 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b2775-ab4d-45cc-917a-d2f9b1edd7c4 None admin] PATH_INFO: `/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/824648d693af4b44ae5df853a3d258f5/roles/186fd04868e2437abf77f8ffdeec44a5` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:07.377726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b2775-ab4d-45cc-917a-d2f9b1edd7c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=78d0895fea004a02b1d8338f5fb0250c, user_id=824648d693af4b44ae5df853a3d258f5, role_id=186fd04868e2437abf77f8ffdeec44a5)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:07.380477 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b2775-ab4d-45cc-917a-d2f9b1edd7c4 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:07.520129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 534/1080] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:08:07 2022] PUT /identity/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/824648d693af4b44ae5df853a3d258f5/roles/186fd04868e2437abf77f8ffdeec44a5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:08:07.536374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b2775-ab4d-45cc-917a-d2f9b1edd7c4 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:07.537452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1af6b0-7042-49f7-9fe7-19e6802a2522 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:07.557779 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:07.608437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b335a-a839-454b-8550-00a23f84734a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:07.610639 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b335a-a839-454b-8550-00a23f84734a None admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:07.611088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b335a-a839-454b-8550-00a23f84734a None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:07.611490 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b335a-a839-454b-8550-00a23f84734a None admin] PATH_INFO: `/v3/projects/87fe861ea4e54eb2bee36726fea74e36/users/e5ee79f2bab84590a2bf44c13c514675/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:07.615699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b335a-a839-454b-8550-00a23f84734a None admin] RBAC: Authorizing `identity:create_grant(project_id=87fe861ea4e54eb2bee36726fea74e36, user_id=e5ee79f2bab84590a2bf44c13c514675, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:07.618914 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b335a-a839-454b-8550-00a23f84734a None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:07.726444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b2775-ab4d-45cc-917a-d2f9b1edd7c4 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:07.731417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:07.746831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 547/1081] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:08:07 2022] PUT /identity/v3/projects/87fe861ea4e54eb2bee36726fea74e36/users/e5ee79f2bab84590a2bf44c13c514675/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:08:07.787825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b47bb-f183-43ea-9dfc-3bb6f045d709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:07.788547 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b47bb-f183-43ea-9dfc-3bb6f045d709 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:07.788818 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b47bb-f183-43ea-9dfc-3bb6f045d709 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:07.789178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b47bb-f183-43ea-9dfc-3bb6f045d709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:07.937991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b47bb-f183-43ea-9dfc-3bb6f045d709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:07.940564 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b47bb-f183-43ea-9dfc-3bb6f045d709 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:08.116129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 535/1082] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:08:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 01:08:08.122321 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b335a-a839-454b-8550-00a23f84734a None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:08.298118 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b335a-a839-454b-8550-00a23f84734a None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:08.346907 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c557f2-07e6-4344-bf76-b7b39aaf7ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:08.347626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c557f2-07e6-4344-bf76-b7b39aaf7ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:08.350148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c557f2-07e6-4344-bf76-b7b39aaf7ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:08.350148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c557f2-07e6-4344-bf76-b7b39aaf7ab3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:08.367434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c557f2-07e6-4344-bf76-b7b39aaf7ab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:08.370080 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c557f2-07e6-4344-bf76-b7b39aaf7ab3 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:08.392815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-f7c557f2-07e6-4344-bf76-b7b39aaf7ab3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:08:08.392815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:08.392815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:08.392815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:08.392815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:08.392815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:08.392815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:08.392815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:08.392815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:08.392815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:08.392815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:08.392815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:08.392815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:08:08.392815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:08:08.392815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:08:08.392815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:08:08.394815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:08.394815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:08.394815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:08.394815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:08.394815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:08.394815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:08.394815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:08.394815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:08.394815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:08.394815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:08.394815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:08.394815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:08.394815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:08.394815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:08.394815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:08.394815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:08.394815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:08:08.395955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:08:08.395955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:08:08.395955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:08:08.395955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 548/1083] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:08:08.402573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b47bb-f183-43ea-9dfc-3bb6f045d709 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:08.406984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:08.574800 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b47bb-f183-43ea-9dfc-3bb6f045d709 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:08.617926 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b7873-09f8-4840-a4e4-6972a3229504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:08.619078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b7873-09f8-4840-a4e4-6972a3229504 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:08.619628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b7873-09f8-4840-a4e4-6972a3229504 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:08.620158 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b7873-09f8-4840-a4e4-6972a3229504 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:08.620991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b7873-09f8-4840-a4e4-6972a3229504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:08.621458 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b7873-09f8-4840-a4e4-6972a3229504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:08.623193 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b7873-09f8-4840-a4e4-6972a3229504 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:08.639045 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 536/1084] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:10.655155 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a8a63-98bd-4947-aff3-b11b48abd25f None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:10.656099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a8a63-98bd-4947-aff3-b11b48abd25f None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:10.656099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a8a63-98bd-4947-aff3-b11b48abd25f None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:10.658317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 549/1085] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:08:10.668467 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84c4d0-8112-42ac-a0d8-290ffae26406 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:10.669232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84c4d0-8112-42ac-a0d8-290ffae26406 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:10.669396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84c4d0-8112-42ac-a0d8-290ffae26406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:10.695104 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-5c84c4d0-8112-42ac-a0d8-290ffae26406 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:10.696492 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-5c84c4d0-8112-42ac-a0d8-290ffae26406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:10.759997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede88e4b-2369-4075-ac35-17fd7d177cea None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:10.760390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede88e4b-2369-4075-ac35-17fd7d177cea None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:10.760837 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede88e4b-2369-4075-ac35-17fd7d177cea None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:10.763103 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 550/1086] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:08:10.767432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:10.770285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8e084-8c7d-4c75-b340-3b5b998ac627 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:10.770731 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8e084-8c7d-4c75-b340-3b5b998ac627 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:10.771105 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8e084-8c7d-4c75-b340-3b5b998ac627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:10.780114 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 537/1087] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:08:10.790807 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-a3e8e084-8c7d-4c75-b340-3b5b998ac627 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:10.792033 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a3e8e084-8c7d-4c75-b340-3b5b998ac627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:10.808970 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:10.867937 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 551/1088] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 01:08:11.118875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84c4d0-8112-42ac-a0d8-290ffae26406 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:11.143798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8e084-8c7d-4c75-b340-3b5b998ac627 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:11.240666 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84c4d0-8112-42ac-a0d8-290ffae26406 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:11.261469 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8e084-8c7d-4c75-b340-3b5b998ac627 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:11.278079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dfe47-5d62-4090-928c-e4a1b68ce431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:11.278822 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dfe47-5d62-4090-928c-e4a1b68ce431 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:11.279101 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dfe47-5d62-4090-928c-e4a1b68ce431 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:11.279376 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dfe47-5d62-4090-928c-e4a1b68ce431 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:11.292583 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056dfe47-5d62-4090-928c-e4a1b68ce431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:08:11.298187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-056dfe47-5d62-4090-928c-e4a1b68ce431 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 01:08:11.298187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:11.298187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:11.298187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:11.298187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:11.298187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:11.298187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:11.298187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:11.298187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:11.298187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:11.298187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:11.298187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:11.298187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:08:11.298187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:08:11.298187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:08:11.298187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:08:11.299947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:08:11.299947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:08:11.299947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:08:11.299947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:08:11.299947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:11.299947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:11.299947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:11.299947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:11.299947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:11.299947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:11.299947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:11.299947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:11.299947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:11.299947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:11.299947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:11.299947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:11.301072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:11.301072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:11.301072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:11.301072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:11.301072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:08:11.301072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:08:11.301072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:08:11.301072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:08:11.301072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:08:11.301072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:08:11.301072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 01:08:11.301072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:08:11.301072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 538/1089] 10.222.0.83 () {56 vars in 1120 bytes} [Fri Sep 23 01:08:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:08:11.302473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5618f0-64d5-42ed-b830-82da799afcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:11.303145 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5618f0-64d5-42ed-b830-82da799afcd9 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:11.303424 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5618f0-64d5-42ed-b830-82da799afcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:11.303690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5618f0-64d5-42ed-b830-82da799afcd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:11.305616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dfe47-5d62-4090-928c-e4a1b68ce431 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:11.316033 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5618f0-64d5-42ed-b830-82da799afcd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:08:11.321050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-4e5618f0-64d5-42ed-b830-82da799afcd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:08:11.321050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:11.321050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:11.321050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:11.321050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:11.321050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:11.321050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:11.321050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:11.321050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:11.321050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:11.321050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:11.321050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:11.321050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:08:11.321050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:08:11.321050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:08:11.321050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:08:11.322911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:08:11.322911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:08:11.322911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:08:11.322911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:08:11.322911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:11.322911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:11.322911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:11.322911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:11.322911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:11.322911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:11.322911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:11.322911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:11.322911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:11.322911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:11.322911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:11.322911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:11.324618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:11.324618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:11.324618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:11.324618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:11.324618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:08:11.324618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:08:11.324618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:08:11.324618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:08:11.324618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:08:11.324618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:08:11.324618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:08:11.324618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:08:11.324618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 552/1090] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:08:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:08:11.329159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5618f0-64d5-42ed-b830-82da799afcd9 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:11.345745 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:11.372108 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:11.440391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dfe47-5d62-4090-928c-e4a1b68ce431 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:11.471789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5618f0-64d5-42ed-b830-82da799afcd9 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:11.491538 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b24a80-0a7c-4339-b36a-aac6baa36548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:11.492169 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b24a80-0a7c-4339-b36a-aac6baa36548 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:11.492451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b24a80-0a7c-4339-b36a-aac6baa36548 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:11.492722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b24a80-0a7c-4339-b36a-aac6baa36548 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:11.493400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b24a80-0a7c-4339-b36a-aac6baa36548 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:11.493705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b24a80-0a7c-4339-b36a-aac6baa36548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:11.495163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b24a80-0a7c-4339-b36a-aac6baa36548 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:11.505188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 539/1091] 10.222.0.83 () {56 vars in 1115 bytes} [Fri Sep 23 01:08:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:08:11.511994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b24a80-0a7c-4339-b36a-aac6baa36548 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:11.523508 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c1622-71ac-48b1-a7fa-05df6e8530ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:11.524910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c1622-71ac-48b1-a7fa-05df6e8530ab None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:11.525345 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c1622-71ac-48b1-a7fa-05df6e8530ab None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:11.525770 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c1622-71ac-48b1-a7fa-05df6e8530ab None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:11.527007 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c1622-71ac-48b1-a7fa-05df6e8530ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:11.527529 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c1622-71ac-48b1-a7fa-05df6e8530ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:11.529989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c1622-71ac-48b1-a7fa-05df6e8530ab None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:11.550448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 553/1092] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:08:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:08:11.552856 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c1622-71ac-48b1-a7fa-05df6e8530ab None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:11.619075 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b24a80-0a7c-4339-b36a-aac6baa36548 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:11.643619 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:11.649278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:11.672640 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe088e71-f77d-4d7c-b5e3-035951037b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:11.673588 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe088e71-f77d-4d7c-b5e3-035951037b85 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:11.674577 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe088e71-f77d-4d7c-b5e3-035951037b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:11.674577 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe088e71-f77d-4d7c-b5e3-035951037b85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:11.683418 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c1622-71ac-48b1-a7fa-05df6e8530ab None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:11.692547 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe088e71-f77d-4d7c-b5e3-035951037b85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:11.695071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe088e71-f77d-4d7c-b5e3-035951037b85 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:11.724981 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e10d91-88ba-425a-9645-a9625afdb32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:11.725631 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e10d91-88ba-425a-9645-a9625afdb32f None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:11.725911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e10d91-88ba-425a-9645-a9625afdb32f None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:11.726185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e10d91-88ba-425a-9645-a9625afdb32f None admin] PATH_INFO: `/v3/users/e5ee79f2bab84590a2bf44c13c514675` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:11.727492 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e10d91-88ba-425a-9645-a9625afdb32f None admin] RBAC: Authorizing `identity:get_user(user_id=e5ee79f2bab84590a2bf44c13c514675)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:11.727946 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-fe088e71-f77d-4d7c-b5e3-035951037b85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:08:11.727946 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:11.727946 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:11.727946 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:11.727946 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:11.727946 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:11.727946 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:11.727946 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:11.727946 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:11.727946 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:11.727946 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:11.727946 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:11.727946 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:08:11.727946 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:08:11.727946 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:08:11.727946 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:08:11.728989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:11.728989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:11.728989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:11.728989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:11.728989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:11.728989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:11.728989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:11.728989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:11.728989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:11.728989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:11.728989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:11.728989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:11.728989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:11.728989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:11.728989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:11.728989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:11.728989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:08:11.730248 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:08:11.730248 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:08:11.730248 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:08:11.730684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e10d91-88ba-425a-9645-a9625afdb32f None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:11.730818 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 540/1093] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:08:11.731199 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 554/1094] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:08:11 2022] GET /identity/v3/users/e5ee79f2bab84590a2bf44c13c514675 => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:11.738391 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e10d91-88ba-425a-9645-a9625afdb32f None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:11.738844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe088e71-f77d-4d7c-b5e3-035951037b85 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:11.892660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e10d91-88ba-425a-9645-a9625afdb32f None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:11.896710 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe088e71-f77d-4d7c-b5e3-035951037b85 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:11.941667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af5dad-26bd-4319-9eda-61ac42800ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:11.941932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bcc86-400d-4fc8-a9f7-c120a13b8800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:11.942295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af5dad-26bd-4319-9eda-61ac42800ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:11.942413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bcc86-400d-4fc8-a9f7-c120a13b8800 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:11.942573 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af5dad-26bd-4319-9eda-61ac42800ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:11.942711 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bcc86-400d-4fc8-a9f7-c120a13b8800 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:11.942879 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af5dad-26bd-4319-9eda-61ac42800ac9 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:11.942978 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bcc86-400d-4fc8-a9f7-c120a13b8800 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:11.943546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af5dad-26bd-4319-9eda-61ac42800ac9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:11.943853 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af5dad-26bd-4319-9eda-61ac42800ac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:11.945307 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af5dad-26bd-4319-9eda-61ac42800ac9 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:11.957171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:11.961206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 555/1095] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:11.967245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af5dad-26bd-4319-9eda-61ac42800ac9 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:12.000822 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:12.051987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bcc86-400d-4fc8-a9f7-c120a13b8800 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:12.054164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bcc86-400d-4fc8-a9f7-c120a13b8800 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:12.091049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af5dad-26bd-4319-9eda-61ac42800ac9 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:12.143262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c4c02-8212-4068-8ade-3f6c0e845af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:12.143905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c4c02-8212-4068-8ade-3f6c0e845af1 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:12.144227 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c4c02-8212-4068-8ade-3f6c0e845af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:12.144498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c4c02-8212-4068-8ade-3f6c0e845af1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:12.152548 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c4c02-8212-4068-8ade-3f6c0e845af1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:12.153912 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c4c02-8212-4068-8ade-3f6c0e845af1 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:12.167701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-2c5c4c02-8212-4068-8ade-3f6c0e845af1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 01:08:12.167701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:12.167701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:12.167701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:12.167701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:12.167701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:12.167701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:12.167701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:12.167701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:12.167701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:12.167701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:12.167701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:12.167701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:08:12.167701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:08:12.167701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:08:12.167701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:08:12.176512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:12.176512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:12.176512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:08:12.176512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:08:12.176512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:08:12.176512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:08:12.176512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:12.176512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:12.176512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:12.176512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:12.176512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:12.176512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:12.176512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:12.176512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:12.176512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:12.176512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:12.176512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:12.176512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:12.178179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:12.178179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:12.178179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:08:12.178179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:08:12.178179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:08:12.178179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:08:12.178179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:08:12.178179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:08:12.178179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 01:08:12.178179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:08:12.178179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 556/1096] 10.222.0.83 () {56 vars in 1093 bytes} [Fri Sep 23 01:08:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:08:12.178179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c4c02-8212-4068-8ade-3f6c0e845af1 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:12.187466 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 541/1097] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:08:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 01:08:12.190149 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bcc86-400d-4fc8-a9f7-c120a13b8800 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:12.242173 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:12.266357 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:12.290995 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c4c02-8212-4068-8ade-3f6c0e845af1 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:12.305537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bcc86-400d-4fc8-a9f7-c120a13b8800 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:12.333583 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb128b4c-24ed-4667-bea6-5543414e741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:12.334202 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb128b4c-24ed-4667-bea6-5543414e741f None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:12.334537 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb128b4c-24ed-4667-bea6-5543414e741f None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:12.334844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb128b4c-24ed-4667-bea6-5543414e741f None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:12.335767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb128b4c-24ed-4667-bea6-5543414e741f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:12.336411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb128b4c-24ed-4667-bea6-5543414e741f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:12.337852 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb128b4c-24ed-4667-bea6-5543414e741f None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:12.344766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43c40f-4616-465f-a503-c5f913d0341e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:12.345589 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43c40f-4616-465f-a503-c5f913d0341e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:12.345863 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43c40f-4616-465f-a503-c5f913d0341e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:12.346134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43c40f-4616-465f-a503-c5f913d0341e None admin] PATH_INFO: `/v3/projects/87fe861ea4e54eb2bee36726fea74e36` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:12.348027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43c40f-4616-465f-a503-c5f913d0341e None admin] RBAC: Authorizing `identity:get_project(project_id=87fe861ea4e54eb2bee36726fea74e36)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:12.350475 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43c40f-4616-465f-a503-c5f913d0341e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:12.352231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 542/1098] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:08:12 2022] GET /identity/v3/projects/87fe861ea4e54eb2bee36726fea74e36 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:08:12.357080 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 557/1099] 10.222.0.83 () {56 vars in 1133 bytes} [Fri Sep 23 01:08:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:08:12.359999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43c40f-4616-465f-a503-c5f913d0341e None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:12.363483 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb128b4c-24ed-4667-bea6-5543414e741f None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:12.482792 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb128b4c-24ed-4667-bea6-5543414e741f None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:12.494838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43c40f-4616-465f-a503-c5f913d0341e None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:12.501630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:12.532034 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b7054-8d43-49af-adac-594191d40337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:12.532977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b7054-8d43-49af-adac-594191d40337 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:12.533375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a8d18-f077-48f6-a3ed-8fcce84c87a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:12.533535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b7054-8d43-49af-adac-594191d40337 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:12.533957 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b7054-8d43-49af-adac-594191d40337 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:12.534061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a8d18-f077-48f6-a3ed-8fcce84c87a6 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:12.534236 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a8d18-f077-48f6-a3ed-8fcce84c87a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:12.534501 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a8d18-f077-48f6-a3ed-8fcce84c87a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:12.535293 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a8d18-f077-48f6-a3ed-8fcce84c87a6 None admin] RBAC: Adding query filter params (role.id=d365054bc34046c5829cd1355f3a31ac, scope.project.id=87fe861ea4e54eb2bee36726fea74e36, user.id=e5ee79f2bab84590a2bf44c13c514675) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:12.535593 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a8d18-f077-48f6-a3ed-8fcce84c87a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:12.537036 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a8d18-f077-48f6-a3ed-8fcce84c87a6 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:12.540194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:12.545194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 543/1100] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:08:12 2022] GET /identity/v3/role_assignments?user.id=e5ee79f2bab84590a2bf44c13c514675&scope.project.id=87fe861ea4e54eb2bee36726fea74e36&role.id=d365054bc34046c5829cd1355f3a31ac => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:12.626960 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b7054-8d43-49af-adac-594191d40337 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:12.629151 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b7054-8d43-49af-adac-594191d40337 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:12.763461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 558/1101] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:08:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 23 01:08:12.773111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a8d18-f077-48f6-a3ed-8fcce84c87a6 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:12.930504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a8d18-f077-48f6-a3ed-8fcce84c87a6 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:12.973591 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783bb5f-bde2-47e1-8cc5-41b2d2794d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:12.974252 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783bb5f-bde2-47e1-8cc5-41b2d2794d20 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:12.974530 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783bb5f-bde2-47e1-8cc5-41b2d2794d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:12.974831 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783bb5f-bde2-47e1-8cc5-41b2d2794d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:12.987211 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783bb5f-bde2-47e1-8cc5-41b2d2794d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:12.989253 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783bb5f-bde2-47e1-8cc5-41b2d2794d20 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:13.007093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-c783bb5f-bde2-47e1-8cc5-41b2d2794d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:08:13.007093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:13.007093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:13.007093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:13.007093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:13.007093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:13.007093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:13.007093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:13.007093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:13.007093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:13.007093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:13.007093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:13.007093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:08:13.007093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:08:13.007093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:08:13.007093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:08:13.008858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:13.008858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:13.008858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:13.008858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:13.008858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:13.008858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:13.008858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:13.008858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:13.008858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:13.008858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:13.008858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:13.008858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:13.008858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:13.008858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:13.008858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:13.008858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:13.008858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:08:13.010483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:08:13.010483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:08:13.010483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:08:13.010483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 544/1102] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:08:13.014448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b7054-8d43-49af-adac-594191d40337 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:13.039487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:13.158542 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b7054-8d43-49af-adac-594191d40337 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:13.200373 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90babb51-a0a1-4f9c-bfbe-0ba7266b38d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:13.200990 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90babb51-a0a1-4f9c-bfbe-0ba7266b38d5 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:13.201268 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90babb51-a0a1-4f9c-bfbe-0ba7266b38d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:13.201533 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90babb51-a0a1-4f9c-bfbe-0ba7266b38d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:13.202179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90babb51-a0a1-4f9c-bfbe-0ba7266b38d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:13.202481 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90babb51-a0a1-4f9c-bfbe-0ba7266b38d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:13.203880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90babb51-a0a1-4f9c-bfbe-0ba7266b38d5 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:13.216484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 559/1103] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:08:13.223062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783bb5f-bde2-47e1-8cc5-41b2d2794d20 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:13.280453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:13.336191 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783bb5f-bde2-47e1-8cc5-41b2d2794d20 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:13.380112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876b222-dba5-4f68-9f52-8a85838619f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:13.380746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876b222-dba5-4f68-9f52-8a85838619f5 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:13.381018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876b222-dba5-4f68-9f52-8a85838619f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:13.381298 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876b222-dba5-4f68-9f52-8a85838619f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:13.388525 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876b222-dba5-4f68-9f52-8a85838619f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:13.390230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876b222-dba5-4f68-9f52-8a85838619f5 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:13.403094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-3876b222-dba5-4f68-9f52-8a85838619f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:08:13.403094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:13.403094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:13.403094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:13.403094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:13.403094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:13.403094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:13.403094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:13.403094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:13.403094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:13.403094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:13.403094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:13.403094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:08:13.403094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:08:13.403094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:08:13.404990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:08:13.404990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:13.404990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:13.404990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:13.404990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:13.404990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:13.404990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:13.404990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:13.404990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:13.404990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:13.404990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:13.404990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:13.404990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:13.404990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:13.404990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:13.404990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:13.404990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:13.406950 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:08:13.406950 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:08:13.406950 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:08:13.406950 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:08:13.406950 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:08:13.406950 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:08:13.406950 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:08:13.406950 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:08:13.409472 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 545/1104] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:08:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:08:13.411363 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90babb51-a0a1-4f9c-bfbe-0ba7266b38d5 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:13.518534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:13.543866 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90babb51-a0a1-4f9c-bfbe-0ba7266b38d5 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:13.590407 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d0776-4e12-43fb-839f-1c69bac46662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:13.591462 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d0776-4e12-43fb-839f-1c69bac46662 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:13.591953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d0776-4e12-43fb-839f-1c69bac46662 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:13.592441 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d0776-4e12-43fb-839f-1c69bac46662 None admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:13.593737 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d0776-4e12-43fb-839f-1c69bac46662 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:13.594302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d0776-4e12-43fb-839f-1c69bac46662 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:13.597021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d0776-4e12-43fb-839f-1c69bac46662 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:13.627948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 560/1105] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:08:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:13.629725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876b222-dba5-4f68-9f52-8a85838619f5 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:13.775220 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876b222-dba5-4f68-9f52-8a85838619f5 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:13.791062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:13.816387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fa1c1-0105-47ee-909a-0eaf53f2ea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:13.816924 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fa1c1-0105-47ee-909a-0eaf53f2ea90 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:13.817201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fa1c1-0105-47ee-909a-0eaf53f2ea90 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:13.817469 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fa1c1-0105-47ee-909a-0eaf53f2ea90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:13.818197 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fa1c1-0105-47ee-909a-0eaf53f2ea90 None admin] RBAC: Adding query filter params (role.id=186fd04868e2437abf77f8ffdeec44a5, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=824648d693af4b44ae5df853a3d258f5) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:13.818492 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fa1c1-0105-47ee-909a-0eaf53f2ea90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:13.819982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fa1c1-0105-47ee-909a-0eaf53f2ea90 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:13.826934 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 546/1106] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:08:13 2022] GET /identity/v3/role_assignments?user.id=824648d693af4b44ae5df853a3d258f5&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=186fd04868e2437abf77f8ffdeec44a5 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:15.055650 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823112d-f011-413c-aa98-6bb5df9971a6 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:15.061549 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823112d-f011-413c-aa98-6bb5df9971a6 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:15.061549 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823112d-f011-413c-aa98-6bb5df9971a6 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:15.061549 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 561/1107] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:08:15.063302 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8a0a6-35a9-4d10-88aa-b1520362dd39 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:15.063677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8a0a6-35a9-4d10-88aa-b1520362dd39 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:15.063891 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8a0a6-35a9-4d10-88aa-b1520362dd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:15.083736 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-bdc8a0a6-35a9-4d10-88aa-b1520362dd39 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:15.084952 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-bdc8a0a6-35a9-4d10-88aa-b1520362dd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:15.152915 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 547/1108] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:08:15.431924 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823112d-f011-413c-aa98-6bb5df9971a6 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:15.571161 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823112d-f011-413c-aa98-6bb5df9971a6 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:15.632156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde426e3-4b4f-46c9-b58f-64f89d416d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:15.633182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde426e3-4b4f-46c9-b58f-64f89d416d61 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:15.633613 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde426e3-4b4f-46c9-b58f-64f89d416d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:15.634049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde426e3-4b4f-46c9-b58f-64f89d416d61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:15.636162 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde426e3-4b4f-46c9-b58f-64f89d416d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:15.638663 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde426e3-4b4f-46c9-b58f-64f89d416d61 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:15.641489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 562/1109] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:08:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:08:15.650730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8a0a6-35a9-4d10-88aa-b1520362dd39 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:15.781081 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8a0a6-35a9-4d10-88aa-b1520362dd39 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:15.790814 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:15.835844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419b158-b9ca-4fbf-adbb-fef0febac448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:15.836876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419b158-b9ca-4fbf-adbb-fef0febac448 None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:15.837355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419b158-b9ca-4fbf-adbb-fef0febac448 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:15.837829 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419b158-b9ca-4fbf-adbb-fef0febac448 None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:15.839059 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419b158-b9ca-4fbf-adbb-fef0febac448 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:15.841812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419b158-b9ca-4fbf-adbb-fef0febac448 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:15.924000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 548/1110] 10.222.0.83 () {60 vars in 1132 bytes} [Fri Sep 23 01:08:15 2022] POST /identity/v3/users => generated 286 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:08:18.183374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d260b-207f-480f-89d7-e2a2f87efa18 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:18.183896 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d260b-207f-480f-89d7-e2a2f87efa18 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:18.183896 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d260b-207f-480f-89d7-e2a2f87efa18 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:18.185181 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 563/1111] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:08:18.194356 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657aee60-963c-46a3-b1f8-fe382b92fded None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:18.194883 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657aee60-963c-46a3-b1f8-fe382b92fded None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:18.195346 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657aee60-963c-46a3-b1f8-fe382b92fded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:18.223752 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-657aee60-963c-46a3-b1f8-fe382b92fded None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:18.224978 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-657aee60-963c-46a3-b1f8-fe382b92fded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:18.303424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 549/1112] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:08:18.577371 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d260b-207f-480f-89d7-e2a2f87efa18 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:18.587213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:18.695829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d260b-207f-480f-89d7-e2a2f87efa18 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:18.734683 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcfdda-0343-490c-8de1-f727ae9c3046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:18.735326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcfdda-0343-490c-8de1-f727ae9c3046 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:18.735607 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcfdda-0343-490c-8de1-f727ae9c3046 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:18.735878 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcfdda-0343-490c-8de1-f727ae9c3046 None admin] PATH_INFO: `/v3/roles/a9e6249ed8cd44ce9fac74a4c8155978` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:18.737362 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcfdda-0343-490c-8de1-f727ae9c3046 None admin] RBAC: Authorizing `identity:get_role(role_id=a9e6249ed8cd44ce9fac74a4c8155978)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:18.738807 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcfdda-0343-490c-8de1-f727ae9c3046 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:18.742572 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 564/1113] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:08:18 2022] GET /identity/v3/roles/a9e6249ed8cd44ce9fac74a4c8155978 => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:18.751987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657aee60-963c-46a3-b1f8-fe382b92fded None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:18.989962 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:19.004697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657aee60-963c-46a3-b1f8-fe382b92fded None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:19.058435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951927e6-92f8-433f-a51d-93ae74049ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:19.059117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951927e6-92f8-433f-a51d-93ae74049ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:19.059392 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951927e6-92f8-433f-a51d-93ae74049ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:19.059660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951927e6-92f8-433f-a51d-93ae74049ec5 None admin] PATH_INFO: `/v3/users/f2c59aa6355b4b65b518aa43276b4349` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:19.076471 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951927e6-92f8-433f-a51d-93ae74049ec5 None admin] RBAC: Authorizing `identity:get_user(user_id=f2c59aa6355b4b65b518aa43276b4349)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:19.077943 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951927e6-92f8-433f-a51d-93ae74049ec5 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:19.080956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 550/1114] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:08:18 2022] GET /identity/v3/users/f2c59aa6355b4b65b518aa43276b4349 => generated 286 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:19.086350 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcfdda-0343-490c-8de1-f727ae9c3046 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:19.180825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:19.216875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcfdda-0343-490c-8de1-f727ae9c3046 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:19.257727 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcd412-9611-407d-86c3-2e82366cfaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:19.258333 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcd412-9611-407d-86c3-2e82366cfaa2 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:19.258642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcd412-9611-407d-86c3-2e82366cfaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:19.258910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcd412-9611-407d-86c3-2e82366cfaa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:19.338196 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcd412-9611-407d-86c3-2e82366cfaa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:19.339680 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcd412-9611-407d-86c3-2e82366cfaa2 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:19.420269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:19.452965 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 565/1115] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:08:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 01:08:19.461915 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951927e6-92f8-433f-a51d-93ae74049ec5 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:19.589999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951927e6-92f8-433f-a51d-93ae74049ec5 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:19.630775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd964533-30a2-4d81-ac0b-aaea438a5c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:19.631412 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd964533-30a2-4d81-ac0b-aaea438a5c28 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:19.631692 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd964533-30a2-4d81-ac0b-aaea438a5c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:19.631995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd964533-30a2-4d81-ac0b-aaea438a5c28 None admin] PATH_INFO: `/v3/projects/87fe861ea4e54eb2bee36726fea74e36` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:19.633225 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd964533-30a2-4d81-ac0b-aaea438a5c28 None admin] RBAC: Authorizing `identity:get_project(project_id=87fe861ea4e54eb2bee36726fea74e36)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:19.634801 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd964533-30a2-4d81-ac0b-aaea438a5c28 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:19.636531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 551/1116] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:08:19 2022] GET /identity/v3/projects/87fe861ea4e54eb2bee36726fea74e36 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:19.643282 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcd412-9611-407d-86c3-2e82366cfaa2 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:19.773986 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcd412-9611-407d-86c3-2e82366cfaa2 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:19.811468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de7158-f4b6-4011-817a-fc0f53430188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:19.812080 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de7158-f4b6-4011-817a-fc0f53430188 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:19.812353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de7158-f4b6-4011-817a-fc0f53430188 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:19.812620 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de7158-f4b6-4011-817a-fc0f53430188 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:19.813352 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de7158-f4b6-4011-817a-fc0f53430188 None admin] RBAC: Adding query filter params (role.id=a9e6249ed8cd44ce9fac74a4c8155978, scope.project.id=87fe861ea4e54eb2bee36726fea74e36, user.id=f2c59aa6355b4b65b518aa43276b4349) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:19.813659 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de7158-f4b6-4011-817a-fc0f53430188 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:19.815177 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de7158-f4b6-4011-817a-fc0f53430188 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:19.821169 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 566/1117] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:08:19 2022] GET /identity/v3/role_assignments?user.id=f2c59aa6355b4b65b518aa43276b4349&scope.project.id=87fe861ea4e54eb2bee36726fea74e36&role.id=a9e6249ed8cd44ce9fac74a4c8155978 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:08:22.023091 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5230e-6644-480f-83e1-d9d92ea50d73 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:22.023632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5230e-6644-480f-83e1-d9d92ea50d73 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:22.023632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5230e-6644-480f-83e1-d9d92ea50d73 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:22.024970 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 552/1118] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:08:22.030680 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf6607-f2fc-4b10-b625-4ea432483ce2 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:22.031304 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf6607-f2fc-4b10-b625-4ea432483ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:22.031304 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf6607-f2fc-4b10-b625-4ea432483ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:22.049996 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-4abf6607-f2fc-4b10-b625-4ea432483ce2 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:22.051246 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4abf6607-f2fc-4b10-b625-4ea432483ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:22.082088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:22.120713 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 567/1119] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:08:22.396494 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5230e-6644-480f-83e1-d9d92ea50d73 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:22.416076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:22.501074 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5230e-6644-480f-83e1-d9d92ea50d73 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:22.538353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47f985-8dae-42df-9afe-b1e7c1965dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:22.539039 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47f985-8dae-42df-9afe-b1e7c1965dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:22.539318 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47f985-8dae-42df-9afe-b1e7c1965dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:22.539589 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47f985-8dae-42df-9afe-b1e7c1965dc4 None admin] PATH_INFO: `/v3/roles/a9e6249ed8cd44ce9fac74a4c8155978` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:22.541081 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47f985-8dae-42df-9afe-b1e7c1965dc4 None admin] RBAC: Authorizing `identity:get_role(role_id=a9e6249ed8cd44ce9fac74a4c8155978)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:22.542569 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47f985-8dae-42df-9afe-b1e7c1965dc4 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:22.544021 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 553/1120] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:08:22 2022] GET /identity/v3/roles/a9e6249ed8cd44ce9fac74a4c8155978 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:22.550383 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf6607-f2fc-4b10-b625-4ea432483ce2 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:22.662965 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf6607-f2fc-4b10-b625-4ea432483ce2 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:22.705685 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f3e28-d84b-49b5-bf1c-d06bebb39901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:22.706378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f3e28-d84b-49b5-bf1c-d06bebb39901 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:22.706684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f3e28-d84b-49b5-bf1c-d06bebb39901 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:22.707493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f3e28-d84b-49b5-bf1c-d06bebb39901 None admin] PATH_INFO: `/v3/users/f2c59aa6355b4b65b518aa43276b4349` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:22.708784 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f3e28-d84b-49b5-bf1c-d06bebb39901 None admin] RBAC: Authorizing `identity:get_user(user_id=f2c59aa6355b4b65b518aa43276b4349)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:22.710243 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f3e28-d84b-49b5-bf1c-d06bebb39901 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:22.711889 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 568/1121] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:08:22 2022] GET /identity/v3/users/f2c59aa6355b4b65b518aa43276b4349 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:22.721979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47f985-8dae-42df-9afe-b1e7c1965dc4 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:22.820069 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:22.835779 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47f985-8dae-42df-9afe-b1e7c1965dc4 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:22.869745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf17e47-2eba-46e6-aea4-6adc10aa4a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:22.870378 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf17e47-2eba-46e6-aea4-6adc10aa4a45 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:22.870686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf17e47-2eba-46e6-aea4-6adc10aa4a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:22.870955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf17e47-2eba-46e6-aea4-6adc10aa4a45 None admin] PATH_INFO: `/v3/projects/87fe861ea4e54eb2bee36726fea74e36` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:22.872069 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf17e47-2eba-46e6-aea4-6adc10aa4a45 None admin] RBAC: Authorizing `identity:get_project(project_id=87fe861ea4e54eb2bee36726fea74e36)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:22.873502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf17e47-2eba-46e6-aea4-6adc10aa4a45 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:22.875147 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 554/1122] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:08:22 2022] GET /identity/v3/projects/87fe861ea4e54eb2bee36726fea74e36 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:22.881771 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f3e28-d84b-49b5-bf1c-d06bebb39901 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:22.918273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:22.985393 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f3e28-d84b-49b5-bf1c-d06bebb39901 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:23.020446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f8caf-fa52-43c7-9f44-d9e88b49391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:23.021112 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f8caf-fa52-43c7-9f44-d9e88b49391a None admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:23.021392 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f8caf-fa52-43c7-9f44-d9e88b49391a None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:23.021686 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f8caf-fa52-43c7-9f44-d9e88b49391a None admin] PATH_INFO: `/v3/projects/87fe861ea4e54eb2bee36726fea74e36/users/f2c59aa6355b4b65b518aa43276b4349/roles/a9e6249ed8cd44ce9fac74a4c8155978` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:23.023906 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f8caf-fa52-43c7-9f44-d9e88b49391a None admin] RBAC: Authorizing `identity:create_grant(project_id=87fe861ea4e54eb2bee36726fea74e36, user_id=f2c59aa6355b4b65b518aa43276b4349, role_id=a9e6249ed8cd44ce9fac74a4c8155978)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:23.025334 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f8caf-fa52-43c7-9f44-d9e88b49391a None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:23.143984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 569/1123] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:08:22 2022] PUT /identity/v3/projects/87fe861ea4e54eb2bee36726fea74e36/users/f2c59aa6355b4b65b518aa43276b4349/roles/a9e6249ed8cd44ce9fac74a4c8155978 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:08:25.362999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1575a98-e4b2-422f-aa49-ac526d0f4890 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:25.364118 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1575a98-e4b2-422f-aa49-ac526d0f4890 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:25.364118 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1575a98-e4b2-422f-aa49-ac526d0f4890 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:25.365511 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 555/1124] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:08:25.371623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9fc7f-765f-4dcc-9bce-2479c482eff2 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:25.372187 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9fc7f-765f-4dcc-9bce-2479c482eff2 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:25.372594 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9fc7f-765f-4dcc-9bce-2479c482eff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:25.403216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-5db9fc7f-765f-4dcc-9bce-2479c482eff2 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:25.405324 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-5db9fc7f-765f-4dcc-9bce-2479c482eff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:25.485854 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 570/1125] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:08:25.770652 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1575a98-e4b2-422f-aa49-ac526d0f4890 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:25.880134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1575a98-e4b2-422f-aa49-ac526d0f4890 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:25.915967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53944eba-ffc4-48b6-ac62-392240832103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:25.916624 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53944eba-ffc4-48b6-ac62-392240832103 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:25.916896 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53944eba-ffc4-48b6-ac62-392240832103 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:25.917171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53944eba-ffc4-48b6-ac62-392240832103 None admin] PATH_INFO: `/v3/roles/a9e6249ed8cd44ce9fac74a4c8155978` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:25.918632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53944eba-ffc4-48b6-ac62-392240832103 None admin] RBAC: Authorizing `identity:get_role(role_id=a9e6249ed8cd44ce9fac74a4c8155978)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:25.920055 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53944eba-ffc4-48b6-ac62-392240832103 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:25.921436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 556/1126] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:08:25 2022] GET /identity/v3/roles/a9e6249ed8cd44ce9fac74a4c8155978 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:25.927662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9fc7f-765f-4dcc-9bce-2479c482eff2 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:25.956818 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:26.057713 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9fc7f-765f-4dcc-9bce-2479c482eff2 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:26.108119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d249085-d5a0-4444-94da-0e87bc7bbe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:26.109103 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d249085-d5a0-4444-94da-0e87bc7bbe8c None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:26.109592 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d249085-d5a0-4444-94da-0e87bc7bbe8c None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:26.110080 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d249085-d5a0-4444-94da-0e87bc7bbe8c None admin] PATH_INFO: `/v3/users/f2c59aa6355b4b65b518aa43276b4349` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:26.112253 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d249085-d5a0-4444-94da-0e87bc7bbe8c None admin] RBAC: Authorizing `identity:get_user(user_id=f2c59aa6355b4b65b518aa43276b4349)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:26.115618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d249085-d5a0-4444-94da-0e87bc7bbe8c None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:26.118270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 571/1127] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:08:25 2022] GET /identity/v3/users/f2c59aa6355b4b65b518aa43276b4349 => generated 286 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:08:26.124405 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53944eba-ffc4-48b6-ac62-392240832103 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:26.151209 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:26.236745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53944eba-ffc4-48b6-ac62-392240832103 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:26.281943 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7caba79-2b13-490d-ada5-4ba6ecf50027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:26.282573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7caba79-2b13-490d-ada5-4ba6ecf50027 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:26.282877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7caba79-2b13-490d-ada5-4ba6ecf50027 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:26.283145 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7caba79-2b13-490d-ada5-4ba6ecf50027 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:26.365259 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7caba79-2b13-490d-ada5-4ba6ecf50027 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:26.366685 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7caba79-2b13-490d-ada5-4ba6ecf50027 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:26.393460 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:26.481924 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 557/1128] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:08:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 01:08:26.488596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d249085-d5a0-4444-94da-0e87bc7bbe8c None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:26.586382 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:26.593114 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d249085-d5a0-4444-94da-0e87bc7bbe8c None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:26.628028 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89239e30-a656-4faf-8c33-06c7fdcd8174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:26.628583 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89239e30-a656-4faf-8c33-06c7fdcd8174 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:26.628882 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89239e30-a656-4faf-8c33-06c7fdcd8174 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:26.629152 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89239e30-a656-4faf-8c33-06c7fdcd8174 None admin] PATH_INFO: `/v3/projects/87fe861ea4e54eb2bee36726fea74e36` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:26.630285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89239e30-a656-4faf-8c33-06c7fdcd8174 None admin] RBAC: Authorizing `identity:get_project(project_id=87fe861ea4e54eb2bee36726fea74e36)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:26.631764 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89239e30-a656-4faf-8c33-06c7fdcd8174 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:26.633420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 572/1129] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:08:26 2022] GET /identity/v3/projects/87fe861ea4e54eb2bee36726fea74e36 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:26.639958 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7caba79-2b13-490d-ada5-4ba6ecf50027 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:26.744586 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7caba79-2b13-490d-ada5-4ba6ecf50027 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:26.769572 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:26.781744 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9237eb-0fce-40e9-89c8-3aa5fe8d343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:26.782361 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9237eb-0fce-40e9-89c8-3aa5fe8d343c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:26.782665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9237eb-0fce-40e9-89c8-3aa5fe8d343c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:26.782933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9237eb-0fce-40e9-89c8-3aa5fe8d343c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:26.783665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9237eb-0fce-40e9-89c8-3aa5fe8d343c None admin] RBAC: Adding query filter params (role.id=a9e6249ed8cd44ce9fac74a4c8155978, scope.project.id=87fe861ea4e54eb2bee36726fea74e36, user.id=f2c59aa6355b4b65b518aa43276b4349) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:26.783965 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9237eb-0fce-40e9-89c8-3aa5fe8d343c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:26.786011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9237eb-0fce-40e9-89c8-3aa5fe8d343c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:26.792487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 558/1130] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:08:26 2022] GET /identity/v3/role_assignments?user.id=f2c59aa6355b4b65b518aa43276b4349&scope.project.id=87fe861ea4e54eb2bee36726fea74e36&role.id=a9e6249ed8cd44ce9fac74a4c8155978 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:29.054646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d2ff3-3ec3-40ee-a516-aaf618772db0 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:29.055285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d2ff3-3ec3-40ee-a516-aaf618772db0 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:29.055285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d2ff3-3ec3-40ee-a516-aaf618772db0 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:29.056552 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 573/1131] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:08:29.062712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab86e2-8d80-4ed4-9686-9136ce9a54d9 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:29.063296 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab86e2-8d80-4ed4-9686-9136ce9a54d9 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:29.063296 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab86e2-8d80-4ed4-9686-9136ce9a54d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:29.083874 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-b9ab86e2-8d80-4ed4-9686-9136ce9a54d9 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:29.085178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b9ab86e2-8d80-4ed4-9686-9136ce9a54d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:29.170538 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 559/1132] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:08:29.446349 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d2ff3-3ec3-40ee-a516-aaf618772db0 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:29.586520 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d2ff3-3ec3-40ee-a516-aaf618772db0 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:29.625443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc7a19-d426-493d-99b9-65571f14f0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:29.626159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc7a19-d426-493d-99b9-65571f14f0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:29.626489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc7a19-d426-493d-99b9-65571f14f0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:29.626857 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc7a19-d426-493d-99b9-65571f14f0f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:29.628264 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc7a19-d426-493d-99b9-65571f14f0f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:29.630026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc7a19-d426-493d-99b9-65571f14f0f0 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:29.631987 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 574/1133] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:08:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:08:29.638503 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab86e2-8d80-4ed4-9686-9136ce9a54d9 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:29.762689 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab86e2-8d80-4ed4-9686-9136ce9a54d9 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:29.783412 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:29.805368 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c39f4-55cc-4420-9d41-73f9943cf8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:29.806110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c39f4-55cc-4420-9d41-73f9943cf8df None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:29.806290 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c39f4-55cc-4420-9d41-73f9943cf8df None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:29.806562 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c39f4-55cc-4420-9d41-73f9943cf8df None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:29.807277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c39f4-55cc-4420-9d41-73f9943cf8df None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:29.808773 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c39f4-55cc-4420-9d41-73f9943cf8df None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:29.894028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 560/1134] 10.222.0.83 () {60 vars in 1141 bytes} [Fri Sep 23 01:08:29 2022] POST /identity/v3/projects => generated 311 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:08:32.190798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab031f-8117-4c87-804c-9148d0cbdcae None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:32.191586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab031f-8117-4c87-804c-9148d0cbdcae None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:32.191586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab031f-8117-4c87-804c-9148d0cbdcae None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:32.193127 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 575/1135] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:08:32.201177 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba0377-0d25-4057-998d-750fcf09899f None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:32.201800 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba0377-0d25-4057-998d-750fcf09899f None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:32.201943 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba0377-0d25-4057-998d-750fcf09899f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:32.222891 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-f1ba0377-0d25-4057-998d-750fcf09899f None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:32.224194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f1ba0377-0d25-4057-998d-750fcf09899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:32.308953 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 561/1136] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 01:08:32.582734 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab031f-8117-4c87-804c-9148d0cbdcae None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:32.617486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:32.695394 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab031f-8117-4c87-804c-9148d0cbdcae None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:32.732295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aacb4d-b0a4-4ae9-9aad-ac38fb713cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:32.732940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aacb4d-b0a4-4ae9-9aad-ac38fb713cda None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:32.733233 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aacb4d-b0a4-4ae9-9aad-ac38fb713cda None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:32.733500 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aacb4d-b0a4-4ae9-9aad-ac38fb713cda None admin] PATH_INFO: `/v3/domains/default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:32.734709 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aacb4d-b0a4-4ae9-9aad-ac38fb713cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:32.736153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aacb4d-b0a4-4ae9-9aad-ac38fb713cda None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:32.737750 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 576/1137] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:08:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:32.744665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba0377-0d25-4057-998d-750fcf09899f None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:32.851069 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:32.855215 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba0377-0d25-4057-998d-750fcf09899f None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:32.891949 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d7f8a-c7f9-4974-85b1-ceea889ff683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:32.892569 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d7f8a-c7f9-4974-85b1-ceea889ff683 None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:32.892847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d7f8a-c7f9-4974-85b1-ceea889ff683 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:32.893116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d7f8a-c7f9-4974-85b1-ceea889ff683 None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:32.893775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d7f8a-c7f9-4974-85b1-ceea889ff683 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:32.895766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d7f8a-c7f9-4974-85b1-ceea889ff683 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:33.195594 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 562/1138] 10.222.0.83 () {60 vars in 1132 bytes} [Fri Sep 23 01:08:32 2022] POST /identity/v3/users => generated 286 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:08:35.530542 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617fb9f-1021-47d9-9830-b1db6ae81a70 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:35.531225 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617fb9f-1021-47d9-9830-b1db6ae81a70 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:35.531325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617fb9f-1021-47d9-9830-b1db6ae81a70 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:35.532727 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 577/1139] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:08:35.539257 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea5520-e7f6-4ea9-b197-46411f8b40df None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:35.540058 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea5520-e7f6-4ea9-b197-46411f8b40df None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:35.540058 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea5520-e7f6-4ea9-b197-46411f8b40df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:35.561831 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-dfea5520-e7f6-4ea9-b197-46411f8b40df None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:35.563141 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-dfea5520-e7f6-4ea9-b197-46411f8b40df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:35.721233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 563/1140] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 01:08:35.999020 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617fb9f-1021-47d9-9830-b1db6ae81a70 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:36.129704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:36.135994 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617fb9f-1021-47d9-9830-b1db6ae81a70 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:36.184568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39ad3f-f5ab-40ff-8212-f04b7f7155c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:36.185593 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39ad3f-f5ab-40ff-8212-f04b7f7155c0 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:36.186113 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39ad3f-f5ab-40ff-8212-f04b7f7155c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:36.186650 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39ad3f-f5ab-40ff-8212-f04b7f7155c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:36.208324 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39ad3f-f5ab-40ff-8212-f04b7f7155c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:08:36.218789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-7a39ad3f-f5ab-40ff-8212-f04b7f7155c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:08:36.218789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:36.218789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:36.218789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:36.218789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:36.218789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:36.218789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:36.218789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:36.218789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:36.218789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:36.218789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:36.218789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:36.218789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:08:36.218789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:08:36.218789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:08:36.218789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:08:36.220167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:08:36.220167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:08:36.220167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:08:36.220167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:08:36.220167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:36.220167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:36.220167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:36.220167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:36.220167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:36.220167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:36.220167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:36.220167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:36.220167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:36.220167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:36.220167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:36.220167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:36.221212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:36.221212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:36.221212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:36.221212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:36.221212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:08:36.221212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:08:36.221212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:08:36.221212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:08:36.221212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:08:36.221212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:08:36.221212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:08:36.221212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:08:36.221212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 578/1141] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:08:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:08:36.230391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea5520-e7f6-4ea9-b197-46411f8b40df None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:36.336659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:36.355197 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea5520-e7f6-4ea9-b197-46411f8b40df None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:36.401140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103cce4-8b0f-4149-9ff3-f3e350a093c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:36.402411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103cce4-8b0f-4149-9ff3-f3e350a093c4 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:36.402976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103cce4-8b0f-4149-9ff3-f3e350a093c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:36.403673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103cce4-8b0f-4149-9ff3-f3e350a093c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:36.405339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103cce4-8b0f-4149-9ff3-f3e350a093c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:36.405844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103cce4-8b0f-4149-9ff3-f3e350a093c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:36.407541 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103cce4-8b0f-4149-9ff3-f3e350a093c4 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:36.417358 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 564/1142] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:08:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:36.423924 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39ad3f-f5ab-40ff-8212-f04b7f7155c0 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:36.539976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39ad3f-f5ab-40ff-8212-f04b7f7155c0 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:36.579812 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876f103-8b06-4f6c-820f-a1ccd2ed88fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:36.580454 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876f103-8b06-4f6c-820f-a1ccd2ed88fb None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:36.580735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876f103-8b06-4f6c-820f-a1ccd2ed88fb None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:36.581012 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876f103-8b06-4f6c-820f-a1ccd2ed88fb None admin] PATH_INFO: `/v3/users/0e5bbd193cbe414287abfec8977ce5ce` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:36.597394 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876f103-8b06-4f6c-820f-a1ccd2ed88fb None admin] RBAC: Authorizing `identity:get_user(user_id=0e5bbd193cbe414287abfec8977ce5ce)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:36.599510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876f103-8b06-4f6c-820f-a1ccd2ed88fb None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:36.601300 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 579/1143] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:08:36 2022] GET /identity/v3/users/0e5bbd193cbe414287abfec8977ce5ce => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:08:36.607856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103cce4-8b0f-4149-9ff3-f3e350a093c4 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:36.735227 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103cce4-8b0f-4149-9ff3-f3e350a093c4 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:36.775488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126dea5-c7cd-4067-934e-81ca45a9ec20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:36.776107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126dea5-c7cd-4067-934e-81ca45a9ec20 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:36.776432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126dea5-c7cd-4067-934e-81ca45a9ec20 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:36.776712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126dea5-c7cd-4067-934e-81ca45a9ec20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:36.795416 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:36.858008 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126dea5-c7cd-4067-934e-81ca45a9ec20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:36.860702 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126dea5-c7cd-4067-934e-81ca45a9ec20 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:37.040223 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 565/1144] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:08:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 23 01:08:37.048773 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876f103-8b06-4f6c-820f-a1ccd2ed88fb None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:37.075805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:37.168231 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876f103-8b06-4f6c-820f-a1ccd2ed88fb None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:37.204351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba76f2-0ce7-4e00-8490-5aed150097d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:37.205004 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba76f2-0ce7-4e00-8490-5aed150097d9 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:37.205284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba76f2-0ce7-4e00-8490-5aed150097d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:37.205554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba76f2-0ce7-4e00-8490-5aed150097d9 None admin] PATH_INFO: `/v3/projects/68b29f45c7ee4b48a1f5c025ab357f65` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:37.206731 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba76f2-0ce7-4e00-8490-5aed150097d9 None admin] RBAC: Authorizing `identity:get_project(project_id=68b29f45c7ee4b48a1f5c025ab357f65)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:37.208819 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba76f2-0ce7-4e00-8490-5aed150097d9 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:37.210489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 580/1145] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:08:37 2022] GET /identity/v3/projects/68b29f45c7ee4b48a1f5c025ab357f65 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:37.216765 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126dea5-c7cd-4067-934e-81ca45a9ec20 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:37.264911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:37.324337 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126dea5-c7cd-4067-934e-81ca45a9ec20 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:37.359556 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684355f8-3988-4618-b8f0-15722830cc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:37.360171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684355f8-3988-4618-b8f0-15722830cc71 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:37.360453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684355f8-3988-4618-b8f0-15722830cc71 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:37.360727 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684355f8-3988-4618-b8f0-15722830cc71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:37.361458 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684355f8-3988-4618-b8f0-15722830cc71 None admin] RBAC: Adding query filter params (role.id=d365054bc34046c5829cd1355f3a31ac, scope.project.id=68b29f45c7ee4b48a1f5c025ab357f65, user.id=0e5bbd193cbe414287abfec8977ce5ce) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:37.361769 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684355f8-3988-4618-b8f0-15722830cc71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:37.363263 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684355f8-3988-4618-b8f0-15722830cc71 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:37.369440 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 566/1146] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:08:37 2022] GET /identity/v3/role_assignments?user.id=0e5bbd193cbe414287abfec8977ce5ce&scope.project.id=68b29f45c7ee4b48a1f5c025ab357f65&role.id=d365054bc34046c5829cd1355f3a31ac => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:08:39.561186 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a442369-7670-4dbf-9da3-132666df373e None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:39.561788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a442369-7670-4dbf-9da3-132666df373e None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:39.561788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a442369-7670-4dbf-9da3-132666df373e None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:39.563197 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 581/1147] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:08:39.569505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88276123-d5f8-44bf-887f-fa0615b405f7 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:39.573224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88276123-d5f8-44bf-887f-fa0615b405f7 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:39.573224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88276123-d5f8-44bf-887f-fa0615b405f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:39.590085 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-88276123-d5f8-44bf-887f-fa0615b405f7 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:39.591416 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-88276123-d5f8-44bf-887f-fa0615b405f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:39.670206 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 567/1148] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:08:39.939864 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a442369-7670-4dbf-9da3-132666df373e None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:40.027411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:40.044195 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a442369-7670-4dbf-9da3-132666df373e None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:40.079844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fba7f-a320-4ab4-a42d-43a74e42eaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:40.080480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fba7f-a320-4ab4-a42d-43a74e42eaee None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:40.080879 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fba7f-a320-4ab4-a42d-43a74e42eaee None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:40.081157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fba7f-a320-4ab4-a42d-43a74e42eaee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:40.091685 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fba7f-a320-4ab4-a42d-43a74e42eaee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:08:40.096623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-ec2fba7f-a320-4ab4-a42d-43a74e42eaee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:08:40.096623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:40.096623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:40.096623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:40.096623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:40.096623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:40.096623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:40.096623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:40.096623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:40.096623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:40.096623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:40.096623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:40.096623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:08:40.096623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:08:40.096623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:08:40.096623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:08:40.098287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:08:40.098287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:08:40.098287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:08:40.098287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:08:40.098287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:40.098287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:40.098287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:40.098287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:40.098287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:40.098287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:40.098287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:40.098287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:40.098287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:40.098287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:40.098287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:40.098287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:40.099475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:40.099475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:40.099475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:40.099475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:40.099475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:08:40.099475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:08:40.099475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:08:40.099475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:08:40.099475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:08:40.099475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:08:40.099475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:08:40.099475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:08:40.099475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 582/1149] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:08:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:08:40.104729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88276123-d5f8-44bf-887f-fa0615b405f7 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:40.145578 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:40.203555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88276123-d5f8-44bf-887f-fa0615b405f7 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:40.237827 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c976da-329e-4fed-8ce7-c57d690d70c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:40.238397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c976da-329e-4fed-8ce7-c57d690d70c9 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:40.239266 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c976da-329e-4fed-8ce7-c57d690d70c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:40.239539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c976da-329e-4fed-8ce7-c57d690d70c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:40.240202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c976da-329e-4fed-8ce7-c57d690d70c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:40.240503 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c976da-329e-4fed-8ce7-c57d690d70c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:40.241876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c976da-329e-4fed-8ce7-c57d690d70c9 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:40.250184 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 568/1150] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:08:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:40.256203 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fba7f-a320-4ab4-a42d-43a74e42eaee None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:40.358934 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fba7f-a320-4ab4-a42d-43a74e42eaee None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:40.393295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b04d6-6b0b-44ee-a0f5-38355bd863f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:40.393918 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b04d6-6b0b-44ee-a0f5-38355bd863f8 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:40.394197 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b04d6-6b0b-44ee-a0f5-38355bd863f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:40.394464 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b04d6-6b0b-44ee-a0f5-38355bd863f8 None admin] PATH_INFO: `/v3/users/0e5bbd193cbe414287abfec8977ce5ce` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:40.395713 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b04d6-6b0b-44ee-a0f5-38355bd863f8 None admin] RBAC: Authorizing `identity:get_user(user_id=0e5bbd193cbe414287abfec8977ce5ce)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:40.397084 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b04d6-6b0b-44ee-a0f5-38355bd863f8 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:40.398677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 583/1151] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:08:40 2022] GET /identity/v3/users/0e5bbd193cbe414287abfec8977ce5ce => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:40.404583 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c976da-329e-4fed-8ce7-c57d690d70c9 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:40.545795 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c976da-329e-4fed-8ce7-c57d690d70c9 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:40.548404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:40.585840 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1482d-ad1f-4797-b4b2-089bb297fad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:40.586537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1482d-ad1f-4797-b4b2-089bb297fad3 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:40.586770 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1482d-ad1f-4797-b4b2-089bb297fad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:40.587040 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1482d-ad1f-4797-b4b2-089bb297fad3 None admin] PATH_INFO: `/v3/projects/68b29f45c7ee4b48a1f5c025ab357f65` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:40.588175 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1482d-ad1f-4797-b4b2-089bb297fad3 None admin] RBAC: Authorizing `identity:get_project(project_id=68b29f45c7ee4b48a1f5c025ab357f65)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:40.589601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1482d-ad1f-4797-b4b2-089bb297fad3 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:40.591279 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 569/1152] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:08:40 2022] GET /identity/v3/projects/68b29f45c7ee4b48a1f5c025ab357f65 => generated 311 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:40.597792 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b04d6-6b0b-44ee-a0f5-38355bd863f8 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:40.614354 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:40.702374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b04d6-6b0b-44ee-a0f5-38355bd863f8 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:40.736551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfdd97-044f-4197-bdaf-31b677d8c75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:40.737236 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfdd97-044f-4197-bdaf-31b677d8c75f None admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:40.737519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfdd97-044f-4197-bdaf-31b677d8c75f None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:40.737820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfdd97-044f-4197-bdaf-31b677d8c75f None admin] PATH_INFO: `/v3/projects/68b29f45c7ee4b48a1f5c025ab357f65/users/0e5bbd193cbe414287abfec8977ce5ce/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:40.739982 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfdd97-044f-4197-bdaf-31b677d8c75f None admin] RBAC: Authorizing `identity:create_grant(project_id=68b29f45c7ee4b48a1f5c025ab357f65, user_id=0e5bbd193cbe414287abfec8977ce5ce, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:40.741407 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfdd97-044f-4197-bdaf-31b677d8c75f None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:40.825875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 584/1153] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:08:40 2022] PUT /identity/v3/projects/68b29f45c7ee4b48a1f5c025ab357f65/users/0e5bbd193cbe414287abfec8977ce5ce/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:08:42.994525 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3d893-2003-4cf6-8fb7-90f89cb7ed53 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:42.995123 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3d893-2003-4cf6-8fb7-90f89cb7ed53 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:42.995123 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3d893-2003-4cf6-8fb7-90f89cb7ed53 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:42.996517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 570/1154] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:08:43.002478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f8b19-849a-4284-947a-d715c60fe700 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:43.003075 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f8b19-849a-4284-947a-d715c60fe700 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:43.003075 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f8b19-849a-4284-947a-d715c60fe700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:43.022039 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-6a9f8b19-849a-4284-947a-d715c60fe700 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:43.023290 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6a9f8b19-849a-4284-947a-d715c60fe700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:43.101077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 585/1155] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:08:43.369657 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3d893-2003-4cf6-8fb7-90f89cb7ed53 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:43.479099 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3d893-2003-4cf6-8fb7-90f89cb7ed53 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:43.513442 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e08b87-abdd-443e-9e47-ea960611529c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:43.514075 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e08b87-abdd-443e-9e47-ea960611529c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:43.514354 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e08b87-abdd-443e-9e47-ea960611529c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:43.514656 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e08b87-abdd-443e-9e47-ea960611529c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:43.525093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e08b87-abdd-443e-9e47-ea960611529c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:08:43.529979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-61e08b87-abdd-443e-9e47-ea960611529c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:08:43.529979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:43.529979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:43.529979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:43.529979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:43.529979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:43.529979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:43.529979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:43.529979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:43.529979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:43.529979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:43.529979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:43.529979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:08:43.529979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:08:43.529979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:08:43.529979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:08:43.531157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:08:43.531157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:08:43.531157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:08:43.531157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:08:43.531157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:43.531157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:43.531157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:43.531157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:43.531157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:43.531157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:43.531157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:43.531157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:43.531157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:43.531157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:43.531157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:43.531157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:43.532163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:43.532163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:43.532163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:43.532163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:43.532163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:08:43.532163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:08:43.532163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:08:43.532163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:08:43.532163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:08:43.532163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:08:43.532163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:08:43.532163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:08:43.532163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 571/1156] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:08:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:08:43.537545 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f8b19-849a-4284-947a-d715c60fe700 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:43.539772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:43.637810 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f8b19-849a-4284-947a-d715c60fe700 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:43.671742 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681bdc9-34aa-461c-bf86-2f67b6b5ae7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:43.672347 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681bdc9-34aa-461c-bf86-2f67b6b5ae7d None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:43.672634 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681bdc9-34aa-461c-bf86-2f67b6b5ae7d None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:43.672951 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681bdc9-34aa-461c-bf86-2f67b6b5ae7d None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:43.673735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681bdc9-34aa-461c-bf86-2f67b6b5ae7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:43.674037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681bdc9-34aa-461c-bf86-2f67b6b5ae7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:43.675476 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681bdc9-34aa-461c-bf86-2f67b6b5ae7d None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:43.685539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 586/1157] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:08:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:43.692229 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e08b87-abdd-443e-9e47-ea960611529c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:43.723920 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:43.796669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e08b87-abdd-443e-9e47-ea960611529c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:43.832296 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c0404-4fbe-4725-880e-cb31c217e981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:43.833009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c0404-4fbe-4725-880e-cb31c217e981 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:43.833281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c0404-4fbe-4725-880e-cb31c217e981 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:43.833553 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c0404-4fbe-4725-880e-cb31c217e981 None admin] PATH_INFO: `/v3/users/0e5bbd193cbe414287abfec8977ce5ce` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:43.834786 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c0404-4fbe-4725-880e-cb31c217e981 None admin] RBAC: Authorizing `identity:get_user(user_id=0e5bbd193cbe414287abfec8977ce5ce)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:43.836211 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c0404-4fbe-4725-880e-cb31c217e981 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:43.837805 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 572/1158] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:08:43 2022] GET /identity/v3/users/0e5bbd193cbe414287abfec8977ce5ce => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:43.843823 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681bdc9-34aa-461c-bf86-2f67b6b5ae7d None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:43.908972 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:43.948161 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681bdc9-34aa-461c-bf86-2f67b6b5ae7d None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:43.983567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554ce31-3031-4107-a1cb-91cb81ab4038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:43.984170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554ce31-3031-4107-a1cb-91cb81ab4038 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:43.984450 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554ce31-3031-4107-a1cb-91cb81ab4038 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:43.984717 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554ce31-3031-4107-a1cb-91cb81ab4038 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:44.056267 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554ce31-3031-4107-a1cb-91cb81ab4038 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:44.057730 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554ce31-3031-4107-a1cb-91cb81ab4038 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:44.137819 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:44.177844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 587/1159] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:08:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 01:08:44.183995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c0404-4fbe-4725-880e-cb31c217e981 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:44.283498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:44.287345 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c0404-4fbe-4725-880e-cb31c217e981 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:44.321072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ce7d6-8361-4f28-96d6-ec1e90b85df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:44.321693 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ce7d6-8361-4f28-96d6-ec1e90b85df6 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:44.321978 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ce7d6-8361-4f28-96d6-ec1e90b85df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:44.322251 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ce7d6-8361-4f28-96d6-ec1e90b85df6 None admin] PATH_INFO: `/v3/projects/68b29f45c7ee4b48a1f5c025ab357f65` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:44.323396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ce7d6-8361-4f28-96d6-ec1e90b85df6 None admin] RBAC: Authorizing `identity:get_project(project_id=68b29f45c7ee4b48a1f5c025ab357f65)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:44.324835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ce7d6-8361-4f28-96d6-ec1e90b85df6 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:44.326740 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 573/1160] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:08:44 2022] GET /identity/v3/projects/68b29f45c7ee4b48a1f5c025ab357f65 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:44.332971 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554ce31-3031-4107-a1cb-91cb81ab4038 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:44.436583 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554ce31-3031-4107-a1cb-91cb81ab4038 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:44.477113 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40543ac5-03ad-4646-821e-3465b1929469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:44.477724 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40543ac5-03ad-4646-821e-3465b1929469 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:44.478004 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40543ac5-03ad-4646-821e-3465b1929469 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:44.478267 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40543ac5-03ad-4646-821e-3465b1929469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:44.479026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40543ac5-03ad-4646-821e-3465b1929469 None admin] RBAC: Adding query filter params (role.id=d365054bc34046c5829cd1355f3a31ac, scope.project.id=68b29f45c7ee4b48a1f5c025ab357f65, user.id=0e5bbd193cbe414287abfec8977ce5ce) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:44.479329 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40543ac5-03ad-4646-821e-3465b1929469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:44.480753 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40543ac5-03ad-4646-821e-3465b1929469 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:44.487315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 588/1161] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:08:44 2022] GET /identity/v3/role_assignments?user.id=0e5bbd193cbe414287abfec8977ce5ce&scope.project.id=68b29f45c7ee4b48a1f5c025ab357f65&role.id=d365054bc34046c5829cd1355f3a31ac => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:46.696248 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a84282-c7c1-40df-a9c1-0e8f62e687c2 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:46.696822 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a84282-c7c1-40df-a9c1-0e8f62e687c2 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:46.696822 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a84282-c7c1-40df-a9c1-0e8f62e687c2 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:46.698118 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 574/1162] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:08:46.703837 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab31976-5a27-4626-8ffc-e0370477cd2d None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:46.704244 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab31976-5a27-4626-8ffc-e0370477cd2d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:46.704380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab31976-5a27-4626-8ffc-e0370477cd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:46.722201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-8ab31976-5a27-4626-8ffc-e0370477cd2d None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:46.723408 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-8ab31976-5a27-4626-8ffc-e0370477cd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:46.745982 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:46.790040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 589/1163] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:08:47.068481 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a84282-c7c1-40df-a9c1-0e8f62e687c2 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:47.176076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a84282-c7c1-40df-a9c1-0e8f62e687c2 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:47.208983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030a18b-f662-47b2-9e1b-577d77257289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:47.209592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030a18b-f662-47b2-9e1b-577d77257289 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:47.209864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030a18b-f662-47b2-9e1b-577d77257289 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:47.210132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030a18b-f662-47b2-9e1b-577d77257289 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:47.243522 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:47.277507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030a18b-f662-47b2-9e1b-577d77257289 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:47.278985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030a18b-f662-47b2-9e1b-577d77257289 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:47.387716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 575/1164] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:08:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 01:08:47.394051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab31976-5a27-4626-8ffc-e0370477cd2d None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:47.497803 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab31976-5a27-4626-8ffc-e0370477cd2d None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:47.534312 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7c8fe-b2d0-4900-b54a-142e9c3c25bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:47.535004 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7c8fe-b2d0-4900-b54a-142e9c3c25bc None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:47.535291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7c8fe-b2d0-4900-b54a-142e9c3c25bc None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:47.536098 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7c8fe-b2d0-4900-b54a-142e9c3c25bc None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:47.544541 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7c8fe-b2d0-4900-b54a-142e9c3c25bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:47.546027 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7c8fe-b2d0-4900-b54a-142e9c3c25bc None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:47.559973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-a9e7c8fe-b2d0-4900-b54a-142e9c3c25bc None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 23 01:08:47.559973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:47.559973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 23 01:08:47.559973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 23 01:08:47.559973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:08:47.559973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:08:47.559973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:08:47.559973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:08:47.559973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 23 01:08:47.559973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:08:47.559973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:08:47.559973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:08:47.559973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:47.559973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:47.559973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:47.559973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:47.559973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:47.561303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:47.561303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:47.561303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:47.561303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:47.561303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:47.561303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:47.561303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:08:47.561303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:08:47.561303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:08:47.561303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:08:47.561303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:47.561303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:47.561303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:47.561303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:47.561303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:47.561303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:47.562174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:47.562174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:47.562174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:47.562174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:47.562174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:47.562174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:47.562174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:47.562174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:47.562174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:47.562174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:47.562174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 23 01:08:47.562174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:08:47.562174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 23 01:08:47.562174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:08:47.562174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 590/1165] 10.222.0.83 () {56 vars in 1117 bytes} [Fri Sep 23 01:08:47 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:08:47.567560 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030a18b-f662-47b2-9e1b-577d77257289 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:47.642368 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:47.683512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030a18b-f662-47b2-9e1b-577d77257289 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:47.717767 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02271321-7595-480a-b128-2dcdbfc6a12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:47.718474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02271321-7595-480a-b128-2dcdbfc6a12e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:47.718656 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02271321-7595-480a-b128-2dcdbfc6a12e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:47.718923 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02271321-7595-480a-b128-2dcdbfc6a12e None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:47.719548 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02271321-7595-480a-b128-2dcdbfc6a12e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:47.719845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02271321-7595-480a-b128-2dcdbfc6a12e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:47.721232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02271321-7595-480a-b128-2dcdbfc6a12e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:47.728785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 576/1166] 10.222.0.83 () {56 vars in 1115 bytes} [Fri Sep 23 01:08:47 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:49.902094 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f145593-8bde-4a0d-9518-9f7c2d3b3ccd None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:49.902793 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f145593-8bde-4a0d-9518-9f7c2d3b3ccd None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:49.902793 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f145593-8bde-4a0d-9518-9f7c2d3b3ccd None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:49.903997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 591/1167] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:08:49.910808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd9ad0-6c54-4ed1-8481-39da5fe42a54 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:49.911305 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd9ad0-6c54-4ed1-8481-39da5fe42a54 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:49.911409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd9ad0-6c54-4ed1-8481-39da5fe42a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:49.929881 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-fcfd9ad0-6c54-4ed1-8481-39da5fe42a54 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:49.931102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-fcfd9ad0-6c54-4ed1-8481-39da5fe42a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:50.001217 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 577/1168] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:08:50.272431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f145593-8bde-4a0d-9518-9f7c2d3b3ccd None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:50.293632 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:50.386397 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f145593-8bde-4a0d-9518-9f7c2d3b3ccd None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:50.426714 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd2dff-0252-4fcd-b9eb-ca5d2ff5ebc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:50.427336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd2dff-0252-4fcd-b9eb-ca5d2ff5ebc8 None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:50.427612 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd2dff-0252-4fcd-b9eb-ca5d2ff5ebc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:50.427877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd2dff-0252-4fcd-b9eb-ca5d2ff5ebc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:50.428553 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd2dff-0252-4fcd-b9eb-ca5d2ff5ebc8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:50.429924 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd2dff-0252-4fcd-b9eb-ca5d2ff5ebc8 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:50.501742 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 592/1169] 10.222.0.83 () {60 vars in 1138 bytes} [Fri Sep 23 01:08:50 2022] POST /identity/v3/domains => generated 267 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:08:52.738446 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f2b48-02fc-441d-8732-1aadcc5a8b71 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:52.739333 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f2b48-02fc-441d-8732-1aadcc5a8b71 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:52.739333 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f2b48-02fc-441d-8732-1aadcc5a8b71 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:52.740418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 578/1170] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:08:52.747036 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceac22-1204-4335-8014-9285fa63fefa None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:52.747587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceac22-1204-4335-8014-9285fa63fefa None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:52.747680 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceac22-1204-4335-8014-9285fa63fefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:52.767001 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-1aceac22-1204-4335-8014-9285fa63fefa None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:52.768232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-1aceac22-1204-4335-8014-9285fa63fefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:52.838547 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 593/1171] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:08:53.106267 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f2b48-02fc-441d-8732-1aadcc5a8b71 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:53.170516 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:53.212869 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f2b48-02fc-441d-8732-1aadcc5a8b71 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:53.248625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7296813-f93a-441d-abc2-6c7f399b0a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:53.249252 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7296813-f93a-441d-abc2-6c7f399b0a0c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:53.249523 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7296813-f93a-441d-abc2-6c7f399b0a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:53.249790 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7296813-f93a-441d-abc2-6c7f399b0a0c None admin] PATH_INFO: `/v3/domains/15f3cd661e4c4a0f8d40f6e900df0627` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:53.260898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7296813-f93a-441d-abc2-6c7f399b0a0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=15f3cd661e4c4a0f8d40f6e900df0627)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:53.262349 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7296813-f93a-441d-abc2-6c7f399b0a0c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:53.264024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 579/1172] 10.222.0.83 () {56 vars in 1183 bytes} [Fri Sep 23 01:08:53 2022] GET /identity/v3/domains/15f3cd661e4c4a0f8d40f6e900df0627 => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:53.270257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aceac22-1204-4335-8014-9285fa63fefa None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:53.280585 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:53.370877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aceac22-1204-4335-8014-9285fa63fefa None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:53.406267 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138ce8f-69c8-4929-a6f1-619c2c65ce3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:53.406908 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138ce8f-69c8-4929-a6f1-619c2c65ce3b None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:53.407188 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138ce8f-69c8-4929-a6f1-619c2c65ce3b None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:53.407460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138ce8f-69c8-4929-a6f1-619c2c65ce3b None admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:53.408114 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138ce8f-69c8-4929-a6f1-619c2c65ce3b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:53.409546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138ce8f-69c8-4929-a6f1-619c2c65ce3b None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:53.494799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 594/1173] 10.222.0.83 () {60 vars in 1141 bytes} [Fri Sep 23 01:08:53 2022] POST /identity/v3/projects => generated 361 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:08:55.725950 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae91a4-81c8-4033-bf5a-570d62101320 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:55.726486 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae91a4-81c8-4033-bf5a-570d62101320 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:55.726486 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae91a4-81c8-4033-bf5a-570d62101320 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:55.727851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 580/1174] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:08:55.733291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb52cf-c8d6-4f09-9f46-7e747f344ac2 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:55.733767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb52cf-c8d6-4f09-9f46-7e747f344ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:55.733938 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb52cf-c8d6-4f09-9f46-7e747f344ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:55.752877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-74fb52cf-c8d6-4f09-9f46-7e747f344ac2 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:55.754140 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-74fb52cf-c8d6-4f09-9f46-7e747f344ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:55.815452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:55.827756 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 595/1175] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:08:56.100458 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae91a4-81c8-4033-bf5a-570d62101320 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:56.203569 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae91a4-81c8-4033-bf5a-570d62101320 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:56.224792 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:56.238450 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdf68b-9639-43a9-b2f7-996cb8101842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:56.239866 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdf68b-9639-43a9-b2f7-996cb8101842 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:56.239968 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdf68b-9639-43a9-b2f7-996cb8101842 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:56.240222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdf68b-9639-43a9-b2f7-996cb8101842 None admin] PATH_INFO: `/v3/domains/15f3cd661e4c4a0f8d40f6e900df0627` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:56.241380 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdf68b-9639-43a9-b2f7-996cb8101842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=15f3cd661e4c4a0f8d40f6e900df0627)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:56.242856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdf68b-9639-43a9-b2f7-996cb8101842 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:56.244454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 581/1176] 10.222.0.83 () {56 vars in 1183 bytes} [Fri Sep 23 01:08:56 2022] GET /identity/v3/domains/15f3cd661e4c4a0f8d40f6e900df0627 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:56.250385 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb52cf-c8d6-4f09-9f46-7e747f344ac2 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:56.362848 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb52cf-c8d6-4f09-9f46-7e747f344ac2 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:56.398088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce8d85-37ed-4103-8a8a-8586e8805a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:56.398733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce8d85-37ed-4103-8a8a-8586e8805a1c None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:56.399008 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce8d85-37ed-4103-8a8a-8586e8805a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:56.399273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce8d85-37ed-4103-8a8a-8586e8805a1c None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:56.399922 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce8d85-37ed-4103-8a8a-8586e8805a1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:56.401443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce8d85-37ed-4103-8a8a-8586e8805a1c None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:56.522530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 596/1177] 10.222.0.83 () {60 vars in 1132 bytes} [Fri Sep 23 01:08:56 2022] POST /identity/v3/users => generated 311 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:08:58.768550 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf33e8b-d3c7-40ea-b835-6c14b24b5c62 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:58.769374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf33e8b-d3c7-40ea-b835-6c14b24b5c62 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:58.769374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf33e8b-d3c7-40ea-b835-6c14b24b5c62 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:58.770693 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 582/1178] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:08:58.776206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62380234-3efe-4727-aeec-2212141e0dda None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:58.776733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62380234-3efe-4727-aeec-2212141e0dda None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:58.776733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62380234-3efe-4727-aeec-2212141e0dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:58.796362 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-62380234-3efe-4727-aeec-2212141e0dda None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:08:58.797565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-62380234-3efe-4727-aeec-2212141e0dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:08:58.846458 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:58.872249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 597/1179] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:08:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 01:08:59.149894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf33e8b-d3c7-40ea-b835-6c14b24b5c62 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:59.255604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf33e8b-d3c7-40ea-b835-6c14b24b5c62 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:59.295702 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b682a-4132-41fc-96ab-3ebe0be9e56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:59.296336 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b682a-4132-41fc-96ab-3ebe0be9e56d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:59.296615 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b682a-4132-41fc-96ab-3ebe0be9e56d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:59.296892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b682a-4132-41fc-96ab-3ebe0be9e56d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:59.308152 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b682a-4132-41fc-96ab-3ebe0be9e56d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:08:59.313112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-eb4b682a-4132-41fc-96ab-3ebe0be9e56d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:08:59.313112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:08:59.313112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:08:59.313112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:08:59.313112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:08:59.313112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:08:59.313112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:08:59.313112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:08:59.313112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:08:59.313112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:08:59.313112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:08:59.313112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:08:59.313112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:08:59.313112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:08:59.313112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:08:59.313112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:08:59.314301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:08:59.314301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:08:59.314301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:08:59.314301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:08:59.314301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:08:59.314301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:08:59.314301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:08:59.314301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:08:59.314301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:08:59.314301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:08:59.314301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:08:59.314301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:08:59.314301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:08:59.314301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:08:59.314301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:08:59.314301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:08:59.315601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:08:59.315601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:08:59.315601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:08:59.315601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:08:59.315601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:08:59.315601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:08:59.315601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:08:59.315601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:08:59.315601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:08:59.315601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:08:59.315601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:08:59.315601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:08:59.315601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 583/1180] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:08:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:08:59.320369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62380234-3efe-4727-aeec-2212141e0dda None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:59.423325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62380234-3efe-4727-aeec-2212141e0dda None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:59.458618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57cb67-1870-4a24-b2d6-6e34512f1c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:59.459259 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57cb67-1870-4a24-b2d6-6e34512f1c52 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:59.459540 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57cb67-1870-4a24-b2d6-6e34512f1c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:59.459811 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57cb67-1870-4a24-b2d6-6e34512f1c52 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:59.460486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57cb67-1870-4a24-b2d6-6e34512f1c52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:08:59.460785 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57cb67-1870-4a24-b2d6-6e34512f1c52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:59.462170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57cb67-1870-4a24-b2d6-6e34512f1c52 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:59.470984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 598/1181] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:08:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:59.477788 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b682a-4132-41fc-96ab-3ebe0be9e56d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:59.526803 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:59.585218 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b682a-4132-41fc-96ab-3ebe0be9e56d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:59.621751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa93752-baf8-4d02-806b-7a8d5b162c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:59.622397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93752-baf8-4d02-806b-7a8d5b162c39 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:59.622705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93752-baf8-4d02-806b-7a8d5b162c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:59.623035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93752-baf8-4d02-806b-7a8d5b162c39 None admin] PATH_INFO: `/v3/users/1930e238b43946e48a012a9de937a8f8` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:59.638471 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa93752-baf8-4d02-806b-7a8d5b162c39 None admin] RBAC: Authorizing `identity:get_user(user_id=1930e238b43946e48a012a9de937a8f8)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:59.640220 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa93752-baf8-4d02-806b-7a8d5b162c39 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:59.641967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 584/1182] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:08:59 2022] GET /identity/v3/users/1930e238b43946e48a012a9de937a8f8 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:08:59.648777 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57cb67-1870-4a24-b2d6-6e34512f1c52 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:08:59.693478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:59.759936 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57cb67-1870-4a24-b2d6-6e34512f1c52 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:08:59.796522 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb193bf-19aa-4ad5-8838-634d65ea22cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:08:59.797392 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb193bf-19aa-4ad5-8838-634d65ea22cc None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:08:59.797495 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb193bf-19aa-4ad5-8838-634d65ea22cc None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:08:59.797690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb193bf-19aa-4ad5-8838-634d65ea22cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:08:59.871126 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb193bf-19aa-4ad5-8838-634d65ea22cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:08:59.872560 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb193bf-19aa-4ad5-8838-634d65ea22cc None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:08:59.910741 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:08:59.971269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 599/1183] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:08:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 01:08:59.977892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa93752-baf8-4d02-806b-7a8d5b162c39 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:09:00.076445 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa93752-baf8-4d02-806b-7a8d5b162c39 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:09:00.085157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:09:00.112391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7944d08-f589-42b5-b7f0-28eb2d16e958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:09:00.113031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7944d08-f589-42b5-b7f0-28eb2d16e958 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:09:00.113326 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7944d08-f589-42b5-b7f0-28eb2d16e958 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:09:00.113577 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7944d08-f589-42b5-b7f0-28eb2d16e958 None admin] PATH_INFO: `/v3/projects/458b9db7aa594d328e9a0402e8dff35e` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:09:00.115407 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7944d08-f589-42b5-b7f0-28eb2d16e958 None admin] RBAC: Authorizing `identity:get_project(project_id=458b9db7aa594d328e9a0402e8dff35e)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:09:00.117337 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7944d08-f589-42b5-b7f0-28eb2d16e958 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:09:00.119016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 585/1184] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:08:59 2022] GET /identity/v3/projects/458b9db7aa594d328e9a0402e8dff35e => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:09:00.125218 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb193bf-19aa-4ad5-8838-634d65ea22cc None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:09:00.223301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb193bf-19aa-4ad5-8838-634d65ea22cc None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:09:00.256934 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe59a3e-f359-47df-b65e-1334f8720009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:09:00.257534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59a3e-f359-47df-b65e-1334f8720009 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:09:00.257811 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59a3e-f359-47df-b65e-1334f8720009 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:09:00.258071 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59a3e-f359-47df-b65e-1334f8720009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:09:00.258810 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe59a3e-f359-47df-b65e-1334f8720009 None admin] RBAC: Adding query filter params (role.id=d365054bc34046c5829cd1355f3a31ac, scope.project.id=458b9db7aa594d328e9a0402e8dff35e, user.id=1930e238b43946e48a012a9de937a8f8) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:09:00.259112 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe59a3e-f359-47df-b65e-1334f8720009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:09:00.260517 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe59a3e-f359-47df-b65e-1334f8720009 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:09:00.265946 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 600/1185] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:09:00 2022] GET /identity/v3/role_assignments?user.id=1930e238b43946e48a012a9de937a8f8&scope.project.id=458b9db7aa594d328e9a0402e8dff35e&role.id=d365054bc34046c5829cd1355f3a31ac => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:09:02.427381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d033fd-8984-4991-8270-5eb919d17a82 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:09:02.427956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d033fd-8984-4991-8270-5eb919d17a82 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:09:02.427956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d033fd-8984-4991-8270-5eb919d17a82 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:09:02.429251 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 586/1186] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:09:02.434624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06406c38-088a-4c39-8685-cbfdc31d0b47 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:09:02.435081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06406c38-088a-4c39-8685-cbfdc31d0b47 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:09:02.435182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06406c38-088a-4c39-8685-cbfdc31d0b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:09:02.441354 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:09:02.454231 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-06406c38-088a-4c39-8685-cbfdc31d0b47 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:09:02.456044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-06406c38-088a-4c39-8685-cbfdc31d0b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:09:02.522513 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 601/1187] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:09:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:09:02.794306 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d033fd-8984-4991-8270-5eb919d17a82 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:09:02.896287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d033fd-8984-4991-8270-5eb919d17a82 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:09:02.930072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ab85a-6c07-4206-b2d4-5fd58ef4aa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:09:02.930735 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ab85a-6c07-4206-b2d4-5fd58ef4aa21 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:09:02.931013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ab85a-6c07-4206-b2d4-5fd58ef4aa21 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:09:02.931281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ab85a-6c07-4206-b2d4-5fd58ef4aa21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:09:02.941244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ab85a-6c07-4206-b2d4-5fd58ef4aa21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:09:02.946226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-e52ab85a-6c07-4206-b2d4-5fd58ef4aa21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:09:02.946226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:09:02.946226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:09:02.946226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:09:02.946226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:09:02.946226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:09:02.946226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:09:02.946226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:09:02.946226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:09:02.946226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:09:02.946226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:09:02.946226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:09:02.946226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:09:02.946226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:09:02.946226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:09:02.946226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:09:02.947278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:09:02.947278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:09:02.947278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:09:02.947278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:09:02.947278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:09:02.947278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:09:02.947278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:09:02.947278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:09:02.947278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:09:02.947278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:09:02.947278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:09:02.947278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:09:02.947278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:09:02.947278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:09:02.947278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:09:02.947278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:09:02.948103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:09:02.948103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:09:02.948103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:09:02.948103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:09:02.948103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:09:02.948103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:09:02.948103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:09:02.948103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:09:02.948103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:09:02.948103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:09:02.948103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:09:02.948103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:09:02.948103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 587/1188] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:09:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:09:02.953897 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06406c38-088a-4c39-8685-cbfdc31d0b47 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:09:03.051575 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06406c38-088a-4c39-8685-cbfdc31d0b47 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:09:03.080466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:09:03.086112 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1caaa-2be8-4cad-8ab4-8122a7daa12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:09:03.086765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1caaa-2be8-4cad-8ab4-8122a7daa12b None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:09:03.087048 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1caaa-2be8-4cad-8ab4-8122a7daa12b None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:09:03.087322 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1caaa-2be8-4cad-8ab4-8122a7daa12b None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:09:03.087991 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1caaa-2be8-4cad-8ab4-8122a7daa12b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:09:03.088296 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1caaa-2be8-4cad-8ab4-8122a7daa12b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:09:03.089747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1caaa-2be8-4cad-8ab4-8122a7daa12b None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:09:03.098392 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 602/1189] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:09:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:09:03.105345 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ab85a-6c07-4206-b2d4-5fd58ef4aa21 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:09:03.139860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:09:03.209533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ab85a-6c07-4206-b2d4-5fd58ef4aa21 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:09:03.245774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfac97-378f-41a4-aefe-7ddf64ec52bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:09:03.246417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfac97-378f-41a4-aefe-7ddf64ec52bd None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:09:03.246723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfac97-378f-41a4-aefe-7ddf64ec52bd None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:09:03.246998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfac97-378f-41a4-aefe-7ddf64ec52bd None admin] PATH_INFO: `/v3/users/1930e238b43946e48a012a9de937a8f8` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:09:03.248192 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacfac97-378f-41a4-aefe-7ddf64ec52bd None admin] RBAC: Authorizing `identity:get_user(user_id=1930e238b43946e48a012a9de937a8f8)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:09:03.250067 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacfac97-378f-41a4-aefe-7ddf64ec52bd None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:09:03.251931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 588/1190] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:09:03 2022] GET /identity/v3/users/1930e238b43946e48a012a9de937a8f8 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:09:03.258647 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1caaa-2be8-4cad-8ab4-8122a7daa12b None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:09:03.371626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1caaa-2be8-4cad-8ab4-8122a7daa12b None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:09:03.405360 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee3c09-c2d3-4c43-8a4d-408d6fbe3c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:09:03.405993 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee3c09-c2d3-4c43-8a4d-408d6fbe3c75 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:09:03.406271 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee3c09-c2d3-4c43-8a4d-408d6fbe3c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:09:03.406542 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee3c09-c2d3-4c43-8a4d-408d6fbe3c75 None admin] PATH_INFO: `/v3/projects/458b9db7aa594d328e9a0402e8dff35e` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:09:03.407692 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee3c09-c2d3-4c43-8a4d-408d6fbe3c75 None admin] RBAC: Authorizing `identity:get_project(project_id=458b9db7aa594d328e9a0402e8dff35e)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:09:03.409114 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee3c09-c2d3-4c43-8a4d-408d6fbe3c75 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:09:03.410795 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 603/1191] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:09:03 2022] GET /identity/v3/projects/458b9db7aa594d328e9a0402e8dff35e => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:09:03.416760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfac97-378f-41a4-aefe-7ddf64ec52bd None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:09:03.518580 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfac97-378f-41a4-aefe-7ddf64ec52bd None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:09:03.520830 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:09:03.552202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df8154-79b6-4003-ac98-771ed9d224c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:09:03.552864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df8154-79b6-4003-ac98-771ed9d224c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:09:03.553143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df8154-79b6-4003-ac98-771ed9d224c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:09:03.553418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df8154-79b6-4003-ac98-771ed9d224c9 None admin] PATH_INFO: `/v3/projects/458b9db7aa594d328e9a0402e8dff35e/users/1930e238b43946e48a012a9de937a8f8/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:09:03.555622 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df8154-79b6-4003-ac98-771ed9d224c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=458b9db7aa594d328e9a0402e8dff35e, user_id=1930e238b43946e48a012a9de937a8f8, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:09:03.557182 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df8154-79b6-4003-ac98-771ed9d224c9 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:09:03.618887 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 589/1192] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:09:03 2022] PUT /identity/v3/projects/458b9db7aa594d328e9a0402e8dff35e/users/1930e238b43946e48a012a9de937a8f8/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:09:05.813519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b71c4-fc50-42e0-9e87-b3b3a65b9679 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:09:05.814163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b71c4-fc50-42e0-9e87-b3b3a65b9679 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:09:05.814163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b71c4-fc50-42e0-9e87-b3b3a65b9679 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:09:05.815450 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 604/1193] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:09:05.821711 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111acf8-00d9-4ab8-badd-64f2eac138b2 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:09:05.822221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111acf8-00d9-4ab8-badd-64f2eac138b2 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:09:05.822312 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111acf8-00d9-4ab8-badd-64f2eac138b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:09:05.841394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-8111acf8-00d9-4ab8-badd-64f2eac138b2 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:09:05.842640 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-8111acf8-00d9-4ab8-badd-64f2eac138b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:09:05.917796 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 590/1194] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:09:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:09:06.185854 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b71c4-fc50-42e0-9e87-b3b3a65b9679 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:09:06.248313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:09:06.294605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b71c4-fc50-42e0-9e87-b3b3a65b9679 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:09:06.331644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7ecfe-6646-40d0-b40e-34bcb81a9f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:09:06.332284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7ecfe-6646-40d0-b40e-34bcb81a9f05 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:09:06.332559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7ecfe-6646-40d0-b40e-34bcb81a9f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:09:06.332858 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7ecfe-6646-40d0-b40e-34bcb81a9f05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:09:06.344766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7ecfe-6646-40d0-b40e-34bcb81a9f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:09:06.350325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-b5b7ecfe-6646-40d0-b40e-34bcb81a9f05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:09:06.350325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:09:06.350325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:09:06.350325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:09:06.350325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:09:06.350325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:09:06.350325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:09:06.350325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:09:06.350325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:09:06.350325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:09:06.350325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:09:06.350325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:09:06.350325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:09:06.350325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:09:06.350325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:09:06.350325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:09:06.351409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:09:06.351409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:09:06.351409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:09:06.351409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:09:06.351409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:09:06.351409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:09:06.351409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:09:06.351409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:09:06.351409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:09:06.351409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:09:06.351409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:09:06.351409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:09:06.351409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:09:06.351409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:09:06.351409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:09:06.351409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:09:06.352279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:09:06.352279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:09:06.352279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:09:06.352279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:09:06.352279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:09:06.352279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:09:06.352279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:09:06.352279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:09:06.352279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:09:06.352279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:09:06.352279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:09:06.352279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:09:06.352279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 605/1195] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:09:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:09:06.357789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111acf8-00d9-4ab8-badd-64f2eac138b2 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:09:06.452357 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:09:06.461008 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111acf8-00d9-4ab8-badd-64f2eac138b2 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:09:06.501708 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c93da-838d-4994-bf73-982745f97a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:09:06.502327 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c93da-838d-4994-bf73-982745f97a8b None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:09:06.502638 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c93da-838d-4994-bf73-982745f97a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:09:06.502922 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c93da-838d-4994-bf73-982745f97a8b None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:09:06.503670 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c93da-838d-4994-bf73-982745f97a8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:09:06.503974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c93da-838d-4994-bf73-982745f97a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:09:06.505383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c93da-838d-4994-bf73-982745f97a8b None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:09:06.514280 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 591/1196] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:09:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:09:06.520221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7ecfe-6646-40d0-b40e-34bcb81a9f05 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:09:06.622456 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7ecfe-6646-40d0-b40e-34bcb81a9f05 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:09:06.644506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:09:06.656504 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f2360-861e-4c05-a71c-32ce5b8fa58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:09:06.657132 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f2360-861e-4c05-a71c-32ce5b8fa58f None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:09:06.657691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f2360-861e-4c05-a71c-32ce5b8fa58f None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:09:06.657944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f2360-861e-4c05-a71c-32ce5b8fa58f None admin] PATH_INFO: `/v3/users/1930e238b43946e48a012a9de937a8f8` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:09:06.659101 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f2360-861e-4c05-a71c-32ce5b8fa58f None admin] RBAC: Authorizing `identity:get_user(user_id=1930e238b43946e48a012a9de937a8f8)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:09:06.660514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f2360-861e-4c05-a71c-32ce5b8fa58f None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:09:06.662692 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 606/1197] 10.222.0.83 () {56 vars in 1177 bytes} [Fri Sep 23 01:09:06 2022] GET /identity/v3/users/1930e238b43946e48a012a9de937a8f8 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:09:06.668746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c93da-838d-4994-bf73-982745f97a8b None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:09:06.773607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c93da-838d-4994-bf73-982745f97a8b None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:09:06.808174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e59dcc-d373-4a25-a490-5783244dbd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:09:06.808787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e59dcc-d373-4a25-a490-5783244dbd75 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:09:06.809063 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e59dcc-d373-4a25-a490-5783244dbd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:09:06.809333 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e59dcc-d373-4a25-a490-5783244dbd75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:09:06.837959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:09:06.881261 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e59dcc-d373-4a25-a490-5783244dbd75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:09:06.882754 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e59dcc-d373-4a25-a490-5783244dbd75 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:09:06.981579 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 592/1198] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:09:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 01:09:06.987641 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f2360-861e-4c05-a71c-32ce5b8fa58f None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:09:07.087873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f2360-861e-4c05-a71c-32ce5b8fa58f None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:09:07.121070 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b334e1-536f-4c33-9719-318c3f185325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:09:07.121719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b334e1-536f-4c33-9719-318c3f185325 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:09:07.122001 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b334e1-536f-4c33-9719-318c3f185325 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:09:07.122275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b334e1-536f-4c33-9719-318c3f185325 None admin] PATH_INFO: `/v3/projects/458b9db7aa594d328e9a0402e8dff35e` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:09:07.123526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b334e1-536f-4c33-9719-318c3f185325 None admin] RBAC: Authorizing `identity:get_project(project_id=458b9db7aa594d328e9a0402e8dff35e)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:09:07.124992 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b334e1-536f-4c33-9719-318c3f185325 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:09:07.126738 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 607/1199] 10.222.0.83 () {56 vars in 1186 bytes} [Fri Sep 23 01:09:06 2022] GET /identity/v3/projects/458b9db7aa594d328e9a0402e8dff35e => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:09:07.133908 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e59dcc-d373-4a25-a490-5783244dbd75 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:09:07.188629 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:09:07.232609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e59dcc-d373-4a25-a490-5783244dbd75 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:09:07.268270 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fcfe3-22b0-4cd5-93b4-0070ae9423d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:09:07.268871 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fcfe3-22b0-4cd5-93b4-0070ae9423d1 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:09:07.269146 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fcfe3-22b0-4cd5-93b4-0070ae9423d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:09:07.269415 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fcfe3-22b0-4cd5-93b4-0070ae9423d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:09:07.270128 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fcfe3-22b0-4cd5-93b4-0070ae9423d1 None admin] RBAC: Adding query filter params (role.id=d365054bc34046c5829cd1355f3a31ac, scope.project.id=458b9db7aa594d328e9a0402e8dff35e, user.id=1930e238b43946e48a012a9de937a8f8) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:09:07.271110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fcfe3-22b0-4cd5-93b4-0070ae9423d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:09:07.272611 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fcfe3-22b0-4cd5-93b4-0070ae9423d1 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:09:07.278149 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 593/1200] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:09:07 2022] GET /identity/v3/role_assignments?user.id=1930e238b43946e48a012a9de937a8f8&scope.project.id=458b9db7aa594d328e9a0402e8dff35e&role.id=d365054bc34046c5829cd1355f3a31ac => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:09:17.116538 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=71 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:09:17.275766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=41 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:37.995633 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0012bf-4485-4192-a91b-fb09cdb34015 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:37.996242 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0012bf-4485-4192-a91b-fb09cdb34015 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:37.996242 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0012bf-4485-4192-a91b-fb09cdb34015 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:37.997562 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 608/1201] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:10:38.005980 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ff6de-8dbf-4b50-bca7-90c0afbc094c None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:38.006676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ff6de-8dbf-4b50-bca7-90c0afbc094c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:38.006676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ff6de-8dbf-4b50-bca7-90c0afbc094c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:38.029016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-816ff6de-8dbf-4b50-bca7-90c0afbc094c None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:10:38.030236 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-816ff6de-8dbf-4b50-bca7-90c0afbc094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:10:38.101504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 594/1202] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:10:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:10:38.373924 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0012bf-4485-4192-a91b-fb09cdb34015 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:38.487220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0012bf-4485-4192-a91b-fb09cdb34015 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:38.521626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9d22f-1e29-4643-baed-3490f0b3df8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:38.522255 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9d22f-1e29-4643-baed-3490f0b3df8b None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:38.523223 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9d22f-1e29-4643-baed-3490f0b3df8b None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:38.523503 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9d22f-1e29-4643-baed-3490f0b3df8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:38.533778 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9d22f-1e29-4643-baed-3490f0b3df8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:38.538783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9d22f-1e29-4643-baed-3490f0b3df8b None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:38.550221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-87d9d22f-1e29-4643-baed-3490f0b3df8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:10:38.550221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:38.550221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:38.550221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:38.550221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:38.550221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:38.550221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:38.550221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:38.550221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:38.550221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:38.550221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:38.550221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:38.550221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:10:38.550221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:10:38.550221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:10:38.550221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:10:38.551478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:38.551478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:38.551478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:38.551478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:38.551478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:38.551478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:38.551478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:38.551478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:38.551478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:38.551478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:38.551478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:38.551478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:38.551478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:38.551478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:38.551478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:38.551478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:38.551478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:10:38.552643 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:10:38.552643 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:10:38.552643 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:10:38.552643 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 609/1203] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:10:38.558262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ff6de-8dbf-4b50-bca7-90c0afbc094c None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:38.658450 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ff6de-8dbf-4b50-bca7-90c0afbc094c None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:38.695002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:38.700879 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a51364-ba87-444b-b357-e5b3ede8df0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:38.701529 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51364-ba87-444b-b357-e5b3ede8df0d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:38.701804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51364-ba87-444b-b357-e5b3ede8df0d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:38.702077 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51364-ba87-444b-b357-e5b3ede8df0d None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:38.702740 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a51364-ba87-444b-b357-e5b3ede8df0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:38.703043 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a51364-ba87-444b-b357-e5b3ede8df0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:38.704412 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a51364-ba87-444b-b357-e5b3ede8df0d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:38.719965 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 595/1204] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:38.723254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9d22f-1e29-4643-baed-3490f0b3df8b None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:38.783430 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:38.829930 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9d22f-1e29-4643-baed-3490f0b3df8b None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:38.863682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f9bb4-7441-4615-87e0-799c46fc3360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:38.864287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f9bb4-7441-4615-87e0-799c46fc3360 None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:38.864565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f9bb4-7441-4615-87e0-799c46fc3360 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:38.864835 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f9bb4-7441-4615-87e0-799c46fc3360 None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:38.865482 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f9bb4-7441-4615-87e0-799c46fc3360 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:38.867426 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f9bb4-7441-4615-87e0-799c46fc3360 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:39.029837 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 610/1205] 10.222.0.83 () {60 vars in 1132 bytes} [Fri Sep 23 01:10:38 2022] POST /identity/v3/users => generated 251 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:10:41.322986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52243db-3396-4503-8f2d-fd381c58b7e6 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:41.323693 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52243db-3396-4503-8f2d-fd381c58b7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:41.323693 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52243db-3396-4503-8f2d-fd381c58b7e6 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:41.324969 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 596/1206] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:10:41.331655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482d79a-4e17-4323-a808-6e64fafa9079 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:41.332366 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482d79a-4e17-4323-a808-6e64fafa9079 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:41.332366 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482d79a-4e17-4323-a808-6e64fafa9079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:41.353559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-3482d79a-4e17-4323-a808-6e64fafa9079 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:10:41.394008 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-3482d79a-4e17-4323-a808-6e64fafa9079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:10:41.435158 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 611/1207] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:10:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 01:10:41.716182 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52243db-3396-4503-8f2d-fd381c58b7e6 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:41.831872 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52243db-3396-4503-8f2d-fd381c58b7e6 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:41.867882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04662450-b611-4d1d-8b18-e74a5897811d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:41.868527 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04662450-b611-4d1d-8b18-e74a5897811d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:41.868800 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04662450-b611-4d1d-8b18-e74a5897811d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:41.869072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04662450-b611-4d1d-8b18-e74a5897811d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:41.880081 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04662450-b611-4d1d-8b18-e74a5897811d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:10:41.885616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-04662450-b611-4d1d-8b18-e74a5897811d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:10:41.885616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:41.885616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:41.885616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:41.885616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:41.885616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:41.885616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:41.885616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:41.885616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:41.885616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:41.885616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:41.885616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:41.885616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:10:41.885616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:10:41.885616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:10:41.885616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:10:41.886757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:10:41.886757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:10:41.886757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:10:41.886757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:10:41.886757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:41.886757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:41.886757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:41.886757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:41.886757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:41.886757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:41.886757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:41.886757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:41.886757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:41.886757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:41.886757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:41.886757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:41.888528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:41.888528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:41.888528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:41.888528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:41.888528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:10:41.888528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:10:41.888528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:10:41.888528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:10:41.888528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:10:41.888528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:10:41.888528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:10:41.888528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:10:41.888528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 597/1208] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:10:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:10:41.892872 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482d79a-4e17-4323-a808-6e64fafa9079 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:41.934158 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:42.004512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482d79a-4e17-4323-a808-6e64fafa9079 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:42.042346 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960de03-bee1-41ea-aaf9-575e63574af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:42.043184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960de03-bee1-41ea-aaf9-575e63574af0 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:42.043569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960de03-bee1-41ea-aaf9-575e63574af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:42.043938 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960de03-bee1-41ea-aaf9-575e63574af0 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:42.044748 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960de03-bee1-41ea-aaf9-575e63574af0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:42.045149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960de03-bee1-41ea-aaf9-575e63574af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:42.047159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960de03-bee1-41ea-aaf9-575e63574af0 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:42.057020 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 612/1209] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:10:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:42.067366 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04662450-b611-4d1d-8b18-e74a5897811d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:42.126638 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:42.183866 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04662450-b611-4d1d-8b18-e74a5897811d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:42.218097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764de46-6526-446d-b039-ba3695bfe01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:42.218761 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764de46-6526-446d-b039-ba3695bfe01a None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:42.219042 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764de46-6526-446d-b039-ba3695bfe01a None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:42.219360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764de46-6526-446d-b039-ba3695bfe01a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:42.232227 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764de46-6526-446d-b039-ba3695bfe01a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:42.233884 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764de46-6526-446d-b039-ba3695bfe01a None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:42.250111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-7764de46-6526-446d-b039-ba3695bfe01a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:10:42.250111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:42.250111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:42.250111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:42.250111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:42.250111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:42.250111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:42.250111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:42.250111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:42.250111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:42.250111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:42.250111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:42.250111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:10:42.250111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:10:42.250111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:10:42.250111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:10:42.251536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:42.251536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:42.251536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:42.251536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:42.251536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:42.251536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:42.251536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:42.251536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:42.251536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:42.251536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:42.251536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:42.251536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:42.251536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:42.251536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:42.251536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:42.251536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:42.251536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:10:42.252507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:10:42.252507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:10:42.252507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:10:42.252507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 598/1210] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:10:42.257375 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960de03-bee1-41ea-aaf9-575e63574af0 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:42.360892 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:42.364033 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960de03-bee1-41ea-aaf9-575e63574af0 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:42.400429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a1743-b127-4963-9e04-6588570d8282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:42.401046 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a1743-b127-4963-9e04-6588570d8282 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:42.401324 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a1743-b127-4963-9e04-6588570d8282 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:42.401594 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a1743-b127-4963-9e04-6588570d8282 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:42.402249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a1743-b127-4963-9e04-6588570d8282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:42.402556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a1743-b127-4963-9e04-6588570d8282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:42.403968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a1743-b127-4963-9e04-6588570d8282 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:42.420144 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 613/1211] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:42.428298 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764de46-6526-446d-b039-ba3695bfe01a None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:42.561387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764de46-6526-446d-b039-ba3695bfe01a None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:42.563157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:42.597320 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3492a70-2365-402f-b4e7-96bb66f7f5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:42.597950 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3492a70-2365-402f-b4e7-96bb66f7f5ba None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:42.598225 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3492a70-2365-402f-b4e7-96bb66f7f5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:42.598578 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3492a70-2365-402f-b4e7-96bb66f7f5ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:42.607196 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3492a70-2365-402f-b4e7-96bb66f7f5ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:42.608732 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3492a70-2365-402f-b4e7-96bb66f7f5ba None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:42.619994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-d3492a70-2365-402f-b4e7-96bb66f7f5ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 01:10:42.619994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:42.619994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:42.619994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:42.619994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:42.619994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:42.619994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:42.619994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:42.619994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:42.619994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:42.619994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:42.619994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:42.619994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:10:42.619994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:10:42.619994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:10:42.619994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:10:42.621230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:42.621230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:42.621230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:10:42.621230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:10:42.621230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:10:42.621230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:10:42.621230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:42.621230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:42.621230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:42.621230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:42.621230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:42.621230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:42.621230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:42.621230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:42.621230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:42.621230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:42.621230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:42.621230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:42.622557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:42.622557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:42.622557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:10:42.622557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:10:42.622557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:10:42.622557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:10:42.622557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:10:42.622557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:10:42.622557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 01:10:42.622557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:10:42.622557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 599/1212] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:10:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:10:42.627375 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a1743-b127-4963-9e04-6588570d8282 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:42.727107 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a1743-b127-4963-9e04-6588570d8282 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:42.767133 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d02b19-2357-4965-be9e-62b0ec88b893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:42.767750 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d02b19-2357-4965-be9e-62b0ec88b893 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:42.768058 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d02b19-2357-4965-be9e-62b0ec88b893 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:42.768334 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d02b19-2357-4965-be9e-62b0ec88b893 None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:42.769062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d02b19-2357-4965-be9e-62b0ec88b893 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:42.769369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d02b19-2357-4965-be9e-62b0ec88b893 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:42.770822 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d02b19-2357-4965-be9e-62b0ec88b893 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:42.790348 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 614/1213] 10.222.0.83 () {56 vars in 1143 bytes} [Fri Sep 23 01:10:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:42.796635 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3492a70-2365-402f-b4e7-96bb66f7f5ba None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:42.934087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3492a70-2365-402f-b4e7-96bb66f7f5ba None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:42.970360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b919f4-ea66-4c30-a86c-c42a8af6ea34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:42.971033 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b919f4-ea66-4c30-a86c-c42a8af6ea34 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:42.971288 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b919f4-ea66-4c30-a86c-c42a8af6ea34 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:42.971552 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b919f4-ea66-4c30-a86c-c42a8af6ea34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:43.003836 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:43.043614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b919f4-ea66-4c30-a86c-c42a8af6ea34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:43.045022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b919f4-ea66-4c30-a86c-c42a8af6ea34 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:43.149599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 600/1214] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:10:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 01:10:43.155880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d02b19-2357-4965-be9e-62b0ec88b893 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:43.175683 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:43.267612 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d02b19-2357-4965-be9e-62b0ec88b893 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:43.303253 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8be65-0319-4f29-b19b-dad8f4c74b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:43.303930 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8be65-0319-4f29-b19b-dad8f4c74b38 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:43.304248 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8be65-0319-4f29-b19b-dad8f4c74b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:43.304520 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8be65-0319-4f29-b19b-dad8f4c74b38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:43.316610 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8be65-0319-4f29-b19b-dad8f4c74b38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:43.318163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8be65-0319-4f29-b19b-dad8f4c74b38 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:43.336805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-c7d8be65-0319-4f29-b19b-dad8f4c74b38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:10:43.336805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:43.336805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:43.336805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:43.336805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:43.336805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:43.336805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:43.336805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:43.336805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:43.336805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:43.336805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:43.336805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:43.336805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:10:43.336805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:10:43.336805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:10:43.336805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:10:43.338123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:43.338123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:43.338123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:43.338123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:43.338123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:43.338123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:43.338123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:43.338123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:43.338123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:43.338123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:43.338123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:43.338123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:43.338123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:43.338123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:43.338123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:43.338123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:43.338123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:10:43.339250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:10:43.339250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:10:43.339250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:10:43.339250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 615/1215] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:10:43.344250 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b919f4-ea66-4c30-a86c-c42a8af6ea34 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:43.412577 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:43.459118 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b919f4-ea66-4c30-a86c-c42a8af6ea34 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:43.496808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1630f6-ac97-4d30-99a0-ca4b45b96c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:43.497276 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1630f6-ac97-4d30-99a0-ca4b45b96c9d None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:43.497554 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1630f6-ac97-4d30-99a0-ca4b45b96c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:43.497827 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1630f6-ac97-4d30-99a0-ca4b45b96c9d None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:43.498510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1630f6-ac97-4d30-99a0-ca4b45b96c9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:43.498848 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1630f6-ac97-4d30-99a0-ca4b45b96c9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:43.500227 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1630f6-ac97-4d30-99a0-ca4b45b96c9d None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:43.512381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 601/1216] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:43.518533 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8be65-0319-4f29-b19b-dad8f4c74b38 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:43.601821 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:43.636778 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8be65-0319-4f29-b19b-dad8f4c74b38 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:43.673054 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae23f43-78b2-407f-9096-37fcb2127b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:43.673604 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae23f43-78b2-407f-9096-37fcb2127b4e None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:43.673902 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae23f43-78b2-407f-9096-37fcb2127b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:43.674174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae23f43-78b2-407f-9096-37fcb2127b4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:43.682225 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae23f43-78b2-407f-9096-37fcb2127b4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:43.683884 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae23f43-78b2-407f-9096-37fcb2127b4e None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:43.696860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-6ae23f43-78b2-407f-9096-37fcb2127b4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:10:43.696860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:43.696860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:43.696860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:43.696860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:43.696860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:43.696860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:43.696860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:43.696860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:43.696860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:43.696860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:43.696860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:43.696860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:10:43.696860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:10:43.696860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:10:43.698077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:10:43.698077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:43.698077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:43.698077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:43.698077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:43.698077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:43.698077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:43.698077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:43.698077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:43.698077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:43.698077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:43.698077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:43.698077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:43.698077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:43.698077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:43.698077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:43.698077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:43.699062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:10:43.699062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:10:43.699062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:10:43.699062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:10:43.699062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:10:43.699062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:10:43.699062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:10:43.699062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:10:43.699062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 616/1217] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:10:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:10:43.705644 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1630f6-ac97-4d30-99a0-ca4b45b96c9d None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:43.818412 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1630f6-ac97-4d30-99a0-ca4b45b96c9d None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:43.844913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:43.858290 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a74ae7-cbbc-404b-8a6f-b1b0ff5505f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:43.858964 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a74ae7-cbbc-404b-8a6f-b1b0ff5505f1 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:43.859245 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a74ae7-cbbc-404b-8a6f-b1b0ff5505f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:43.859562 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a74ae7-cbbc-404b-8a6f-b1b0ff5505f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:43.860289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a74ae7-cbbc-404b-8a6f-b1b0ff5505f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:43.860661 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a74ae7-cbbc-404b-8a6f-b1b0ff5505f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:43.862211 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a74ae7-cbbc-404b-8a6f-b1b0ff5505f1 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:43.876089 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 602/1218] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:10:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:43.882669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae23f43-78b2-407f-9096-37fcb2127b4e None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:44.002577 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae23f43-78b2-407f-9096-37fcb2127b4e None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:44.034260 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:44.040976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b6170-f882-4bda-8545-c573cc5b5217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:44.041641 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b6170-f882-4bda-8545-c573cc5b5217 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:44.041868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b6170-f882-4bda-8545-c573cc5b5217 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:44.042136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b6170-f882-4bda-8545-c573cc5b5217 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:44.043338 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b6170-f882-4bda-8545-c573cc5b5217 None admin] RBAC: Adding query filter params (role.id=2e8d92bd39634bbdad03d67d3fc439f0, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=3eab2cbff5984fa6a8e715ed6553db82) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:44.043338 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b6170-f882-4bda-8545-c573cc5b5217 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:44.044662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b6170-f882-4bda-8545-c573cc5b5217 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:44.050830 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 617/1219] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:10:43 2022] GET /identity/v3/role_assignments?user.id=3eab2cbff5984fa6a8e715ed6553db82&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=2e8d92bd39634bbdad03d67d3fc439f0 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:46.353688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d3f6a-c7d0-438a-8c06-1dab74d6747f None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:46.354254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d3f6a-c7d0-438a-8c06-1dab74d6747f None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:46.354254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d3f6a-c7d0-438a-8c06-1dab74d6747f None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:46.355763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 603/1220] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:10:46.361518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9098f9-1dcd-4696-9a3c-823fffa7f44d None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:46.362056 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9098f9-1dcd-4696-9a3c-823fffa7f44d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:46.362056 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9098f9-1dcd-4696-9a3c-823fffa7f44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:46.381724 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-3d9098f9-1dcd-4696-9a3c-823fffa7f44d None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:10:46.383139 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-3d9098f9-1dcd-4696-9a3c-823fffa7f44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:10:46.464983 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 618/1221] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:10:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:10:46.765794 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d3f6a-c7d0-438a-8c06-1dab74d6747f None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:46.895146 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d3f6a-c7d0-438a-8c06-1dab74d6747f None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:46.948498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d01ece-9bd5-4af0-92db-12e48b0edc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:46.949229 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d01ece-9bd5-4af0-92db-12e48b0edc80 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:46.949582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d01ece-9bd5-4af0-92db-12e48b0edc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:46.949875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d01ece-9bd5-4af0-92db-12e48b0edc80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:46.962455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d01ece-9bd5-4af0-92db-12e48b0edc80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:10:46.967533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-75d01ece-9bd5-4af0-92db-12e48b0edc80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:10:46.967533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:46.967533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:46.967533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:46.967533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:46.967533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:46.967533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:46.967533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:46.967533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:46.967533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:46.967533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:46.967533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:46.967533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:10:46.967533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:10:46.967533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:10:46.967533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:10:46.969001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:10:46.969001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:10:46.969001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:10:46.969001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:10:46.969001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:46.969001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:46.969001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:46.969001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:46.969001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:46.969001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:46.969001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:46.969001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:46.969001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:46.969001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:46.969001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:46.969001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:46.970287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:46.970287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:46.970287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:46.970287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:46.970287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:10:46.970287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:10:46.970287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:10:46.970287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:10:46.970287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:10:46.970287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:10:46.970287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:10:46.970287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:10:46.970287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 604/1222] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:10:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:10:46.975361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9098f9-1dcd-4696-9a3c-823fffa7f44d None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:47.098458 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9098f9-1dcd-4696-9a3c-823fffa7f44d None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:47.124818 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:47.142434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefac62e-4e7a-4aa0-8b02-ef394b93a521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:47.143106 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefac62e-4e7a-4aa0-8b02-ef394b93a521 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:47.143401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefac62e-4e7a-4aa0-8b02-ef394b93a521 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:47.143643 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefac62e-4e7a-4aa0-8b02-ef394b93a521 None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:47.144326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefac62e-4e7a-4aa0-8b02-ef394b93a521 None admin] RBAC: Adding query filter params (name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:47.144623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefac62e-4e7a-4aa0-8b02-ef394b93a521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:47.146011 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefac62e-4e7a-4aa0-8b02-ef394b93a521 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:47.155511 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 619/1223] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:10:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:10:47.161551 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d01ece-9bd5-4af0-92db-12e48b0edc80 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:47.209183 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:47.275394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d01ece-9bd5-4af0-92db-12e48b0edc80 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:47.314384 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d0605-7ea5-4c54-92ba-d059b48f7269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:47.315145 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d0605-7ea5-4c54-92ba-d059b48f7269 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:47.315466 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d0605-7ea5-4c54-92ba-d059b48f7269 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:47.315734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d0605-7ea5-4c54-92ba-d059b48f7269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:47.331245 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d0605-7ea5-4c54-92ba-d059b48f7269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:47.333060 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d0605-7ea5-4c54-92ba-d059b48f7269 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:47.349864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-7f5d0605-7ea5-4c54-92ba-d059b48f7269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:10:47.349864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:47.349864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:47.349864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:47.349864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:47.349864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:47.349864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:47.349864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:47.349864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:47.349864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:47.349864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:47.349864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:47.349864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:10:47.349864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:10:47.349864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:10:47.349864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:10:47.351609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:47.351609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:47.351609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:47.351609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:47.351609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:47.351609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:47.351609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:47.351609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:47.351609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:47.351609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:47.351609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:47.351609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:47.351609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:47.351609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:47.351609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:47.351609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:47.351609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:10:47.353446 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:10:47.353446 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:10:47.353446 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:10:47.353446 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 605/1224] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:10:47.357693 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefac62e-4e7a-4aa0-8b02-ef394b93a521 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:47.493296 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefac62e-4e7a-4aa0-8b02-ef394b93a521 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:47.529804 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86798198-2870-4202-842a-45db38dda469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:47.530428 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86798198-2870-4202-842a-45db38dda469 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:47.530754 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86798198-2870-4202-842a-45db38dda469 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:47.531013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86798198-2870-4202-842a-45db38dda469 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:47.531670 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86798198-2870-4202-842a-45db38dda469 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:47.531971 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86798198-2870-4202-842a-45db38dda469 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:47.533370 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86798198-2870-4202-842a-45db38dda469 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:47.549613 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 620/1225] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:47.555536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d0605-7ea5-4c54-92ba-d059b48f7269 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:47.658406 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:47.667659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d0605-7ea5-4c54-92ba-d059b48f7269 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:47.711097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c093252-3e0f-49fd-bceb-ad1de310fe39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:47.712079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c093252-3e0f-49fd-bceb-ad1de310fe39 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:47.712368 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c093252-3e0f-49fd-bceb-ad1de310fe39 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:47.712643 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c093252-3e0f-49fd-bceb-ad1de310fe39 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:47.722318 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c093252-3e0f-49fd-bceb-ad1de310fe39 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:47.723941 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c093252-3e0f-49fd-bceb-ad1de310fe39 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:47.737400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-8c093252-3e0f-49fd-bceb-ad1de310fe39 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 01:10:47.737400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:47.737400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:47.737400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:47.737400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:47.737400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:47.737400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:47.737400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:47.737400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:47.737400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:47.737400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:47.737400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:47.737400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:10:47.737400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:10:47.737400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:10:47.737400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:10:47.739404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:47.739404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:47.739404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:10:47.739404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:10:47.739404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:10:47.739404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:10:47.739404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:47.739404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:47.739404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:47.739404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:47.739404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:47.739404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:47.739404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:47.739404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:47.739404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:47.739404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:47.739404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:47.739404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:47.740841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:47.740841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:47.740841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:10:47.740841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:10:47.740841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:10:47.740841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:10:47.740841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:10:47.740841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:10:47.740841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 01:10:47.740841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:10:47.740841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 606/1226] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:10:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:10:47.745920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86798198-2870-4202-842a-45db38dda469 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:47.801236 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:47.868826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86798198-2870-4202-842a-45db38dda469 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:47.905726 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b326e-ed1f-416c-82af-51fb5e9a89fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:47.906474 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b326e-ed1f-416c-82af-51fb5e9a89fc None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:47.906781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b326e-ed1f-416c-82af-51fb5e9a89fc None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:47.907049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b326e-ed1f-416c-82af-51fb5e9a89fc None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:47.907781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b326e-ed1f-416c-82af-51fb5e9a89fc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:47.908082 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b326e-ed1f-416c-82af-51fb5e9a89fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:47.909579 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b326e-ed1f-416c-82af-51fb5e9a89fc None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:47.928416 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 621/1227] 10.222.0.83 () {56 vars in 1143 bytes} [Fri Sep 23 01:10:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:47.935560 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c093252-3e0f-49fd-bceb-ad1de310fe39 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:48.107028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c093252-3e0f-49fd-bceb-ad1de310fe39 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:48.154960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659e843-cd5b-47e0-a0d7-90b0c499a8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:48.155740 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659e843-cd5b-47e0-a0d7-90b0c499a8f0 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:48.155954 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659e843-cd5b-47e0-a0d7-90b0c499a8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:48.156185 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659e843-cd5b-47e0-a0d7-90b0c499a8f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:48.172094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659e843-cd5b-47e0-a0d7-90b0c499a8f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:48.172094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659e843-cd5b-47e0-a0d7-90b0c499a8f0 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:48.185960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-5659e843-cd5b-47e0-a0d7-90b0c499a8f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:10:48.185960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:48.185960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:48.185960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:48.185960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:48.185960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:48.185960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:48.185960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:48.185960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:48.185960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:48.185960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:48.185960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:48.185960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:10:48.185960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:10:48.185960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:10:48.185960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:10:48.187487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:48.187487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:48.187487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:48.187487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:48.187487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:48.187487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:48.187487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:48.187487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:48.187487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:48.187487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:48.187487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:48.187487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:48.187487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:48.187487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:48.187487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:48.187487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:48.187487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:10:48.189188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:10:48.189188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:10:48.189188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:10:48.189188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 607/1228] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:10:48.193436 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b326e-ed1f-416c-82af-51fb5e9a89fc None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:48.324935 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b326e-ed1f-416c-82af-51fb5e9a89fc None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:48.327449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:48.360854 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b84f3b-6ff2-47ff-b9cd-22b2624adc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:48.361463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b84f3b-6ff2-47ff-b9cd-22b2624adc88 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:48.361749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b84f3b-6ff2-47ff-b9cd-22b2624adc88 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:48.362021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b84f3b-6ff2-47ff-b9cd-22b2624adc88 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:48.362840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b84f3b-6ff2-47ff-b9cd-22b2624adc88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:48.363145 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b84f3b-6ff2-47ff-b9cd-22b2624adc88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:48.364523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b84f3b-6ff2-47ff-b9cd-22b2624adc88 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:48.377792 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 622/1229] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:10:48.383666 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659e843-cd5b-47e0-a0d7-90b0c499a8f0 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:48.393724 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:48.532210 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659e843-cd5b-47e0-a0d7-90b0c499a8f0 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:48.574472 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7dcd1b-7f20-4112-a164-ec7dc0667e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:48.575296 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dcd1b-7f20-4112-a164-ec7dc0667e8e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:48.575711 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dcd1b-7f20-4112-a164-ec7dc0667e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:48.576174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dcd1b-7f20-4112-a164-ec7dc0667e8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:48.588916 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7dcd1b-7f20-4112-a164-ec7dc0667e8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:48.591875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7dcd1b-7f20-4112-a164-ec7dc0667e8e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:48.614024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-0c7dcd1b-7f20-4112-a164-ec7dc0667e8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:10:48.614024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:48.614024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:48.614024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:48.614024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:48.614024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:48.614024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:48.614024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:48.614024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:48.614024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:48.614024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:48.614024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:48.614024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:10:48.614024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:10:48.614024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:10:48.615224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:10:48.615224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:48.615224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:48.615224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:48.615224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:48.615224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:48.615224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:48.615224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:48.615224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:48.615224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:48.615224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:48.615224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:48.615224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:48.615224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:48.615224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:48.615224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:48.615224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:48.620845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:10:48.620845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:10:48.620845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:10:48.620845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:10:48.620845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:10:48.620845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:10:48.620845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:10:48.620845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:10:48.620845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 608/1230] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:10:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:10:48.623467 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b84f3b-6ff2-47ff-b9cd-22b2624adc88 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:48.746803 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b84f3b-6ff2-47ff-b9cd-22b2624adc88 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:48.784626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a173e8c-a41b-472f-bd24-286803152df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:48.785152 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a173e8c-a41b-472f-bd24-286803152df5 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:48.785433 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a173e8c-a41b-472f-bd24-286803152df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:48.786415 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a173e8c-a41b-472f-bd24-286803152df5 None admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:48.786640 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a173e8c-a41b-472f-bd24-286803152df5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:48.786953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a173e8c-a41b-472f-bd24-286803152df5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:48.789317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a173e8c-a41b-472f-bd24-286803152df5 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:48.802658 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 623/1231] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:10:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:48.809155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7dcd1b-7f20-4112-a164-ec7dc0667e8e None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:48.886428 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:48.925206 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7dcd1b-7f20-4112-a164-ec7dc0667e8e None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:48.961071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa19aca-cf12-4f34-9d1f-a2178af4d784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:48.961742 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa19aca-cf12-4f34-9d1f-a2178af4d784 None admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:48.962022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa19aca-cf12-4f34-9d1f-a2178af4d784 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:48.962344 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa19aca-cf12-4f34-9d1f-a2178af4d784 None admin] PATH_INFO: `/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/3eab2cbff5984fa6a8e715ed6553db82/roles/2e8d92bd39634bbdad03d67d3fc439f0` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:48.979245 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa19aca-cf12-4f34-9d1f-a2178af4d784 None admin] RBAC: Authorizing `identity:create_grant(project_id=78d0895fea004a02b1d8338f5fb0250c, user_id=3eab2cbff5984fa6a8e715ed6553db82, role_id=2e8d92bd39634bbdad03d67d3fc439f0)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:48.980817 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa19aca-cf12-4f34-9d1f-a2178af4d784 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:49.157973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 609/1232] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:10:48 2022] PUT /identity/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/3eab2cbff5984fa6a8e715ed6553db82/roles/2e8d92bd39634bbdad03d67d3fc439f0 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:10:51.355868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dea0a3-7cd7-4a9f-aafb-2032f676c3b0 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:51.356407 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dea0a3-7cd7-4a9f-aafb-2032f676c3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:51.356407 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dea0a3-7cd7-4a9f-aafb-2032f676c3b0 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:51.357758 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 624/1233] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:10:51.363186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0d3d5-f507-41f8-821a-8f40b1f04991 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:51.363632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0d3d5-f507-41f8-821a-8f40b1f04991 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:51.363753 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0d3d5-f507-41f8-821a-8f40b1f04991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:51.382923 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-d7a0d3d5-f507-41f8-821a-8f40b1f04991 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:10:51.391526 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d7a0d3d5-f507-41f8-821a-8f40b1f04991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:10:51.453829 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 610/1234] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:10:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:10:51.726063 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dea0a3-7cd7-4a9f-aafb-2032f676c3b0 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:51.752281 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:51.829759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dea0a3-7cd7-4a9f-aafb-2032f676c3b0 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:51.863974 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1dd9-9c44-4a83-891f-558f6d39ae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:51.864597 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1dd9-9c44-4a83-891f-558f6d39ae95 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:51.864928 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1dd9-9c44-4a83-891f-558f6d39ae95 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:51.865273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1dd9-9c44-4a83-891f-558f6d39ae95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:51.877900 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b1dd9-9c44-4a83-891f-558f6d39ae95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:10:51.883708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-830b1dd9-9c44-4a83-891f-558f6d39ae95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:10:51.883708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:51.883708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:51.883708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:51.883708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:51.883708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:51.883708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:51.883708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:51.883708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:51.883708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:51.883708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:51.883708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:51.883708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:10:51.883708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:10:51.883708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:10:51.883708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:10:51.890478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:10:51.890478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:10:51.890478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:10:51.890478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:10:51.890478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:51.890478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:51.890478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:51.890478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:51.890478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:51.890478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:51.890478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:51.890478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:51.890478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:51.890478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:51.890478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:51.890478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:51.891939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:51.891939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:51.891939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:51.891939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:51.891939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:10:51.891939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:10:51.891939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:10:51.891939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:10:51.891939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:10:51.891939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:10:51.891939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 01:10:51.891939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:10:51.891939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 625/1235] 10.222.0.83 () {56 vars in 1102 bytes} [Fri Sep 23 01:10:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:10:51.892646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0d3d5-f507-41f8-821a-8f40b1f04991 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:51.941706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:52.003893 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0d3d5-f507-41f8-821a-8f40b1f04991 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:52.043894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfc372-7fe8-4fa5-8cdf-80d6dc3e124e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:52.044560 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfc372-7fe8-4fa5-8cdf-80d6dc3e124e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:52.044873 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfc372-7fe8-4fa5-8cdf-80d6dc3e124e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:52.045147 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfc372-7fe8-4fa5-8cdf-80d6dc3e124e None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:52.045833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfc372-7fe8-4fa5-8cdf-80d6dc3e124e None admin] RBAC: Adding query filter params (name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:52.046134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfc372-7fe8-4fa5-8cdf-80d6dc3e124e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:52.047740 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfc372-7fe8-4fa5-8cdf-80d6dc3e124e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:52.058685 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 611/1236] 10.222.0.83 () {56 vars in 1103 bytes} [Fri Sep 23 01:10:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:52.065101 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1dd9-9c44-4a83-891f-558f6d39ae95 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:52.169555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:52.186850 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1dd9-9c44-4a83-891f-558f6d39ae95 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:52.221573 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d57edb-2664-4e6f-9094-f3264ae13d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:52.222205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d57edb-2664-4e6f-9094-f3264ae13d40 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:52.222483 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d57edb-2664-4e6f-9094-f3264ae13d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:52.222781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d57edb-2664-4e6f-9094-f3264ae13d40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:52.233445 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d57edb-2664-4e6f-9094-f3264ae13d40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:52.234999 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d57edb-2664-4e6f-9094-f3264ae13d40 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:52.250519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-15d57edb-2664-4e6f-9094-f3264ae13d40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:10:52.250519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:52.250519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:52.250519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:52.250519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:52.250519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:52.250519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:52.250519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:52.250519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:52.250519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:52.250519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:52.250519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:52.250519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:10:52.250519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:10:52.250519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:10:52.250519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:10:52.251765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:52.251765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:52.251765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:52.251765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:52.251765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:52.251765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:52.251765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:52.251765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:52.251765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:52.251765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:52.251765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:52.251765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:52.251765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:52.251765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:52.251765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:52.251765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:52.251765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:10:52.252907 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:10:52.252907 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:10:52.252907 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:10:52.252907 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 626/1237] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:10:52.257790 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfc372-7fe8-4fa5-8cdf-80d6dc3e124e None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:52.359211 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfc372-7fe8-4fa5-8cdf-80d6dc3e124e None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:52.368371 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:52.393177 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969254d-f724-4e7b-904d-41f231a756f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:52.393790 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969254d-f724-4e7b-904d-41f231a756f1 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:52.394092 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969254d-f724-4e7b-904d-41f231a756f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:52.394386 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969254d-f724-4e7b-904d-41f231a756f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:52.395015 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969254d-f724-4e7b-904d-41f231a756f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:52.395367 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969254d-f724-4e7b-904d-41f231a756f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:52.396781 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969254d-f724-4e7b-904d-41f231a756f1 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:52.410489 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 612/1238] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:52.417231 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d57edb-2664-4e6f-9094-f3264ae13d40 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:52.528233 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d57edb-2664-4e6f-9094-f3264ae13d40 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:52.569535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b736425-179e-4400-bfff-ab95117219f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:52.570212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b736425-179e-4400-bfff-ab95117219f8 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:52.570494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b736425-179e-4400-bfff-ab95117219f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:52.570797 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b736425-179e-4400-bfff-ab95117219f8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:52.575737 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:52.581465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b736425-179e-4400-bfff-ab95117219f8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:52.583254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b736425-179e-4400-bfff-ab95117219f8 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:52.596291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-9b736425-179e-4400-bfff-ab95117219f8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 01:10:52.596291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:52.596291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:52.596291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:52.596291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:52.596291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:52.596291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:52.596291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:52.596291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:52.596291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:52.596291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:52.596291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:52.596291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:10:52.596291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:10:52.596291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:10:52.596291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:10:52.597704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:52.597704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:52.597704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:10:52.597704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:10:52.597704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:10:52.597704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:10:52.597704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:52.597704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:52.597704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:52.597704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:52.597704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:52.597704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:52.597704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:52.597704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:52.597704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:52.597704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:52.597704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:52.597704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:52.599100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:52.599100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:52.599100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:10:52.599100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:10:52.599100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:10:52.599100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:10:52.599100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:10:52.599100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:10:52.599100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 01:10:52.599100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:10:52.599100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 627/1239] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:10:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:10:52.604034 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969254d-f724-4e7b-904d-41f231a756f1 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:52.722896 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969254d-f724-4e7b-904d-41f231a756f1 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:52.760149 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44b1da-b28a-45c2-ba7c-43e9f517f929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:52.760849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44b1da-b28a-45c2-ba7c-43e9f517f929 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:52.761200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44b1da-b28a-45c2-ba7c-43e9f517f929 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:52.761512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44b1da-b28a-45c2-ba7c-43e9f517f929 None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:52.762331 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44b1da-b28a-45c2-ba7c-43e9f517f929 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:52.762729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44b1da-b28a-45c2-ba7c-43e9f517f929 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:52.764355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44b1da-b28a-45c2-ba7c-43e9f517f929 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:52.783856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 613/1240] 10.222.0.83 () {56 vars in 1143 bytes} [Fri Sep 23 01:10:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:52.789908 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b736425-179e-4400-bfff-ab95117219f8 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:52.898776 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b736425-179e-4400-bfff-ab95117219f8 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:52.940683 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3838081-6055-4699-a0a5-43ec497a65e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:52.941316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3838081-6055-4699-a0a5-43ec497a65e7 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:52.941604 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3838081-6055-4699-a0a5-43ec497a65e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:52.941870 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3838081-6055-4699-a0a5-43ec497a65e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:53.018654 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:53.027037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3838081-6055-4699-a0a5-43ec497a65e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:53.028500 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3838081-6055-4699-a0a5-43ec497a65e7 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:53.145446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 628/1241] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:10:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 01:10:53.151889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44b1da-b28a-45c2-ba7c-43e9f517f929 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:53.182831 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:53.263263 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44b1da-b28a-45c2-ba7c-43e9f517f929 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:53.306193 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6172f6-a720-4fa4-8acc-892190709df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:53.306877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6172f6-a720-4fa4-8acc-892190709df5 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:53.307150 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6172f6-a720-4fa4-8acc-892190709df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:53.307425 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6172f6-a720-4fa4-8acc-892190709df5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:53.319526 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6172f6-a720-4fa4-8acc-892190709df5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:53.321517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6172f6-a720-4fa4-8acc-892190709df5 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:53.342001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-7d6172f6-a720-4fa4-8acc-892190709df5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:10:53.342001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:53.342001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:53.342001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:53.342001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:53.342001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:53.342001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:53.342001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:53.342001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:53.342001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:53.342001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:53.342001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:53.342001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:10:53.342001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:10:53.342001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:10:53.342001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:10:53.343234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:53.343234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:53.343234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:53.343234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:53.343234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:53.343234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:53.343234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:53.343234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:53.343234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:53.343234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:53.343234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:53.343234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:53.343234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:53.343234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:53.343234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:53.343234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:53.343234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:10:53.344382 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:10:53.344382 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:10:53.344382 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:10:53.344382 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 614/1242] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:10:53.349296 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3838081-6055-4699-a0a5-43ec497a65e7 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:53.464729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:53.471107 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3838081-6055-4699-a0a5-43ec497a65e7 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:53.506676 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aed7d-59a9-4758-8522-fa9488f24a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:53.507314 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aed7d-59a9-4758-8522-fa9488f24a0a None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:53.507593 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aed7d-59a9-4758-8522-fa9488f24a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:53.507862 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aed7d-59a9-4758-8522-fa9488f24a0a None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:53.508503 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9aed7d-59a9-4758-8522-fa9488f24a0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:53.508804 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9aed7d-59a9-4758-8522-fa9488f24a0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:53.510164 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9aed7d-59a9-4758-8522-fa9488f24a0a None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:53.521820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 629/1243] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:53.527821 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6172f6-a720-4fa4-8acc-892190709df5 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:53.610550 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:53.633572 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6172f6-a720-4fa4-8acc-892190709df5 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:53.670343 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b848f4-1f3f-41d5-b9e6-648969995442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:53.671009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b848f4-1f3f-41d5-b9e6-648969995442 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:53.671320 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b848f4-1f3f-41d5-b9e6-648969995442 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:53.671642 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b848f4-1f3f-41d5-b9e6-648969995442 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:53.678805 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b848f4-1f3f-41d5-b9e6-648969995442 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:53.680759 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b848f4-1f3f-41d5-b9e6-648969995442 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:53.692179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-82b848f4-1f3f-41d5-b9e6-648969995442 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:10:53.692179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:53.692179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:53.692179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:53.692179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:53.692179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:53.692179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:53.692179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:53.692179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:53.692179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:53.692179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:53.692179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:53.692179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:10:53.692179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:10:53.692179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:10:53.693844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:10:53.693844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:53.693844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:53.693844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:53.693844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:53.693844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:53.693844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:53.693844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:53.693844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:53.693844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:53.693844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:53.693844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:53.693844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:53.693844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:53.693844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:53.693844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:53.693844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:53.695983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:10:53.695983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:10:53.695983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:10:53.695983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:10:53.695983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:10:53.695983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:10:53.695983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:10:53.695983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:10:53.695983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 615/1244] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:10:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:10:53.699696 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aed7d-59a9-4758-8522-fa9488f24a0a None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:53.801986 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aed7d-59a9-4758-8522-fa9488f24a0a None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:53.840760 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc32b10-513c-431a-9bfc-a41626b3b8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:53.841374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc32b10-513c-431a-9bfc-a41626b3b8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:53.841651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc32b10-513c-431a-9bfc-a41626b3b8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:53.841928 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc32b10-513c-431a-9bfc-a41626b3b8d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:53.842637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc32b10-513c-431a-9bfc-a41626b3b8d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:53.842949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc32b10-513c-431a-9bfc-a41626b3b8d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:53.844392 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc32b10-513c-431a-9bfc-a41626b3b8d5 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:53.857752 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 630/1245] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:10:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:53.864053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b848f4-1f3f-41d5-b9e6-648969995442 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:53.983194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b848f4-1f3f-41d5-b9e6-648969995442 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:54.016759 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f98af-f074-4fd4-9bc8-0c81b3489b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:54.017369 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f98af-f074-4fd4-9bc8-0c81b3489b6e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:54.017669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f98af-f074-4fd4-9bc8-0c81b3489b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:54.017944 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f98af-f074-4fd4-9bc8-0c81b3489b6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:54.018805 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f98af-f074-4fd4-9bc8-0c81b3489b6e None admin] RBAC: Adding query filter params (role.id=2e8d92bd39634bbdad03d67d3fc439f0, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=3eab2cbff5984fa6a8e715ed6553db82) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:54.019115 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f98af-f074-4fd4-9bc8-0c81b3489b6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:54.020677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f98af-f074-4fd4-9bc8-0c81b3489b6e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:54.027545 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 616/1246] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:10:53 2022] GET /identity/v3/role_assignments?user.id=3eab2cbff5984fa6a8e715ed6553db82&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=2e8d92bd39634bbdad03d67d3fc439f0 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:56.301010 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98944d6-a580-4423-a089-a66ebc440802 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:56.301581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98944d6-a580-4423-a089-a66ebc440802 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:56.301581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98944d6-a580-4423-a089-a66ebc440802 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:56.302902 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 631/1247] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:10:56.308564 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbe98f-e18a-4642-ba5f-e526f479a2b7 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:56.309034 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbe98f-e18a-4642-ba5f-e526f479a2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:56.309199 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbe98f-e18a-4642-ba5f-e526f479a2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:56.315568 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:56.328974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-72bbe98f-e18a-4642-ba5f-e526f479a2b7 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:10:56.330182 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-72bbe98f-e18a-4642-ba5f-e526f479a2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:10:56.399191 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 617/1248] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:10:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:10:56.673091 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98944d6-a580-4423-a089-a66ebc440802 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:56.691378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:56.786283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98944d6-a580-4423-a089-a66ebc440802 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:56.829759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb705d4-60f7-424f-8c1c-ce6e78638525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:56.830401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb705d4-60f7-424f-8c1c-ce6e78638525 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:56.830710 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb705d4-60f7-424f-8c1c-ce6e78638525 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:56.830986 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb705d4-60f7-424f-8c1c-ce6e78638525 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:56.843346 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb705d4-60f7-424f-8c1c-ce6e78638525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:10:56.848340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-6cb705d4-60f7-424f-8c1c-ce6e78638525 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:10:56.848340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:56.848340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:56.848340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:56.848340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:56.848340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:56.848340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:56.848340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:56.848340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:56.848340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:56.848340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:56.848340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:56.848340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:10:56.848340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:10:56.848340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:10:56.848340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:10:56.849551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:10:56.849551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:10:56.849551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:10:56.849551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:10:56.849551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:56.849551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:56.849551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:56.849551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:56.849551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:56.849551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:56.849551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:56.849551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:56.849551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:56.849551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:56.849551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:56.849551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:56.850444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:56.850444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:56.850444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:56.850444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:56.850444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:10:56.850444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:10:56.850444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:10:56.850444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:10:56.850444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:10:56.850444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:10:56.850444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:10:56.850444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:10:56.850444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 632/1249] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:10:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:10:56.856235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbe98f-e18a-4642-ba5f-e526f479a2b7 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:56.964515 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbe98f-e18a-4642-ba5f-e526f479a2b7 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:56.998629 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:57.003989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af51bc4-9806-4a7d-80e6-65f5de3fdf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:57.004612 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af51bc4-9806-4a7d-80e6-65f5de3fdf4c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:57.004915 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af51bc4-9806-4a7d-80e6-65f5de3fdf4c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:57.005182 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af51bc4-9806-4a7d-80e6-65f5de3fdf4c None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:57.005849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af51bc4-9806-4a7d-80e6-65f5de3fdf4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:57.006150 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af51bc4-9806-4a7d-80e6-65f5de3fdf4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:57.007579 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af51bc4-9806-4a7d-80e6-65f5de3fdf4c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:57.018555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 618/1250] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:10:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:57.025533 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb705d4-60f7-424f-8c1c-ce6e78638525 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:57.112198 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:57.138161 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb705d4-60f7-424f-8c1c-ce6e78638525 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:57.175837 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe7a32-90a1-4b0c-9d68-995b391e5058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:57.176483 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe7a32-90a1-4b0c-9d68-995b391e5058 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:57.176759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe7a32-90a1-4b0c-9d68-995b391e5058 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:57.177033 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe7a32-90a1-4b0c-9d68-995b391e5058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:57.187891 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe7a32-90a1-4b0c-9d68-995b391e5058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:57.189392 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe7a32-90a1-4b0c-9d68-995b391e5058 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:57.205283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-e7fe7a32-90a1-4b0c-9d68-995b391e5058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:10:57.205283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:57.205283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:57.205283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:57.205283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:57.205283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:57.205283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:57.205283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:57.205283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:57.205283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:57.205283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:57.205283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:57.205283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:10:57.205283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:10:57.205283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:10:57.205283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:10:57.219323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:57.219323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:57.219323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:57.219323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:57.219323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:57.219323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:57.219323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:57.219323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:57.219323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:57.219323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:57.219323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:57.219323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:57.219323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:57.219323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:57.219323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:57.219323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:57.219323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:10:57.220439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:10:57.220439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:10:57.220439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:10:57.220439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 633/1251] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:10:57.220734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af51bc4-9806-4a7d-80e6-65f5de3fdf4c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:57.320326 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af51bc4-9806-4a7d-80e6-65f5de3fdf4c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:57.355950 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0e159-0793-4df9-8e28-a885048882d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:57.356577 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0e159-0793-4df9-8e28-a885048882d9 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:57.356901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0e159-0793-4df9-8e28-a885048882d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:57.357174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0e159-0793-4df9-8e28-a885048882d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:57.357821 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0e159-0793-4df9-8e28-a885048882d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:57.358121 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0e159-0793-4df9-8e28-a885048882d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:57.359545 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0e159-0793-4df9-8e28-a885048882d9 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:57.373012 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 619/1252] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:57.379220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe7a32-90a1-4b0c-9d68-995b391e5058 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:57.489035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe7a32-90a1-4b0c-9d68-995b391e5058 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:57.518021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:57.539254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705a640-8f67-4214-80b6-1ef73b50be82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:57.540238 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705a640-8f67-4214-80b6-1ef73b50be82 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:57.540720 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705a640-8f67-4214-80b6-1ef73b50be82 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:57.541216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705a640-8f67-4214-80b6-1ef73b50be82 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:57.550869 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705a640-8f67-4214-80b6-1ef73b50be82 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:57.552414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705a640-8f67-4214-80b6-1ef73b50be82 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:57.564832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-1705a640-8f67-4214-80b6-1ef73b50be82 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 01:10:57.564832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:57.564832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:57.564832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:57.564832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:57.564832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:57.564832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:57.564832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:57.564832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:57.564832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:57.564832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:57.564832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:57.564832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:10:57.564832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:10:57.564832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:10:57.564832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:10:57.566044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:57.566044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:57.566044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:10:57.566044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:10:57.566044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:10:57.566044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:10:57.566044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:57.566044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:57.566044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:57.566044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:57.566044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:57.566044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:57.566044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:57.566044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:57.566044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:57.566044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:57.566044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:57.566044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:57.567356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:57.567356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:57.567356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:10:57.567356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:10:57.567356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:10:57.567356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:10:57.567356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:10:57.567356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:10:57.567356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 01:10:57.567356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:10:57.567356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 634/1253] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:10:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:10:57.574352 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0e159-0793-4df9-8e28-a885048882d9 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:57.637358 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:57.693248 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0e159-0793-4df9-8e28-a885048882d9 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:57.731351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea24c5c-6bc3-4e7d-ab38-8585f33682a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:57.732085 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea24c5c-6bc3-4e7d-ab38-8585f33682a6 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:57.733375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea24c5c-6bc3-4e7d-ab38-8585f33682a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:57.733375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea24c5c-6bc3-4e7d-ab38-8585f33682a6 None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:57.733539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea24c5c-6bc3-4e7d-ab38-8585f33682a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:57.733721 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea24c5c-6bc3-4e7d-ab38-8585f33682a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:57.735208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea24c5c-6bc3-4e7d-ab38-8585f33682a6 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:57.754291 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 620/1254] 10.222.0.83 () {56 vars in 1143 bytes} [Fri Sep 23 01:10:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:57.762487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705a640-8f67-4214-80b6-1ef73b50be82 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:57.877575 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705a640-8f67-4214-80b6-1ef73b50be82 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:57.918335 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eeecf-bb74-47e2-bc0d-9f4d9b2be9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:57.918995 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eeecf-bb74-47e2-bc0d-9f4d9b2be9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:57.919270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eeecf-bb74-47e2-bc0d-9f4d9b2be9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:57.919546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eeecf-bb74-47e2-bc0d-9f4d9b2be9e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:57.978815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:57.991796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1eeecf-bb74-47e2-bc0d-9f4d9b2be9e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:57.993710 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1eeecf-bb74-47e2-bc0d-9f4d9b2be9e1 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:58.111167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 635/1255] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:10:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 01:10:58.118910 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea24c5c-6bc3-4e7d-ab38-8585f33682a6 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:58.231030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea24c5c-6bc3-4e7d-ab38-8585f33682a6 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:58.244934 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:58.267913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c27307-fd8d-4d04-ad3a-cebb9022fb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:58.268549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c27307-fd8d-4d04-ad3a-cebb9022fb8c None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:58.268856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c27307-fd8d-4d04-ad3a-cebb9022fb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:58.269127 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c27307-fd8d-4d04-ad3a-cebb9022fb8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:58.280014 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c27307-fd8d-4d04-ad3a-cebb9022fb8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:58.281479 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c27307-fd8d-4d04-ad3a-cebb9022fb8c None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:58.296665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-52c27307-fd8d-4d04-ad3a-cebb9022fb8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:10:58.296665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:58.296665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:58.296665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:58.296665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:58.296665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:58.296665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:58.296665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:58.296665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:58.296665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:58.296665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:58.296665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:58.296665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:10:58.296665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:10:58.296665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:10:58.296665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:10:58.298658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:58.298658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:58.298658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:58.298658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:58.298658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:58.298658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:58.298658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:58.298658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:58.298658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:58.298658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:58.298658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:58.298658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:58.298658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:58.298658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:58.298658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:58.298658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:58.298658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:10:58.300422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:10:58.300422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:10:58.300422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:10:58.300422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 621/1256] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:10:58.304512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eeecf-bb74-47e2-bc0d-9f4d9b2be9e1 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:58.397439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:58.409394 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eeecf-bb74-47e2-bc0d-9f4d9b2be9e1 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:58.446516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28ac6b-ba23-42c1-bdaf-54fd5d75b8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:58.447210 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28ac6b-ba23-42c1-bdaf-54fd5d75b8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:58.447422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28ac6b-ba23-42c1-bdaf-54fd5d75b8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:58.447688 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28ac6b-ba23-42c1-bdaf-54fd5d75b8c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:58.448402 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28ac6b-ba23-42c1-bdaf-54fd5d75b8c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:58.448724 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28ac6b-ba23-42c1-bdaf-54fd5d75b8c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:58.450084 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28ac6b-ba23-42c1-bdaf-54fd5d75b8c7 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:58.463607 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 636/1257] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:58.473360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c27307-fd8d-4d04-ad3a-cebb9022fb8c None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:58.589616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c27307-fd8d-4d04-ad3a-cebb9022fb8c None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:58.628642 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6be43a-a5cb-478d-be6b-21874e214314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:58.629290 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6be43a-a5cb-478d-be6b-21874e214314 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:58.629583 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6be43a-a5cb-478d-be6b-21874e214314 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:58.629853 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6be43a-a5cb-478d-be6b-21874e214314 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:58.637785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6be43a-a5cb-478d-be6b-21874e214314 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:58.639288 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6be43a-a5cb-478d-be6b-21874e214314 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:58.651758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-cd6be43a-a5cb-478d-be6b-21874e214314 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:10:58.651758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:10:58.651758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:10:58.651758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:10:58.651758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:10:58.651758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:10:58.651758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:10:58.651758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:10:58.651758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:10:58.651758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:10:58.651758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:10:58.651758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:10:58.651758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:10:58.651758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:10:58.651758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:10:58.653208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:10:58.653208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:10:58.653208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:10:58.653208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:10:58.653208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:10:58.653208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:10:58.653208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:10:58.653208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:10:58.653208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:10:58.653208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:10:58.653208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:10:58.653208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:10:58.653208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:10:58.653208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:10:58.653208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:10:58.653208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:10:58.653208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:10:58.654422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:10:58.654422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:10:58.654422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:10:58.654422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:10:58.654422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:10:58.654422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:10:58.654422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:10:58.654422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:10:58.654422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 622/1258] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:10:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:10:58.659174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28ac6b-ba23-42c1-bdaf-54fd5d75b8c7 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:58.801517 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28ac6b-ba23-42c1-bdaf-54fd5d75b8c7 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:58.840495 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93233764-a7f9-467b-aa5a-03e0114def0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:58.841120 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93233764-a7f9-467b-aa5a-03e0114def0d None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:58.841401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93233764-a7f9-467b-aa5a-03e0114def0d None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:58.841674 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93233764-a7f9-467b-aa5a-03e0114def0d None admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:58.842494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93233764-a7f9-467b-aa5a-03e0114def0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:58.842916 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93233764-a7f9-467b-aa5a-03e0114def0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:58.844374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93233764-a7f9-467b-aa5a-03e0114def0d None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:58.858938 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 637/1259] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:10:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:10:58.865597 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6be43a-a5cb-478d-be6b-21874e214314 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:10:58.893528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:10:59.000265 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6be43a-a5cb-478d-be6b-21874e214314 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:10:59.034925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94bf94-6f2b-42e6-894a-f63cd0ba0965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:10:59.035627 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94bf94-6f2b-42e6-894a-f63cd0ba0965 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:10:59.035902 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94bf94-6f2b-42e6-894a-f63cd0ba0965 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:10:59.036170 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94bf94-6f2b-42e6-894a-f63cd0ba0965 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:10:59.036895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94bf94-6f2b-42e6-894a-f63cd0ba0965 None admin] RBAC: Adding query filter params (role.id=d365054bc34046c5829cd1355f3a31ac, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=3eab2cbff5984fa6a8e715ed6553db82) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:10:59.037195 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94bf94-6f2b-42e6-894a-f63cd0ba0965 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:10:59.039194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94bf94-6f2b-42e6-894a-f63cd0ba0965 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:10:59.045115 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 623/1260] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:10:58 2022] GET /identity/v3/role_assignments?user.id=3eab2cbff5984fa6a8e715ed6553db82&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=d365054bc34046c5829cd1355f3a31ac => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:11:01.296022 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441f6e0-2d7e-4500-8323-5c610ed6c842 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:01.296557 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441f6e0-2d7e-4500-8323-5c610ed6c842 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:01.296649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441f6e0-2d7e-4500-8323-5c610ed6c842 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:01.298038 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 638/1261] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:11:01.303646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5d92a-10b2-4c70-9045-9b30eefd8404 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:01.304871 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5d92a-10b2-4c70-9045-9b30eefd8404 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:01.304871 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5d92a-10b2-4c70-9045-9b30eefd8404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:01.322910 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-f9a5d92a-10b2-4c70-9045-9b30eefd8404 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:11:01.325602 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f9a5d92a-10b2-4c70-9045-9b30eefd8404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:11:01.398040 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 624/1262] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:11:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 01:11:01.668036 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441f6e0-2d7e-4500-8323-5c610ed6c842 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:01.682284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:01.784822 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441f6e0-2d7e-4500-8323-5c610ed6c842 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:01.818200 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d751e-c74c-4597-8611-9138e1d65965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:01.818867 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d751e-c74c-4597-8611-9138e1d65965 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:01.819143 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d751e-c74c-4597-8611-9138e1d65965 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:01.819907 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d751e-c74c-4597-8611-9138e1d65965 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:01.830280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d751e-c74c-4597-8611-9138e1d65965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:11:01.836182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-dc5d751e-c74c-4597-8611-9138e1d65965 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:11:01.836182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:11:01.836182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:11:01.836182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:11:01.836182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:11:01.836182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:11:01.836182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:11:01.836182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:11:01.836182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:11:01.836182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:11:01.836182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:11:01.836182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:11:01.836182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:11:01.836182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:11:01.836182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:11:01.836182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:11:01.837405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:11:01.837405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:11:01.837405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:11:01.837405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:11:01.837405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:11:01.837405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:11:01.837405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:11:01.837405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:11:01.837405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:11:01.837405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:11:01.837405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:11:01.837405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:11:01.837405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:11:01.837405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:11:01.837405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:11:01.837405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:11:01.838566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:11:01.838566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:11:01.838566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:11:01.838566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:11:01.838566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:11:01.838566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:11:01.838566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:11:01.838566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:11:01.838566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:11:01.838566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:11:01.838566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:11:01.838566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:11:01.838566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 639/1263] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:11:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:11:01.844197 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5d92a-10b2-4c70-9045-9b30eefd8404 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:01.865025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:01.969625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5d92a-10b2-4c70-9045-9b30eefd8404 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:02.007509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bcedc-1063-4d23-8644-b1ec993529c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:02.008876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bcedc-1063-4d23-8644-b1ec993529c8 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:02.008876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bcedc-1063-4d23-8644-b1ec993529c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:02.008876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bcedc-1063-4d23-8644-b1ec993529c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:02.009152 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bcedc-1063-4d23-8644-b1ec993529c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:11:02.009251 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bcedc-1063-4d23-8644-b1ec993529c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:02.010631 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bcedc-1063-4d23-8644-b1ec993529c8 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:02.019247 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 625/1264] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:11:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:11:02.025691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d751e-c74c-4597-8611-9138e1d65965 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:02.101773 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:02.136325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d751e-c74c-4597-8611-9138e1d65965 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:02.174743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c803c-e41f-4eb1-8853-097d0b0ecdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:02.175378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c803c-e41f-4eb1-8853-097d0b0ecdfc None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:02.175656 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c803c-e41f-4eb1-8853-097d0b0ecdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:02.176004 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c803c-e41f-4eb1-8853-097d0b0ecdfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:02.187201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c803c-e41f-4eb1-8853-097d0b0ecdfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:02.188645 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c803c-e41f-4eb1-8853-097d0b0ecdfc None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:02.204398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-0d4c803c-e41f-4eb1-8853-097d0b0ecdfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:11:02.204398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:11:02.204398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:11:02.204398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:11:02.204398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:11:02.204398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:11:02.204398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:11:02.204398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:11:02.204398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:11:02.204398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:11:02.204398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:11:02.204398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:11:02.204398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:11:02.204398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:11:02.204398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:11:02.204398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:11:02.205588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:11:02.205588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:11:02.205588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:11:02.205588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:11:02.205588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:11:02.205588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:11:02.205588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:11:02.205588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:11:02.205588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:11:02.205588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:11:02.205588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:11:02.205588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:11:02.205588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:11:02.205588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:11:02.205588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:11:02.205588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:11:02.205588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:11:02.206733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:11:02.206733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:11:02.206733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:11:02.206733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 640/1265] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:11:02.211757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bcedc-1063-4d23-8644-b1ec993529c8 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:02.301469 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:02.323592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bcedc-1063-4d23-8644-b1ec993529c8 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:02.359367 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809476e-adf4-4ba7-b277-0896c5962ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:02.360008 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809476e-adf4-4ba7-b277-0896c5962ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:02.360280 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809476e-adf4-4ba7-b277-0896c5962ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:02.360555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809476e-adf4-4ba7-b277-0896c5962ba7 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:02.361208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809476e-adf4-4ba7-b277-0896c5962ba7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:11:02.361513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809476e-adf4-4ba7-b277-0896c5962ba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:02.363024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809476e-adf4-4ba7-b277-0896c5962ba7 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:02.376621 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 626/1266] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:11:02.383337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c803c-e41f-4eb1-8853-097d0b0ecdfc None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:02.494978 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c803c-e41f-4eb1-8853-097d0b0ecdfc None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:02.514873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:02.528789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fb4a1-d520-4a1f-ac56-5846dd7421a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:02.529420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fb4a1-d520-4a1f-ac56-5846dd7421a7 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:02.529696 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fb4a1-d520-4a1f-ac56-5846dd7421a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:02.529966 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fb4a1-d520-4a1f-ac56-5846dd7421a7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:02.537603 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fb4a1-d520-4a1f-ac56-5846dd7421a7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:02.539627 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fb4a1-d520-4a1f-ac56-5846dd7421a7 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:02.551142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-bd3fb4a1-d520-4a1f-ac56-5846dd7421a7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 01:11:02.551142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:11:02.551142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:11:02.551142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:11:02.551142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:11:02.551142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:11:02.551142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:11:02.551142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:11:02.551142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:11:02.551142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:11:02.551142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:11:02.551142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:11:02.551142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:11:02.551142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:11:02.551142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:11:02.551142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:11:02.552406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:11:02.552406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:11:02.552406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:11:02.552406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:11:02.552406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:11:02.552406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:11:02.552406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:11:02.552406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:11:02.552406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:11:02.552406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:11:02.552406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:11:02.552406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:11:02.552406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:11:02.552406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:11:02.552406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:11:02.552406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:11:02.552406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:11:02.552406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:11:02.553564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:11:02.553564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:11:02.553564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:11:02.553564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:11:02.553564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:11:02.553564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:11:02.553564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:11:02.553564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:11:02.553564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 01:11:02.553564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:11:02.553564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 641/1267] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:11:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:11:02.559263 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809476e-adf4-4ba7-b277-0896c5962ba7 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:02.664481 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809476e-adf4-4ba7-b277-0896c5962ba7 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:02.700229 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5fe37-ab87-4b21-b08f-df8590a63411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:02.700832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5fe37-ab87-4b21-b08f-df8590a63411 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:02.701105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5fe37-ab87-4b21-b08f-df8590a63411 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:02.701375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5fe37-ab87-4b21-b08f-df8590a63411 None admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:02.702406 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5fe37-ab87-4b21-b08f-df8590a63411 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:11:02.702543 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5fe37-ab87-4b21-b08f-df8590a63411 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:02.703931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5fe37-ab87-4b21-b08f-df8590a63411 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:02.713417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:02.722113 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 627/1268] 10.222.0.83 () {56 vars in 1143 bytes} [Fri Sep 23 01:11:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:11:02.728687 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fb4a1-d520-4a1f-ac56-5846dd7421a7 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:02.840827 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fb4a1-d520-4a1f-ac56-5846dd7421a7 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:02.876158 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54605bc6-4da3-4ce5-b8d9-563e14131ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:02.876794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54605bc6-4da3-4ce5-b8d9-563e14131ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:02.877074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54605bc6-4da3-4ce5-b8d9-563e14131ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:02.877347 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54605bc6-4da3-4ce5-b8d9-563e14131ec0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:02.888589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54605bc6-4da3-4ce5-b8d9-563e14131ec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:02.890051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54605bc6-4da3-4ce5-b8d9-563e14131ec0 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:02.905468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-54605bc6-4da3-4ce5-b8d9-563e14131ec0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:11:02.905468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:11:02.905468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:11:02.905468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:11:02.905468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:11:02.905468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:11:02.905468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:11:02.905468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:11:02.905468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:11:02.905468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:11:02.905468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:11:02.905468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:11:02.905468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:11:02.905468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:11:02.905468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:11:02.905468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:11:02.906736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:11:02.906736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:11:02.906736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:11:02.906736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:11:02.906736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:11:02.906736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:11:02.906736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:11:02.906736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:11:02.906736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:11:02.906736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:11:02.906736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:11:02.906736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:11:02.906736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:11:02.906736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:11:02.906736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:11:02.906736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:11:02.906736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:11:02.907612 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:11:02.907612 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:11:02.907612 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:11:02.907612 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 642/1269] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:11:02.912464 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5fe37-ab87-4b21-b08f-df8590a63411 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:03.019158 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5fe37-ab87-4b21-b08f-df8590a63411 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:03.054814 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c48826-4881-4abb-a50c-7c80519fa953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:03.055420 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c48826-4881-4abb-a50c-7c80519fa953 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:03.055696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c48826-4881-4abb-a50c-7c80519fa953 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:03.055963 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c48826-4881-4abb-a50c-7c80519fa953 None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:03.056610 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c48826-4881-4abb-a50c-7c80519fa953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:11:03.056908 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c48826-4881-4abb-a50c-7c80519fa953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:03.058360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c48826-4881-4abb-a50c-7c80519fa953 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:03.070973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 628/1270] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:11:03.077866 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54605bc6-4da3-4ce5-b8d9-563e14131ec0 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:03.111775 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:03.180784 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54605bc6-4da3-4ce5-b8d9-563e14131ec0 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:03.217471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d9a87-d63b-4157-b8b2-7fd8fa09238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:03.218100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d9a87-d63b-4157-b8b2-7fd8fa09238d None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:03.218369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d9a87-d63b-4157-b8b2-7fd8fa09238d None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:03.218656 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d9a87-d63b-4157-b8b2-7fd8fa09238d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:03.225388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d9a87-d63b-4157-b8b2-7fd8fa09238d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:03.227402 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d9a87-d63b-4157-b8b2-7fd8fa09238d None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:03.239460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-9d3d9a87-d63b-4157-b8b2-7fd8fa09238d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:11:03.239460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:11:03.239460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:11:03.239460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:11:03.239460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:11:03.239460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:11:03.239460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:11:03.239460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:11:03.239460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:11:03.239460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:11:03.239460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:11:03.239460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:11:03.239460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:11:03.239460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:11:03.239460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:11:03.240459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:11:03.240459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:11:03.240459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:11:03.240459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:11:03.240459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:11:03.240459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:11:03.240459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:11:03.240459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:11:03.240459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:11:03.240459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:11:03.240459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:11:03.240459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:11:03.240459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:11:03.240459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:11:03.240459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:11:03.240459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:11:03.240459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:11:03.241843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:11:03.241843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:11:03.241843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:11:03.241843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:11:03.241843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:11:03.241843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:11:03.241843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:11:03.241843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:11:03.241843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 643/1271] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:11:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:11:03.246690 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c48826-4881-4abb-a50c-7c80519fa953 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:03.309243 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:03.354743 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c48826-4881-4abb-a50c-7c80519fa953 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:03.390383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480eb5e0-887c-4389-8056-55b3c919465e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:03.391021 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480eb5e0-887c-4389-8056-55b3c919465e None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:03.391302 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480eb5e0-887c-4389-8056-55b3c919465e None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:03.391573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480eb5e0-887c-4389-8056-55b3c919465e None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:03.392330 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480eb5e0-887c-4389-8056-55b3c919465e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:11:03.392635 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480eb5e0-887c-4389-8056-55b3c919465e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:03.394114 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480eb5e0-887c-4389-8056-55b3c919465e None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:03.407572 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 629/1272] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:11:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:11:03.413909 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d9a87-d63b-4157-b8b2-7fd8fa09238d None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:03.541787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:03.552190 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d9a87-d63b-4157-b8b2-7fd8fa09238d None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:03.592609 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bdf969-088b-43aa-942b-82c0c79320ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:03.593305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdf969-088b-43aa-942b-82c0c79320ec None admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:03.593584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdf969-088b-43aa-942b-82c0c79320ec None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:03.593858 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdf969-088b-43aa-942b-82c0c79320ec None admin] PATH_INFO: `/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/3eab2cbff5984fa6a8e715ed6553db82/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:03.595946 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bdf969-088b-43aa-942b-82c0c79320ec None admin] RBAC: Authorizing `identity:create_grant(project_id=78d0895fea004a02b1d8338f5fb0250c, user_id=3eab2cbff5984fa6a8e715ed6553db82, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:03.597440 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bdf969-088b-43aa-942b-82c0c79320ec None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:03.760689 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 644/1273] 10.222.0.83 () {58 vars in 1439 bytes} [Fri Sep 23 01:11:03 2022] PUT /identity/v3/projects/78d0895fea004a02b1d8338f5fb0250c/users/3eab2cbff5984fa6a8e715ed6553db82/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:11:05.980802 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6172e-ef7c-48bd-9280-d8584538f712 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:05.981520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6172e-ef7c-48bd-9280-d8584538f712 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:05.981520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6172e-ef7c-48bd-9280-d8584538f712 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:05.982989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 630/1274] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:11:05.988894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c32c6-64b9-4496-8f50-e036c37a81a5 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:05.989388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c32c6-64b9-4496-8f50-e036c37a81a5 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:05.989565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c32c6-64b9-4496-8f50-e036c37a81a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:06.007836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-b94c32c6-64b9-4496-8f50-e036c37a81a5 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:11:06.009070 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b94c32c6-64b9-4496-8f50-e036c37a81a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:11:06.081843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 645/1275] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:11:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:11:06.357154 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6172e-ef7c-48bd-9280-d8584538f712 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:06.462500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6172e-ef7c-48bd-9280-d8584538f712 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:06.482565 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:06.500148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0e2cf-e590-4d60-831b-ba0526e8f4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:06.500789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0e2cf-e590-4d60-831b-ba0526e8f4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:06.501070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0e2cf-e590-4d60-831b-ba0526e8f4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:06.501340 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0e2cf-e590-4d60-831b-ba0526e8f4e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:06.512400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0e2cf-e590-4d60-831b-ba0526e8f4e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 01:11:06.517561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-14a0e2cf-e590-4d60-831b-ba0526e8f4e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:11:06.517561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:11:06.517561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:11:06.517561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:11:06.517561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:11:06.517561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:11:06.517561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:11:06.517561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:11:06.517561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:11:06.517561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:11:06.517561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:11:06.517561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:11:06.517561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 01:11:06.517561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 01:11:06.517561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 01:11:06.517561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 01:11:06.518688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 01:11:06.518688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 01:11:06.518688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 01:11:06.518688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 01:11:06.518688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:11:06.518688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:11:06.518688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:11:06.518688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:11:06.518688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:11:06.518688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:11:06.518688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:11:06.518688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:11:06.518688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:11:06.518688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:11:06.518688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:11:06.518688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:11:06.519851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:11:06.519851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:11:06.519851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:11:06.519851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:11:06.519851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 01:11:06.519851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 01:11:06.519851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 01:11:06.519851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 01:11:06.519851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 01:11:06.519851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 01:11:06.519851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 01:11:06.519851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:11:06.519851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 631/1276] 10.222.0.83 () {56 vars in 1096 bytes} [Fri Sep 23 01:11:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:11:06.525447 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c32c6-64b9-4496-8f50-e036c37a81a5 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:06.611269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:06.633180 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c32c6-64b9-4496-8f50-e036c37a81a5 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:06.667295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c778531-f893-4337-8963-f1928035f79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:06.667908 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c778531-f893-4337-8963-f1928035f79d None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:06.668188 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c778531-f893-4337-8963-f1928035f79d None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:06.668460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c778531-f893-4337-8963-f1928035f79d None admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:06.669125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c778531-f893-4337-8963-f1928035f79d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:11:06.669487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c778531-f893-4337-8963-f1928035f79d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:06.670913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c778531-f893-4337-8963-f1928035f79d None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:06.680178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 646/1277] 10.222.0.83 () {56 vars in 1099 bytes} [Fri Sep 23 01:11:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:11:06.686678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0e2cf-e590-4d60-831b-ba0526e8f4e7 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:06.799884 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0e2cf-e590-4d60-831b-ba0526e8f4e7 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:06.839450 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09d400-7501-4e85-9402-1835e1fa10ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:06.842014 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09d400-7501-4e85-9402-1835e1fa10ae None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:06.842014 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09d400-7501-4e85-9402-1835e1fa10ae None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:06.842014 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09d400-7501-4e85-9402-1835e1fa10ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:06.851077 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09d400-7501-4e85-9402-1835e1fa10ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:06.852611 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09d400-7501-4e85-9402-1835e1fa10ae None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:06.868093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-ca09d400-7501-4e85-9402-1835e1fa10ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:11:06.868093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:11:06.868093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:11:06.868093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:11:06.868093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:11:06.868093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:11:06.868093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:11:06.868093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:11:06.868093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:11:06.868093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:11:06.868093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:11:06.868093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:11:06.868093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:11:06.868093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:11:06.868093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:11:06.868093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:11:06.869284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:11:06.869284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:11:06.869284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:11:06.869284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:11:06.869284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:11:06.869284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:11:06.869284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:11:06.869284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:11:06.869284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:11:06.869284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:11:06.869284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:11:06.869284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:11:06.869284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:11:06.869284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:11:06.869284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:11:06.869284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:11:06.869284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:11:06.870900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:11:06.870900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:11:06.870900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:11:06.870900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 632/1278] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:11:06.875471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c778531-f893-4337-8963-f1928035f79d None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:06.980682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c778531-f893-4337-8963-f1928035f79d None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:07.023219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09553b5b-dbe3-4f6b-8f64-296924f9106b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:07.023982 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09553b5b-dbe3-4f6b-8f64-296924f9106b None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:07.024365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09553b5b-dbe3-4f6b-8f64-296924f9106b None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:07.024723 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09553b5b-dbe3-4f6b-8f64-296924f9106b None admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:07.025507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09553b5b-dbe3-4f6b-8f64-296924f9106b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:11:07.025936 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09553b5b-dbe3-4f6b-8f64-296924f9106b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:07.027814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09553b5b-dbe3-4f6b-8f64-296924f9106b None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:07.042868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 647/1279] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:11:07.049006 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09d400-7501-4e85-9402-1835e1fa10ae None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:07.086924 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:07.162162 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09d400-7501-4e85-9402-1835e1fa10ae None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:07.200593 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e076a-1399-4c9e-8bb8-882c35d69258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:07.201229 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e076a-1399-4c9e-8bb8-882c35d69258 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:07.202981 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e076a-1399-4c9e-8bb8-882c35d69258 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:07.202981 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e076a-1399-4c9e-8bb8-882c35d69258 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:07.210260 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e076a-1399-4c9e-8bb8-882c35d69258 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:07.211773 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e076a-1399-4c9e-8bb8-882c35d69258 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:07.223534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-7d8e076a-1399-4c9e-8bb8-882c35d69258 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 01:11:07.223534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:11:07.223534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:11:07.223534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:11:07.223534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:11:07.223534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:11:07.223534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:11:07.223534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:11:07.223534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:11:07.223534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:11:07.223534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:11:07.223534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:11:07.223534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 01:11:07.223534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 01:11:07.223534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 01:11:07.223534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 01:11:07.230190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:11:07.230190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:11:07.230190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 01:11:07.230190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:11:07.230190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 01:11:07.230190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 01:11:07.230190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:11:07.230190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:11:07.230190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:11:07.230190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:11:07.230190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:11:07.230190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:11:07.230190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:11:07.230190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:11:07.230190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:11:07.230190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:11:07.230190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:11:07.230190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:11:07.231345 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:11:07.231345 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:11:07.231345 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 01:11:07.231345 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 01:11:07.231345 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 01:11:07.231345 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 01:11:07.231345 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 01:11:07.231345 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 01:11:07.231345 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 01:11:07.231345 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:11:07.231345 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 633/1280] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:11:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:11:07.231933 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09553b5b-dbe3-4f6b-8f64-296924f9106b None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:07.236224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:07.340260 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09553b5b-dbe3-4f6b-8f64-296924f9106b None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:07.375645 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e051a76-af7a-4155-94de-efdf3e7fde31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:07.376258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e051a76-af7a-4155-94de-efdf3e7fde31 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:07.376537 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e051a76-af7a-4155-94de-efdf3e7fde31 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:07.376808 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e051a76-af7a-4155-94de-efdf3e7fde31 None admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:07.377530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e051a76-af7a-4155-94de-efdf3e7fde31 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:11:07.377831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e051a76-af7a-4155-94de-efdf3e7fde31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:07.379291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e051a76-af7a-4155-94de-efdf3e7fde31 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:07.399256 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 648/1281] 10.222.0.83 () {56 vars in 1143 bytes} [Fri Sep 23 01:11:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:11:07.405341 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e076a-1399-4c9e-8bb8-882c35d69258 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:07.509827 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:07.521467 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e076a-1399-4c9e-8bb8-882c35d69258 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:07.558258 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbdbb4-9ea5-4745-8535-763eff992cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:07.558905 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbdbb4-9ea5-4745-8535-763eff992cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:07.559184 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbdbb4-9ea5-4745-8535-763eff992cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:07.559456 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbdbb4-9ea5-4745-8535-763eff992cd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:07.629233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbdbb4-9ea5-4745-8535-763eff992cd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:07.630897 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbdbb4-9ea5-4745-8535-763eff992cd5 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:07.743227 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 634/1282] 10.222.0.83 () {58 vars in 1282 bytes} [Fri Sep 23 01:11:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 01:11:07.749210 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e051a76-af7a-4155-94de-efdf3e7fde31 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:07.809377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:07.815337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:07.857023 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e051a76-af7a-4155-94de-efdf3e7fde31 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:07.895233 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da834f86-5a9d-4e70-8ead-d5bd283b5c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:07.897019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da834f86-5a9d-4e70-8ead-d5bd283b5c29 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:07.897019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da834f86-5a9d-4e70-8ead-d5bd283b5c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:07.897019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da834f86-5a9d-4e70-8ead-d5bd283b5c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:07.907859 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da834f86-5a9d-4e70-8ead-d5bd283b5c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:07.909300 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da834f86-5a9d-4e70-8ead-d5bd283b5c29 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:07.923873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-da834f86-5a9d-4e70-8ead-d5bd283b5c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:11:07.923873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:11:07.923873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:11:07.923873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:11:07.923873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:11:07.923873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:11:07.923873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:11:07.923873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:11:07.923873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:11:07.923873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:11:07.923873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:11:07.923873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:11:07.923873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 01:11:07.923873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 01:11:07.923873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 01:11:07.923873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 01:11:07.925498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:11:07.925498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:11:07.925498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:11:07.925498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:11:07.925498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:11:07.925498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:11:07.925498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:11:07.925498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:11:07.925498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:11:07.925498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:11:07.925498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:11:07.925498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:11:07.925498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:11:07.925498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:11:07.925498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:11:07.925498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:11:07.925498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 01:11:07.926484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 01:11:07.926484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 01:11:07.926484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:11:07.926484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 649/1283] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:11:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:11:07.931234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbdbb4-9ea5-4745-8535-763eff992cd5 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:08.049799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbdbb4-9ea5-4745-8535-763eff992cd5 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:08.089661 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7f833-7f5d-47fa-9ee6-b1bfaeedb73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:08.090213 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7f833-7f5d-47fa-9ee6-b1bfaeedb73a None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:08.090483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7f833-7f5d-47fa-9ee6-b1bfaeedb73a None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:08.090796 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7f833-7f5d-47fa-9ee6-b1bfaeedb73a None admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:08.091423 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7f833-7f5d-47fa-9ee6-b1bfaeedb73a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:11:08.091724 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7f833-7f5d-47fa-9ee6-b1bfaeedb73a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:08.093126 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7f833-7f5d-47fa-9ee6-b1bfaeedb73a None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:08.105610 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 635/1284] 10.222.0.83 () {56 vars in 1109 bytes} [Fri Sep 23 01:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:11:08.111658 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da834f86-5a9d-4e70-8ead-d5bd283b5c29 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:08.222176 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da834f86-5a9d-4e70-8ead-d5bd283b5c29 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:08.237438 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:08.262040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030e5d0-070c-4f17-a2b2-74b202a6aa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:08.262727 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030e5d0-070c-4f17-a2b2-74b202a6aa6d None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:08.263032 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030e5d0-070c-4f17-a2b2-74b202a6aa6d None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:08.263366 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030e5d0-070c-4f17-a2b2-74b202a6aa6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:08.272568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030e5d0-070c-4f17-a2b2-74b202a6aa6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:08.274059 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030e5d0-070c-4f17-a2b2-74b202a6aa6d None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:08.286618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application [None req-d030e5d0-070c-4f17-a2b2-74b202a6aa6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:11:08.286618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:11:08.286618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:11:08.286618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:11:08.286618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:11:08.286618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:11:08.286618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:11:08.286618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:11:08.286618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:11:08.286618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:11:08.286618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:11:08.286618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:11:08.286618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 01:11:08.286618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 01:11:08.286618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 01:11:08.288232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 01:11:08.288232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:11:08.288232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:11:08.288232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:11:08.288232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:11:08.288232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:11:08.288232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:11:08.288232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:11:08.288232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application with Lock( Sep 23 01:11:08.288232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:11:08.288232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:11:08.288232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:11:08.288232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:11:08.288232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:11:08.288232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:11:08.288232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:11:08.288232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:11:08.289234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 01:11:08.289234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 01:11:08.289234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 01:11:08.289234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 01:11:08.289234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 01:11:08.289234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 01:11:08.289234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 01:11:08.289234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: ERROR keystone.server.flask.application Sep 23 01:11:08.289234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 650/1285] 10.222.0.83 () {56 vars in 1111 bytes} [Fri Sep 23 01:11:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:11:08.294091 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7f833-7f5d-47fa-9ee6-b1bfaeedb73a None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:08.351153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:08.402454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7f833-7f5d-47fa-9ee6-b1bfaeedb73a None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:08.436547 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285280ee-62de-4440-9d44-89d17a2dcd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:08.437250 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285280ee-62de-4440-9d44-89d17a2dcd87 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:08.437527 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285280ee-62de-4440-9d44-89d17a2dcd87 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:08.437800 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285280ee-62de-4440-9d44-89d17a2dcd87 None admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:08.438496 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285280ee-62de-4440-9d44-89d17a2dcd87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:11:08.438866 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285280ee-62de-4440-9d44-89d17a2dcd87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:08.440320 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285280ee-62de-4440-9d44-89d17a2dcd87 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:08.453294 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 636/1286] 10.222.0.83 () {56 vars in 1148 bytes} [Fri Sep 23 01:11:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:11:08.463226 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030e5d0-070c-4f17-a2b2-74b202a6aa6d None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:08.576768 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030e5d0-070c-4f17-a2b2-74b202a6aa6d None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:08.611831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60410929-49d7-4c4c-8f6d-2d5aeeb6820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:08.612880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60410929-49d7-4c4c-8f6d-2d5aeeb6820d None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:08.612880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60410929-49d7-4c4c-8f6d-2d5aeeb6820d None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:08.613108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60410929-49d7-4c4c-8f6d-2d5aeeb6820d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:08.613663 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60410929-49d7-4c4c-8f6d-2d5aeeb6820d None admin] RBAC: Adding query filter params (role.id=d365054bc34046c5829cd1355f3a31ac, scope.project.id=78d0895fea004a02b1d8338f5fb0250c, user.id=3eab2cbff5984fa6a8e715ed6553db82) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:11:08.613972 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60410929-49d7-4c4c-8f6d-2d5aeeb6820d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:08.615454 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60410929-49d7-4c4c-8f6d-2d5aeeb6820d None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:08.622445 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 651/1287] 10.222.0.83 () {56 vars in 1374 bytes} [Fri Sep 23 01:11:08 2022] GET /identity/v3/role_assignments?user.id=3eab2cbff5984fa6a8e715ed6553db82&scope.project.id=78d0895fea004a02b1d8338f5fb0250c&role.id=d365054bc34046c5829cd1355f3a31ac => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:11:10.893071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a767b7b-364d-49a4-bdab-73ea5e0444ea None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:10.893504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a767b7b-364d-49a4-bdab-73ea5e0444ea None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:10.893620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a767b7b-364d-49a4-bdab-73ea5e0444ea None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:10.895039 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 637/1288] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:11:10.901294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23807c-8070-4949-9d81-ceb41058a244 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:10.901743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23807c-8070-4949-9d81-ceb41058a244 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:10.901847 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23807c-8070-4949-9d81-ceb41058a244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:10.920830 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-1d23807c-8070-4949-9d81-ceb41058a244 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:11:10.922028 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-1d23807c-8070-4949-9d81-ceb41058a244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:11:10.952558 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:10.990662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 652/1289] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:11:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:11:11.263868 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a767b7b-364d-49a4-bdab-73ea5e0444ea None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:11.370933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a767b7b-364d-49a4-bdab-73ea5e0444ea None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:11.382924 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:11.407135 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53176ae2-57d8-4403-b1b4-12fec82fa3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:11.411186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53176ae2-57d8-4403-b1b4-12fec82fa3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:11.411186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53176ae2-57d8-4403-b1b4-12fec82fa3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:11.411186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53176ae2-57d8-4403-b1b4-12fec82fa3f4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:11.411186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53176ae2-57d8-4403-b1b4-12fec82fa3f4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:11.411186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53176ae2-57d8-4403-b1b4-12fec82fa3f4 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:11.419388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-53176ae2-57d8-4403-b1b4-12fec82fa3f4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 01:11:11.419388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:11:11.419388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:11:11.419388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:11:11.419388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:11:11.419388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:11:11.419388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:11:11.419388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:11:11.419388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 01:11:11.419388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:11:11.419388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:11:11.419388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:11:11.419388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:11:11.419388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:11:11.419388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:11:11.419388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:11:11.419388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:11:11.420696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:11:11.420696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:11:11.420696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:11:11.420696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:11:11.420696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:11:11.420696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:11:11.420696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:11:11.420696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:11:11.420696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:11:11.420696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:11:11.420696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:11:11.420696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:11:11.420696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:11:11.420696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:11:11.420696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:11:11.420696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:11:11.421748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:11:11.421748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:11:11.421748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:11:11.421748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:11:11.421748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:11:11.421748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:11:11.421748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:11:11.421748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:11:11.421748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:11:11.421748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:11:11.421748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:11:11.421748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:11:11.421748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 01:11:11.421748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:11:11.421748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 638/1290] 10.222.0.83 () {56 vars in 1117 bytes} [Fri Sep 23 01:11:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:11:11.426689 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23807c-8070-4949-9d81-ceb41058a244 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:11.527329 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23807c-8070-4949-9d81-ceb41058a244 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:11.562144 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d217a5-45bc-40c0-85d0-075f8177a581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:11.562786 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d217a5-45bc-40c0-85d0-075f8177a581 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:11.563721 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d217a5-45bc-40c0-85d0-075f8177a581 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:11.563721 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d217a5-45bc-40c0-85d0-075f8177a581 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:11.565966 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d217a5-45bc-40c0-85d0-075f8177a581 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:11:11.565966 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d217a5-45bc-40c0-85d0-075f8177a581 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:11.565966 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d217a5-45bc-40c0-85d0-075f8177a581 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:11.570847 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 653/1291] 10.222.0.83 () {56 vars in 1116 bytes} [Fri Sep 23 01:11:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:11:11.576774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53176ae2-57d8-4403-b1b4-12fec82fa3f4 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:11.678377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53176ae2-57d8-4403-b1b4-12fec82fa3f4 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:11.713860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f03c33-7cc7-4d2b-a238-4b3912a16d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:11.714477 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f03c33-7cc7-4d2b-a238-4b3912a16d95 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:11.714785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f03c33-7cc7-4d2b-a238-4b3912a16d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:11.715056 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f03c33-7cc7-4d2b-a238-4b3912a16d95 None admin] PATH_INFO: `/v3/services` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:11.715696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f03c33-7cc7-4d2b-a238-4b3912a16d95 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:11:11.715998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f03c33-7cc7-4d2b-a238-4b3912a16d95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:11.717441 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f03c33-7cc7-4d2b-a238-4b3912a16d95 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:11.722536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 639/1292] 10.222.0.83 () {56 vars in 1116 bytes} [Fri Sep 23 01:11:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:11:13.967672 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2757a9a-5f8b-4fcd-9398-adcc7501e453 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:13.968206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2757a9a-5f8b-4fcd-9398-adcc7501e453 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:13.968206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2757a9a-5f8b-4fcd-9398-adcc7501e453 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:13.969586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 654/1293] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:11:13.975724 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfec312-30ee-4e67-ab09-0c7c4f278c9c None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:13.976279 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfec312-30ee-4e67-ab09-0c7c4f278c9c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:13.976279 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfec312-30ee-4e67-ab09-0c7c4f278c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:13.996314 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-cbfec312-30ee-4e67-ab09-0c7c4f278c9c None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:11:13.997563 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-cbfec312-30ee-4e67-ab09-0c7c4f278c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:11:14.032252 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:14.072577 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 640/1294] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:11:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:11:14.338312 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2757a9a-5f8b-4fcd-9398-adcc7501e453 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:14.369415 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:14.440408 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2757a9a-5f8b-4fcd-9398-adcc7501e453 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:14.476695 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf4034-997b-419a-8223-d5c1494d162d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:14.477337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf4034-997b-419a-8223-d5c1494d162d None admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:14.477615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf4034-997b-419a-8223-d5c1494d162d None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:14.477882 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf4034-997b-419a-8223-d5c1494d162d None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:14.478610 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf4034-997b-419a-8223-d5c1494d162d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:14.480065 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf4034-997b-419a-8223-d5c1494d162d None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:14.839288 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 655/1295] 10.222.0.83 () {60 vars in 1141 bytes} [Fri Sep 23 01:11:14 2022] POST /identity/v3/services => generated 246 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:11:17.080140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76ca35-f746-442a-a668-e8801f6a2707 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:17.080712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76ca35-f746-442a-a668-e8801f6a2707 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:17.080712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76ca35-f746-442a-a668-e8801f6a2707 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:17.082135 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 641/1296] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:11:17.089178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bf87c-d6fc-47c7-a41e-e63c6c966d38 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:17.089711 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bf87c-d6fc-47c7-a41e-e63c6c966d38 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:17.089711 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bf87c-d6fc-47c7-a41e-e63c6c966d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:17.110209 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-585bf87c-d6fc-47c7-a41e-e63c6c966d38 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:11:17.111515 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-585bf87c-d6fc-47c7-a41e-e63c6c966d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:11:17.192650 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 656/1297] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:11:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:11:17.467820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76ca35-f746-442a-a668-e8801f6a2707 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:17.575790 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76ca35-f746-442a-a668-e8801f6a2707 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:17.610508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f9c8c-a4f6-4ab7-a052-20ee7bac62c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:17.611153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f9c8c-a4f6-4ab7-a052-20ee7bac62c7 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:17.611427 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f9c8c-a4f6-4ab7-a052-20ee7bac62c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:17.611691 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f9c8c-a4f6-4ab7-a052-20ee7bac62c7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:17.612263 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f9c8c-a4f6-4ab7-a052-20ee7bac62c7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:17.613616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f9c8c-a4f6-4ab7-a052-20ee7bac62c7 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:17.622833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-9d5f9c8c-a4f6-4ab7-a052-20ee7bac62c7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 01:11:17.622833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:11:17.622833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:11:17.622833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:11:17.622833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:11:17.622833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:11:17.622833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:11:17.622833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:11:17.622833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 01:11:17.622833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:11:17.622833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:11:17.622833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:11:17.622833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:11:17.622833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:11:17.622833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:11:17.622833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:11:17.622833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:11:17.624100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:11:17.624100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:11:17.624100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:11:17.624100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:11:17.624100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:11:17.624100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:11:17.624100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:11:17.624100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:11:17.624100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:11:17.624100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:11:17.624100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:11:17.624100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:11:17.624100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:11:17.624100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:11:17.624100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:11:17.624100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:11:17.625171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:11:17.625171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:11:17.625171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:11:17.625171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:11:17.625171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:11:17.625171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:11:17.625171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:11:17.625171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:11:17.625171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:11:17.625171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:11:17.625171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:11:17.625171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:11:17.625171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 01:11:17.625171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:11:17.625171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 642/1298] 10.222.0.83 () {56 vars in 1117 bytes} [Fri Sep 23 01:11:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 01:11:17.630252 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bf87c-d6fc-47c7-a41e-e63c6c966d38 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:17.650457 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:17.744207 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bf87c-d6fc-47c7-a41e-e63c6c966d38 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:17.780802 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d19eb-61e9-4022-a1bd-0b07455e5d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:17.781408 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d19eb-61e9-4022-a1bd-0b07455e5d49 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:17.781689 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d19eb-61e9-4022-a1bd-0b07455e5d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:17.781955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d19eb-61e9-4022-a1bd-0b07455e5d49 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:17.782619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d19eb-61e9-4022-a1bd-0b07455e5d49 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:11:17.782908 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d19eb-61e9-4022-a1bd-0b07455e5d49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:17.784295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d19eb-61e9-4022-a1bd-0b07455e5d49 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:17.789825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 657/1299] 10.222.0.83 () {56 vars in 1116 bytes} [Fri Sep 23 01:11:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:11:17.796200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f9c8c-a4f6-4ab7-a052-20ee7bac62c7 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:17.829437 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:17.902961 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f9c8c-a4f6-4ab7-a052-20ee7bac62c7 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:17.940084 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea717eaf-a126-405d-91e4-18dfa7001b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:17.940698 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea717eaf-a126-405d-91e4-18dfa7001b58 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:17.940972 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea717eaf-a126-405d-91e4-18dfa7001b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:17.941243 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea717eaf-a126-405d-91e4-18dfa7001b58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:17.941947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea717eaf-a126-405d-91e4-18dfa7001b58 None admin] RBAC: Adding query filter params (interface=public, service_id=82c07eb5ba2a46caa209b16986ef5728, region_id=RegionOne) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:11:17.942254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea717eaf-a126-405d-91e4-18dfa7001b58 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:17.943662 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea717eaf-a126-405d-91e4-18dfa7001b58 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:17.950197 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 643/1300] 10.222.0.83 () {56 vars in 1251 bytes} [Fri Sep 23 01:11:17 2022] GET /identity/v3/endpoints?service_id=82c07eb5ba2a46caa209b16986ef5728&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:11:17.956244 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d19eb-61e9-4022-a1bd-0b07455e5d49 None admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:18.038914 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:18.057480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d19eb-61e9-4022-a1bd-0b07455e5d49 None admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:18.092708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68fc51-1cde-4df8-8976-2c2855d8dcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:18.093371 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68fc51-1cde-4df8-8976-2c2855d8dcf3 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:18.093560 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68fc51-1cde-4df8-8976-2c2855d8dcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:18.093823 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68fc51-1cde-4df8-8976-2c2855d8dcf3 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:18.094419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68fc51-1cde-4df8-8976-2c2855d8dcf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:18.095860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68fc51-1cde-4df8-8976-2c2855d8dcf3 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:18.102580 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 658/1301] 10.222.0.83 () {56 vars in 1087 bytes} [Fri Sep 23 01:11:17 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:11:20.282372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123139d-58c1-4633-9d5e-c3107286e899 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:20.282980 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123139d-58c1-4633-9d5e-c3107286e899 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:20.282980 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123139d-58c1-4633-9d5e-c3107286e899 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:20.284444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 644/1302] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:11:20.291875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d08bdd-ed0c-4aec-b467-83129d7cdd04 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:20.292398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d08bdd-ed0c-4aec-b467-83129d7cdd04 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:20.292728 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d08bdd-ed0c-4aec-b467-83129d7cdd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:20.321516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-96d08bdd-ed0c-4aec-b467-83129d7cdd04 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:11:20.322836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-96d08bdd-ed0c-4aec-b467-83129d7cdd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:11:20.393589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 659/1303] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:11:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 01:11:20.666149 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123139d-58c1-4633-9d5e-c3107286e899 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:20.778087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:20.785076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123139d-58c1-4633-9d5e-c3107286e899 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:20.822175 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd9be2-b7c2-41d6-a8e3-c128d9fb2ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:20.822846 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd9be2-b7c2-41d6-a8e3-c128d9fb2ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:20.823127 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd9be2-b7c2-41d6-a8e3-c128d9fb2ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:20.823396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd9be2-b7c2-41d6-a8e3-c128d9fb2ba8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:20.824010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd9be2-b7c2-41d6-a8e3-c128d9fb2ba8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:20.825499 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd9be2-b7c2-41d6-a8e3-c128d9fb2ba8 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:20.836484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application [None req-c7cd9be2-b7c2-41d6-a8e3-c128d9fb2ba8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 01:11:20.836484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:11:20.836484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 01:11:20.836484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 01:11:20.836484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 01:11:20.836484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 01:11:20.836484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 01:11:20.836484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:11:20.836484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 01:11:20.836484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:11:20.836484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 01:11:20.836484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:11:20.836484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 01:11:20.836484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 01:11:20.836484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 01:11:20.836484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 01:11:20.836484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 01:11:20.842372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 01:11:20.842372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 01:11:20.842372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 01:11:20.842372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 01:11:20.842372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 01:11:20.842372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 01:11:20.842372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 01:11:20.842372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 01:11:20.842372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 01:11:20.842372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 01:11:20.842372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 01:11:20.842372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 01:11:20.842372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 01:11:20.842372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 01:11:20.842372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 01:11:20.842372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 01:11:20.843502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 01:11:20.843502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application with Lock( Sep 23 01:11:20.843502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 01:11:20.843502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self._enter() Sep 23 01:11:20.843502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 01:11:20.843502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 01:11:20.843502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 01:11:20.843502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application return self.creator() Sep 23 01:11:20.843502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 01:11:20.843502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application created_value = creator( Sep 23 01:11:20.843502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 01:11:20.843502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 01:11:20.843502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 01:11:20.843502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: ERROR keystone.server.flask.application Sep 23 01:11:20.843502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 645/1304] 10.222.0.83 () {56 vars in 1117 bytes} [Fri Sep 23 01:11:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 01:11:20.844530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d08bdd-ed0c-4aec-b467-83129d7cdd04 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:20.938160 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:20.974538 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d08bdd-ed0c-4aec-b467-83129d7cdd04 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:21.016687 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e4b5b-2ff8-4e5e-a610-7110086eb992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:21.017307 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e4b5b-2ff8-4e5e-a610-7110086eb992 None admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:21.017580 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e4b5b-2ff8-4e5e-a610-7110086eb992 None admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:21.017846 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e4b5b-2ff8-4e5e-a610-7110086eb992 None admin] PATH_INFO: `/v3/services` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:21.018496 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e4b5b-2ff8-4e5e-a610-7110086eb992 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:11:21.018886 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e4b5b-2ff8-4e5e-a610-7110086eb992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:21.020281 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e4b5b-2ff8-4e5e-a610-7110086eb992 None admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:21.027864 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 660/1305] 10.222.0.83 () {56 vars in 1116 bytes} [Fri Sep 23 01:11:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:11:21.034436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd9be2-b7c2-41d6-a8e3-c128d9fb2ba8 None admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:11:21.155105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd9be2-b7c2-41d6-a8e3-c128d9fb2ba8 None admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:11:21.194171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5408e63-5511-4d2b-8da5-1ba1b0d5e686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:11:21.195405 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5408e63-5511-4d2b-8da5-1ba1b0d5e686 None admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:11:21.195627 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5408e63-5511-4d2b-8da5-1ba1b0d5e686 None admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:11:21.195829 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5408e63-5511-4d2b-8da5-1ba1b0d5e686 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:11:21.196581 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5408e63-5511-4d2b-8da5-1ba1b0d5e686 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:11:21.198165 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5408e63-5511-4d2b-8da5-1ba1b0d5e686 None admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:11:21.382963 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 646/1306] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:11:21 2022] POST /identity/v3/endpoints => generated 331 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:11:31.044707 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=30 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:11:31.377723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:18.807342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b7632-9a61-4caa-b23f-18f1df0e9c89 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:18.808798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b7632-9a61-4caa-b23f-18f1df0e9c89 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:18.809506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b7632-9a61-4caa-b23f-18f1df0e9c89 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:18.821252 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859dec2-af25-49e8-a386-58e3c1a5d316 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:18.822658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859dec2-af25-49e8-a386-58e3c1a5d316 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:18.823370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859dec2-af25-49e8-a386-58e3c1a5d316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:18.832657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 661/1307] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:20:18 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:20:18.973628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-1859dec2-af25-49e8-a386-58e3c1a5d316 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:20:18.976126 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-1859dec2-af25-49e8-a386-58e3c1a5d316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:19.192814 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 647/1308] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:20:19.508722 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c09304-6b75-4e74-a468-4d48aae0910d None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:19.509001 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c09304-6b75-4e74-a468-4d48aae0910d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:19.509440 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c09304-6b75-4e74-a468-4d48aae0910d None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:19.510870 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 662/1309] 10.222.0.83 () {54 vars in 964 bytes} [Fri Sep 23 01:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:20:19.517654 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27bbe7-55bc-4876-a1f8-580a8bf4f239 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:19.518018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27bbe7-55bc-4876-a1f8-580a8bf4f239 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:19.518353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27bbe7-55bc-4876-a1f8-580a8bf4f239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:19.610102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-be27bbe7-55bc-4876-a1f8-580a8bf4f239 None None] MFA Rules not processed for user `be2b2806686c4a15b1ace8b6245c4e28`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:20:19.611609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-be27bbe7-55bc-4876-a1f8-580a8bf4f239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:19.636594 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:19.700387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 648/1310] 10.222.0.83 () {58 vars in 1061 bytes} [Fri Sep 23 01:20:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:20:19.712063 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c09304-6b75-4e74-a468-4d48aae0910d None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:20:19.715155 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-06c09304-6b75-4e74-a468-4d48aae0910d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:19.874162 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c09304-6b75-4e74-a468-4d48aae0910d None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:20:19.973317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a770766-dbea-46f4-90ea-3fd17763b65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:20:19.973854 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a770766-dbea-46f4-90ea-3fd17763b65d service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:19.974133 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a770766-dbea-46f4-90ea-3fd17763b65d service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:19.974410 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a770766-dbea-46f4-90ea-3fd17763b65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:19.976323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-0a770766-dbea-46f4-90ea-3fd17763b65d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:20.061050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:20.148688 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a770766-dbea-46f4-90ea-3fd17763b65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:20:20.150578 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a770766-dbea-46f4-90ea-3fd17763b65d service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:20:20.179835 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 663/1311] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:20:22.970183 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecee44-a980-40b7-b2d4-acd521141644 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:22.970993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecee44-a980-40b7-b2d4-acd521141644 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:22.970993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecee44-a980-40b7-b2d4-acd521141644 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:22.972372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 649/1312] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:20:22.978885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65152e3b-e8f0-47bc-86f8-1caee1a70a5e None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:22.979543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65152e3b-e8f0-47bc-86f8-1caee1a70a5e None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:22.979543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65152e3b-e8f0-47bc-86f8-1caee1a70a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:23.072591 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-65152e3b-e8f0-47bc-86f8-1caee1a70a5e None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:20:23.073902 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-65152e3b-e8f0-47bc-86f8-1caee1a70a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:23.183651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 664/1313] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:20:23.727379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecee44-a980-40b7-b2d4-acd521141644 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:20:23.728983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f7ecee44-a980-40b7-b2d4-acd521141644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:23.852282 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecee44-a980-40b7-b2d4-acd521141644 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:20:23.928684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:23.931174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280c168-5ebb-4410-ba80-483ebf1705a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:20:23.931832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280c168-5ebb-4410-ba80-483ebf1705a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:23.932153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280c168-5ebb-4410-ba80-483ebf1705a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:23.932468 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280c168-5ebb-4410-ba80-483ebf1705a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:23.934160 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-5280c168-5ebb-4410-ba80-483ebf1705a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:24.068721 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280c168-5ebb-4410-ba80-483ebf1705a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:20:24.070166 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280c168-5ebb-4410-ba80-483ebf1705a4 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:20:24.089978 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 650/1314] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:20:26.871806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecfec4-23de-4429-b316-ad1891bb6a63 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:26.872363 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecfec4-23de-4429-b316-ad1891bb6a63 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:26.872363 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecfec4-23de-4429-b316-ad1891bb6a63 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:26.878089 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 665/1315] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:20:26.879916 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc0bf1-5b27-49d5-b04b-55b19df1921f None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:26.880362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc0bf1-5b27-49d5-b04b-55b19df1921f None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:26.880453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc0bf1-5b27-49d5-b04b-55b19df1921f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:26.949655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-69fc0bf1-5b27-49d5-b04b-55b19df1921f None None] MFA Rules not processed for user `713912ac902347b893e9f394818adf52`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:20:26.950900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-69fc0bf1-5b27-49d5-b04b-55b19df1921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:27.023886 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:27.073633 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 651/1316] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:20:26 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:20:27.380255 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c26ad5-0a86-4cb0-bc25-c02c6e63107a None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:27.380537 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c26ad5-0a86-4cb0-bc25-c02c6e63107a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:27.380817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c26ad5-0a86-4cb0-bc25-c02c6e63107a None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:27.382247 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 666/1317] 10.222.0.83 () {54 vars in 964 bytes} [Fri Sep 23 01:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:20:27.388623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539647c6-c492-43b2-9745-6903ddf8e495 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:27.388968 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539647c6-c492-43b2-9745-6903ddf8e495 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:27.389247 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539647c6-c492-43b2-9745-6903ddf8e495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:27.481453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-539647c6-c492-43b2-9745-6903ddf8e495 None None] MFA Rules not processed for user `be2b2806686c4a15b1ace8b6245c4e28`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:20:27.482978 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-539647c6-c492-43b2-9745-6903ddf8e495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:27.584049 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 652/1318] 10.222.0.83 () {58 vars in 1061 bytes} [Fri Sep 23 01:20:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:20:27.594515 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c26ad5-0a86-4cb0-bc25-c02c6e63107a None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:20:27.597307 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-09c26ad5-0a86-4cb0-bc25-c02c6e63107a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:27.612487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:27.728209 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c26ad5-0a86-4cb0-bc25-c02c6e63107a None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:20:27.817008 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84d2b3-ad22-4e5a-9dad-3f02d9c08b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:20:27.817652 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84d2b3-ad22-4e5a-9dad-3f02d9c08b26 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:27.817926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84d2b3-ad22-4e5a-9dad-3f02d9c08b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:27.818197 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84d2b3-ad22-4e5a-9dad-3f02d9c08b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:27.819921 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-2c84d2b3-ad22-4e5a-9dad-3f02d9c08b26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:27.900166 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:27.955646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84d2b3-ad22-4e5a-9dad-3f02d9c08b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:20:27.957091 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84d2b3-ad22-4e5a-9dad-3f02d9c08b26 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:20:27.985783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 667/1319] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:20:27 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:20:32.022855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192e8be-772e-4bb8-bcff-37c815bc87a0 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:32.023715 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192e8be-772e-4bb8-bcff-37c815bc87a0 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:32.023715 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192e8be-772e-4bb8-bcff-37c815bc87a0 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:32.025382 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 653/1320] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:20:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:20:32.032475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4376e1-ce74-4f05-9528-337719cd1466 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:32.033311 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4376e1-ce74-4f05-9528-337719cd1466 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:32.033489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4376e1-ce74-4f05-9528-337719cd1466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:32.150712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-bb4376e1-ce74-4f05-9528-337719cd1466 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:20:32.152231 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-bb4376e1-ce74-4f05-9528-337719cd1466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:32.346459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 668/1321] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:20:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:20:32.766480 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192e8be-772e-4bb8-bcff-37c815bc87a0 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:20:32.768699 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a192e8be-772e-4bb8-bcff-37c815bc87a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:32.824153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:32.890680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192e8be-772e-4bb8-bcff-37c815bc87a0 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:20:32.980836 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564dd02-078f-49ec-9462-9c52ff559072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:20:32.981515 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564dd02-078f-49ec-9462-9c52ff559072 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:32.981835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564dd02-078f-49ec-9462-9c52ff559072 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:32.982146 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564dd02-078f-49ec-9462-9c52ff559072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:32.983965 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-c564dd02-078f-49ec-9462-9c52ff559072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:33.117706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:33.136954 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564dd02-078f-49ec-9462-9c52ff559072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:20:33.138485 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564dd02-078f-49ec-9462-9c52ff559072 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:20:33.161999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 654/1322] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:20:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:20:37.544662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66429f-25a6-4ee5-93e0-97bb971b049c None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:37.545236 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66429f-25a6-4ee5-93e0-97bb971b049c None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:37.545730 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66429f-25a6-4ee5-93e0-97bb971b049c None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:37.548371 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 669/1323] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:20:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:20:37.556443 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5202d9a-7476-41e3-8cf1-f006aa86d1d3 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:37.556985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5202d9a-7476-41e3-8cf1-f006aa86d1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:37.557593 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5202d9a-7476-41e3-8cf1-f006aa86d1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:37.686313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-b5202d9a-7476-41e3-8cf1-f006aa86d1d3 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:20:37.687777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b5202d9a-7476-41e3-8cf1-f006aa86d1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:37.816725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 655/1324] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:20:38.350968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66429f-25a6-4ee5-93e0-97bb971b049c None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:20:38.352869 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ae66429f-25a6-4ee5-93e0-97bb971b049c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:38.389779 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:38.549989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66429f-25a6-4ee5-93e0-97bb971b049c None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:20:38.667098 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482a64a-40e0-4e0e-ba7f-73ffedfdf29f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:20:38.668078 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482a64a-40e0-4e0e-ba7f-73ffedfdf29f service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:38.668393 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482a64a-40e0-4e0e-ba7f-73ffedfdf29f service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:38.668767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482a64a-40e0-4e0e-ba7f-73ffedfdf29f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:38.670864 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a482a64a-40e0-4e0e-ba7f-73ffedfdf29f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:38.768152 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:38.841196 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482a64a-40e0-4e0e-ba7f-73ffedfdf29f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:20:38.844114 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482a64a-40e0-4e0e-ba7f-73ffedfdf29f service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:20:38.883298 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 670/1325] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:20:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:20:42.069200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcf91b-08da-4c85-8cd5-d6341d4fa8c0 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:42.069777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcf91b-08da-4c85-8cd5-d6341d4fa8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:42.070124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcf91b-08da-4c85-8cd5-d6341d4fa8c0 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:42.072444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 656/1326] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:20:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:20:42.080665 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93530428-30c2-4a5e-af1d-580c72af2649 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:42.081285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93530428-30c2-4a5e-af1d-580c72af2649 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:42.081546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93530428-30c2-4a5e-af1d-580c72af2649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:42.184167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-93530428-30c2-4a5e-af1d-580c72af2649 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:20:42.185650 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-93530428-30c2-4a5e-af1d-580c72af2649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:42.360881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 671/1327] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:20:42.705249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcf91b-08da-4c85-8cd5-d6341d4fa8c0 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:20:42.708247 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-78bcf91b-08da-4c85-8cd5-d6341d4fa8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:42.824808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:42.906549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcf91b-08da-4c85-8cd5-d6341d4fa8c0 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:20:43.022175 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0414d9b-ed93-4a70-a3fc-a72aa89d61aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:20:43.023021 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0414d9b-ed93-4a70-a3fc-a72aa89d61aa service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:43.023303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0414d9b-ed93-4a70-a3fc-a72aa89d61aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:43.023635 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0414d9b-ed93-4a70-a3fc-a72aa89d61aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:43.025453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d0414d9b-ed93-4a70-a3fc-a72aa89d61aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:43.190398 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:43.192941 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0414d9b-ed93-4a70-a3fc-a72aa89d61aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:20:43.194437 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0414d9b-ed93-4a70-a3fc-a72aa89d61aa service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:20:43.216490 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 657/1328] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:20:45.591328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58552c-ca67-44e7-938b-d9b051006f5a None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:45.592181 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58552c-ca67-44e7-938b-d9b051006f5a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:45.592181 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58552c-ca67-44e7-938b-d9b051006f5a None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:45.594071 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 672/1329] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:20:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:20:45.601638 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3ab91-97f9-441b-b65f-3338d68e944b None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:45.602250 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3ab91-97f9-441b-b65f-3338d68e944b None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:45.602250 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3ab91-97f9-441b-b65f-3338d68e944b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:45.688869 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-a1e3ab91-97f9-441b-b65f-3338d68e944b None None] MFA Rules not processed for user `713912ac902347b893e9f394818adf52`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:20:45.690262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a1e3ab91-97f9-441b-b65f-3338d68e944b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:45.820093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 658/1330] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:20:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:20:46.152174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58552c-ca67-44e7-938b-d9b051006f5a None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:20:46.154267 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-2e58552c-ca67-44e7-938b-d9b051006f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:46.209663 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:46.318571 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58552c-ca67-44e7-938b-d9b051006f5a None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:20:46.461288 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdaf3e-f1d1-4d39-b7ac-50ddf394cb0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:20:46.461907 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdaf3e-f1d1-4d39-b7ac-50ddf394cb0c service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:46.462182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdaf3e-f1d1-4d39-b7ac-50ddf394cb0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:46.462481 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdaf3e-f1d1-4d39-b7ac-50ddf394cb0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:46.465094 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-84cdaf3e-f1d1-4d39-b7ac-50ddf394cb0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:46.599315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:46.657988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdaf3e-f1d1-4d39-b7ac-50ddf394cb0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:20:46.660320 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdaf3e-f1d1-4d39-b7ac-50ddf394cb0c service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:20:46.696080 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 673/1331] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:20:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:20:49.459115 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca1199-0685-413a-a9d3-45c1c469b282 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:49.459747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca1199-0685-413a-a9d3-45c1c469b282 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:49.459747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca1199-0685-413a-a9d3-45c1c469b282 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:49.461087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 659/1332] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:20:49.474203 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a48277-43d5-46af-9be6-68dc86a94124 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:49.474203 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a48277-43d5-46af-9be6-68dc86a94124 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:49.474203 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a48277-43d5-46af-9be6-68dc86a94124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:49.549598 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-f5a48277-43d5-46af-9be6-68dc86a94124 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:20:49.550955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f5a48277-43d5-46af-9be6-68dc86a94124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:49.671988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 674/1333] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:20:49.965265 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca1199-0685-413a-a9d3-45c1c469b282 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:20:49.966980 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-8eca1199-0685-413a-a9d3-45c1c469b282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:50.054960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:50.094507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca1199-0685-413a-a9d3-45c1c469b282 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:20:50.179115 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc963e-2d57-468a-9919-7fb7ea22cc1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:20:50.179726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc963e-2d57-468a-9919-7fb7ea22cc1a service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:50.180004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc963e-2d57-468a-9919-7fb7ea22cc1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:50.180274 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc963e-2d57-468a-9919-7fb7ea22cc1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:50.181887 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-46fc963e-2d57-468a-9919-7fb7ea22cc1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:50.299196 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc963e-2d57-468a-9919-7fb7ea22cc1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:20:50.300643 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc963e-2d57-468a-9919-7fb7ea22cc1a service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:20:50.310943 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:50.319990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 660/1334] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:20:52.554756 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f43100-85e3-416c-aef5-b8fcab95f8dd None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:52.555277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f43100-85e3-416c-aef5-b8fcab95f8dd None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:52.555277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f43100-85e3-416c-aef5-b8fcab95f8dd None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:52.556590 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 675/1335] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:20:52.561878 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012bcc7-28d5-41fb-a660-a8398a244579 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:52.562375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012bcc7-28d5-41fb-a660-a8398a244579 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:52.562508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012bcc7-28d5-41fb-a660-a8398a244579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:52.628839 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-8012bcc7-28d5-41fb-a660-a8398a244579 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:20:52.630065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-8012bcc7-28d5-41fb-a660-a8398a244579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:52.729599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 661/1336] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:20:53.016787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f43100-85e3-416c-aef5-b8fcab95f8dd None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:20:53.018399 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-30f43100-85e3-416c-aef5-b8fcab95f8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:53.061372 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:53.145945 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f43100-85e3-416c-aef5-b8fcab95f8dd None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:20:53.238108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee64ac9-0507-4cc3-9c65-e8dd7dd10212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:20:53.238820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee64ac9-0507-4cc3-9c65-e8dd7dd10212 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:53.239101 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee64ac9-0507-4cc3-9c65-e8dd7dd10212 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:53.239376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee64ac9-0507-4cc3-9c65-e8dd7dd10212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:53.241168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-cee64ac9-0507-4cc3-9c65-e8dd7dd10212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:53.342499 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:53.383525 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee64ac9-0507-4cc3-9c65-e8dd7dd10212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:20:53.385050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee64ac9-0507-4cc3-9c65-e8dd7dd10212 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:20:53.408300 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 676/1337] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:20:56.411992 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb373d-5a4d-4fdb-9d5a-f647c1f264bc None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:56.412565 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb373d-5a4d-4fdb-9d5a-f647c1f264bc None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:56.412565 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb373d-5a4d-4fdb-9d5a-f647c1f264bc None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:56.413938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 662/1338] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:20:56.419722 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce2add-03d7-489c-8852-72f22b729001 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:56.420278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce2add-03d7-489c-8852-72f22b729001 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:56.420278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce2add-03d7-489c-8852-72f22b729001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:56.496369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-30ce2add-03d7-489c-8852-72f22b729001 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:20:56.497598 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-30ce2add-03d7-489c-8852-72f22b729001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:56.607725 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 677/1339] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:20:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:20:56.912100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb373d-5a4d-4fdb-9d5a-f647c1f264bc None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:20:56.913650 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-c4fb373d-5a4d-4fdb-9d5a-f647c1f264bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:57.016826 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:20:57.047619 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb373d-5a4d-4fdb-9d5a-f647c1f264bc None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:20:57.132256 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbac61-80b3-4fb2-9307-d196aecbe5a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:20:57.132917 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbac61-80b3-4fb2-9307-d196aecbe5a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:20:57.133195 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbac61-80b3-4fb2-9307-d196aecbe5a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:20:57.133470 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbac61-80b3-4fb2-9307-d196aecbe5a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:20:57.135169 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-8edbac61-80b3-4fb2-9307-d196aecbe5a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:20:57.267922 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbac61-80b3-4fb2-9307-d196aecbe5a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:20:57.269174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbac61-80b3-4fb2-9307-d196aecbe5a8 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:20:57.289721 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 663/1340] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:20:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:21:02.271222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd7c21-863e-44df-b3fb-4303053bad7f None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:02.271996 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd7c21-863e-44df-b3fb-4303053bad7f None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:02.271996 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd7c21-863e-44df-b3fb-4303053bad7f None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:02.273227 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 678/1341] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:21:02.281362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d89a5c-7d7c-4dfc-8f70-7cf2b9c665f6 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:02.282036 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d89a5c-7d7c-4dfc-8f70-7cf2b9c665f6 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:02.282036 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d89a5c-7d7c-4dfc-8f70-7cf2b9c665f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:02.290462 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:02.395900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-59d89a5c-7d7c-4dfc-8f70-7cf2b9c665f6 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:21:02.406689 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-59d89a5c-7d7c-4dfc-8f70-7cf2b9c665f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:02.548011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 664/1342] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:21:02.935777 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd7c21-863e-44df-b3fb-4303053bad7f None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:21:02.938372 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-5bcd7c21-863e-44df-b3fb-4303053bad7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:03.005895 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:03.104280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd7c21-863e-44df-b3fb-4303053bad7f None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:21:03.220768 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db6a5e-ed22-4d2f-93f5-f006be6fef51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:21:03.221987 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db6a5e-ed22-4d2f-93f5-f006be6fef51 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:03.222491 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db6a5e-ed22-4d2f-93f5-f006be6fef51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:03.223035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db6a5e-ed22-4d2f-93f5-f006be6fef51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:03.226283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-59db6a5e-ed22-4d2f-93f5-f006be6fef51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:03.349496 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:03.370552 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db6a5e-ed22-4d2f-93f5-f006be6fef51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:21:03.372127 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db6a5e-ed22-4d2f-93f5-f006be6fef51 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:21:03.397713 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 679/1343] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:21:07.049566 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a11a25-9e8d-48ef-ad35-1e2d81fcf827 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:07.050091 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a11a25-9e8d-48ef-ad35-1e2d81fcf827 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:07.050203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a11a25-9e8d-48ef-ad35-1e2d81fcf827 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:07.051523 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 665/1344] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:21:07.056989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b636f1-df50-45a2-8c39-0025be9a59b8 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:07.057459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b636f1-df50-45a2-8c39-0025be9a59b8 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:07.057616 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b636f1-df50-45a2-8c39-0025be9a59b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:07.136470 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-20b636f1-df50-45a2-8c39-0025be9a59b8 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:21:07.137617 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-20b636f1-df50-45a2-8c39-0025be9a59b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:07.244923 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 680/1345] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:21:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:21:07.531592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a11a25-9e8d-48ef-ad35-1e2d81fcf827 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:21:07.533206 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-03a11a25-9e8d-48ef-ad35-1e2d81fcf827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:07.637988 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:07.663181 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a11a25-9e8d-48ef-ad35-1e2d81fcf827 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:21:07.759540 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cad767-c585-4225-92e0-f38df20c5b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:21:07.760180 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cad767-c585-4225-92e0-f38df20c5b94 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:07.760507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cad767-c585-4225-92e0-f38df20c5b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:07.760735 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cad767-c585-4225-92e0-f38df20c5b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:07.762441 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-26cad767-c585-4225-92e0-f38df20c5b94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:07.950876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cad767-c585-4225-92e0-f38df20c5b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:21:07.952369 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cad767-c585-4225-92e0-f38df20c5b94 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:21:07.977239 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 666/1346] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:21:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:21:12.657361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060813e-999e-4ba8-b33e-e81a6d9c1193 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:12.658152 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060813e-999e-4ba8-b33e-e81a6d9c1193 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:12.658152 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060813e-999e-4ba8-b33e-e81a6d9c1193 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:12.659290 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 681/1347] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:21:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:21:12.672481 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225284f3-1be1-44f1-8842-ff9e84d7e48e None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:12.673022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225284f3-1be1-44f1-8842-ff9e84d7e48e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:12.673022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225284f3-1be1-44f1-8842-ff9e84d7e48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:12.690423 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:12.760389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-225284f3-1be1-44f1-8842-ff9e84d7e48e None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:21:12.761623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-225284f3-1be1-44f1-8842-ff9e84d7e48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:12.876829 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 667/1348] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:21:13.162428 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060813e-999e-4ba8-b33e-e81a6d9c1193 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:21:13.164008 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-9060813e-999e-4ba8-b33e-e81a6d9c1193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:13.230144 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:13.282292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060813e-999e-4ba8-b33e-e81a6d9c1193 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:21:13.367822 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811d538-89b0-4220-b722-6ce979cdad7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:21:13.368345 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811d538-89b0-4220-b722-6ce979cdad7e service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:13.368626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811d538-89b0-4220-b722-6ce979cdad7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:13.368897 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811d538-89b0-4220-b722-6ce979cdad7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:13.370518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b811d538-89b0-4220-b722-6ce979cdad7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:13.479206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:13.483072 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811d538-89b0-4220-b722-6ce979cdad7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:21:13.485240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811d538-89b0-4220-b722-6ce979cdad7e service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:21:13.504537 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 682/1349] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:21:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:21:19.068440 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730156db-fdf5-4a3e-a854-b85f24387b86 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:19.069337 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730156db-fdf5-4a3e-a854-b85f24387b86 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:19.076840 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730156db-fdf5-4a3e-a854-b85f24387b86 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:19.076840 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 668/1350] 10.222.0.83 () {54 vars in 921 bytes} [Fri Sep 23 01:21:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:21:19.082477 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bda4c7-9dbc-42f6-9c9f-0629b0312768 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:19.082477 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bda4c7-9dbc-42f6-9c9f-0629b0312768 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:19.082477 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bda4c7-9dbc-42f6-9c9f-0629b0312768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:19.198878 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-82bda4c7-9dbc-42f6-9c9f-0629b0312768 None None] MFA Rules not processed for user `3eab2cbff5984fa6a8e715ed6553db82`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:21:19.200191 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-82bda4c7-9dbc-42f6-9c9f-0629b0312768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:19.523487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 683/1351] 10.222.0.83 () {58 vars in 1018 bytes} [Fri Sep 23 01:21:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:21:22.875374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=59 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:24.460647 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df272b5-786c-4d72-b097-803b83c70166 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:24.461291 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df272b5-786c-4d72-b097-803b83c70166 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:24.461997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df272b5-786c-4d72-b097-803b83c70166 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:24.465831 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 669/1352] 10.222.0.83 () {54 vars in 921 bytes} [Fri Sep 23 01:21:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:21:24.474966 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f1fe6-3dad-4df3-be66-31fa8bd10b4d None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:24.475823 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f1fe6-3dad-4df3-be66-31fa8bd10b4d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:24.476159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f1fe6-3dad-4df3-be66-31fa8bd10b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:24.574849 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:24.603404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-d76f1fe6-3dad-4df3-be66-31fa8bd10b4d None None] MFA Rules not processed for user `3eab2cbff5984fa6a8e715ed6553db82`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:21:24.604996 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-d76f1fe6-3dad-4df3-be66-31fa8bd10b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:24.799419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 684/1353] 10.222.0.83 () {58 vars in 1018 bytes} [Fri Sep 23 01:21:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:21:26.513880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d4642-6510-4c36-9bb8-a2d3d9047f1c None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:26.514734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d4642-6510-4c36-9bb8-a2d3d9047f1c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:26.515664 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d4642-6510-4c36-9bb8-a2d3d9047f1c None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:26.518520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 670/1354] 10.222.0.83 () {54 vars in 921 bytes} [Fri Sep 23 01:21:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:21:26.525577 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5ef85-07aa-41d2-91fd-7355b7e6a3ad None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:26.526287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5ef85-07aa-41d2-91fd-7355b7e6a3ad None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:26.526574 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5ef85-07aa-41d2-91fd-7355b7e6a3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:26.656005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-31a5ef85-07aa-41d2-91fd-7355b7e6a3ad None None] MFA Rules not processed for user `3eab2cbff5984fa6a8e715ed6553db82`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:21:26.657921 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-31a5ef85-07aa-41d2-91fd-7355b7e6a3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:26.725603 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:26.878774 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 685/1355] 10.222.0.83 () {58 vars in 1018 bytes} [Fri Sep 23 01:21:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:21:30.833683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a2a4f-08c8-4866-9375-b6b3190ae113 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:30.834469 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a2a4f-08c8-4866-9375-b6b3190ae113 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:30.834469 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a2a4f-08c8-4866-9375-b6b3190ae113 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:30.839991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 671/1356] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:21:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:21:30.847991 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a3423-ef2c-46bc-899a-e9264790a350 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:30.849294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a3423-ef2c-46bc-899a-e9264790a350 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:30.850130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a3423-ef2c-46bc-899a-e9264790a350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:30.989295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-167a3423-ef2c-46bc-899a-e9264790a350 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:21:30.990836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-167a3423-ef2c-46bc-899a-e9264790a350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:31.139087 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 686/1357] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:21:31.556951 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5bca7-1aa5-4472-a7c5-68884d1975cb None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:31.557233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5bca7-1aa5-4472-a7c5-68884d1975cb None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:31.557819 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5bca7-1aa5-4472-a7c5-68884d1975cb None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:31.559732 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 672/1358] 10.222.0.83 () {54 vars in 961 bytes} [Fri Sep 23 01:21:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:21:31.571360 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe684f3-6018-48d7-8569-154f46a0c923 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:31.572198 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe684f3-6018-48d7-8569-154f46a0c923 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:31.572869 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe684f3-6018-48d7-8569-154f46a0c923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:31.597156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:31.663677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-dbe684f3-6018-48d7-8569-154f46a0c923 None None] MFA Rules not processed for user `824648d693af4b44ae5df853a3d258f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:21:31.664878 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-dbe684f3-6018-48d7-8569-154f46a0c923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:31.830433 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 687/1359] 10.222.0.83 () {58 vars in 1058 bytes} [Fri Sep 23 01:21:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:21:31.838150 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5bca7-1aa5-4472-a7c5-68884d1975cb None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:21:31.839986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b0d5bca7-1aa5-4472-a7c5-68884d1975cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:32.057283 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5bca7-1aa5-4472-a7c5-68884d1975cb None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:21:32.174394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:32.246285 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34068f-89f7-40b2-a773-dce764ab51b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:21:32.247237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34068f-89f7-40b2-a773-dce764ab51b8 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:32.247663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34068f-89f7-40b2-a773-dce764ab51b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:32.248084 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34068f-89f7-40b2-a773-dce764ab51b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:32.250846 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-4a34068f-89f7-40b2-a773-dce764ab51b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:32.455638 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34068f-89f7-40b2-a773-dce764ab51b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:21:32.458754 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34068f-89f7-40b2-a773-dce764ab51b8 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:21:32.501185 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 673/1360] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:21:35.161053 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997546c-2afe-472a-953d-51434f4972f5 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:35.162117 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997546c-2afe-472a-953d-51434f4972f5 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:35.162117 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997546c-2afe-472a-953d-51434f4972f5 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:35.163835 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 688/1361] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:21:35.169086 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26866fd3-1688-4da3-9ff5-c61880dbd533 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:35.169747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26866fd3-1688-4da3-9ff5-c61880dbd533 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:35.169747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26866fd3-1688-4da3-9ff5-c61880dbd533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:35.275695 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-26866fd3-1688-4da3-9ff5-c61880dbd533 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:21:35.276589 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-26866fd3-1688-4da3-9ff5-c61880dbd533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:35.332894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:35.416033 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 674/1362] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:21:35.819886 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997546c-2afe-472a-953d-51434f4972f5 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:21:35.822215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-9997546c-2afe-472a-953d-51434f4972f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:35.975628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:36.125492 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997546c-2afe-472a-953d-51434f4972f5 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:21:36.296361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390dfa1-16e1-4dfe-b6bc-03b941d693dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:21:36.297380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390dfa1-16e1-4dfe-b6bc-03b941d693dd service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:36.297380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390dfa1-16e1-4dfe-b6bc-03b941d693dd service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:36.297698 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390dfa1-16e1-4dfe-b6bc-03b941d693dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:36.299880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-5390dfa1-16e1-4dfe-b6bc-03b941d693dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:36.344004 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:36.454056 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390dfa1-16e1-4dfe-b6bc-03b941d693dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:21:36.457284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390dfa1-16e1-4dfe-b6bc-03b941d693dd service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:21:36.492698 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 689/1363] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:21:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:21:40.512267 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7de418-9447-4c8f-851d-e29f8cc5e383 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:40.513155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7de418-9447-4c8f-851d-e29f8cc5e383 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:40.513155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7de418-9447-4c8f-851d-e29f8cc5e383 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:40.521905 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 675/1364] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:21:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:21:40.525751 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc8a6d-c130-4bae-91c0-d1ca7d628a41 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:40.526648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc8a6d-c130-4bae-91c0-d1ca7d628a41 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:40.527746 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc8a6d-c130-4bae-91c0-d1ca7d628a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:40.688103 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-08bc8a6d-c130-4bae-91c0-d1ca7d628a41 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:21:40.689895 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-08bc8a6d-c130-4bae-91c0-d1ca7d628a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:40.889568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:40.893802 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 690/1365] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:21:41.301960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092f5f3-3e27-4d84-9255-1b8a9da461db None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:41.302245 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092f5f3-3e27-4d84-9255-1b8a9da461db None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:41.302540 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092f5f3-3e27-4d84-9255-1b8a9da461db None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:41.304063 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 676/1366] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:21:41.312403 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f9a4e-a03e-469b-8a5c-1f7a95c97f62 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:41.312837 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f9a4e-a03e-469b-8a5c-1f7a95c97f62 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:41.313323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f9a4e-a03e-469b-8a5c-1f7a95c97f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:41.438702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-7b6f9a4e-a03e-469b-8a5c-1f7a95c97f62 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:21:41.440706 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-7b6f9a4e-a03e-469b-8a5c-1f7a95c97f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:41.446685 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085b39d-2afc-481c-ae08-6b3d1464ed2d None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:41.447753 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085b39d-2afc-481c-ae08-6b3d1464ed2d None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:41.448407 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085b39d-2afc-481c-ae08-6b3d1464ed2d None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:41.453193 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 677/1367] 10.222.0.83 () {54 vars in 961 bytes} [Fri Sep 23 01:21:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:21:41.464105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6daf0-8097-43a4-b26e-eecc3d6a389a None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:41.464805 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6daf0-8097-43a4-b26e-eecc3d6a389a None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:41.465378 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6daf0-8097-43a4-b26e-eecc3d6a389a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:41.626245 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-81f6daf0-8097-43a4-b26e-eecc3d6a389a None None] MFA Rules not processed for user `824648d693af4b44ae5df853a3d258f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:21:41.628012 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-81f6daf0-8097-43a4-b26e-eecc3d6a389a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:41.651298 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 691/1368] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:21:41.870581 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:41.912250 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 678/1369] 10.222.0.83 () {58 vars in 1058 bytes} [Fri Sep 23 01:21:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:21:41.927107 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f9a4e-a03e-469b-8a5c-1f7a95c97f62 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:21:41.928945 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-7b6f9a4e-a03e-469b-8a5c-1f7a95c97f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:42.080104 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:42.129445 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553241d7-3ab6-49bd-bf79-1f1ead93bcc2 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:42.129938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553241d7-3ab6-49bd-bf79-1f1ead93bcc2 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:42.130479 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553241d7-3ab6-49bd-bf79-1f1ead93bcc2 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:42.133920 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 679/1370] 10.222.0.83 () {54 vars in 963 bytes} [Fri Sep 23 01:21:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:21:42.144890 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a23b7-b1f3-4ade-a50b-85724ef31127 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:42.145311 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a23b7-b1f3-4ade-a50b-85724ef31127 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:42.145753 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a23b7-b1f3-4ade-a50b-85724ef31127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:42.165834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f9a4e-a03e-469b-8a5c-1f7a95c97f62 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:21:42.308766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-381a23b7-b1f3-4ade-a50b-85724ef31127 None None] MFA Rules not processed for user `9f71db705b08460996a729a88c82bb63`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:21:42.309880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-381a23b7-b1f3-4ade-a50b-85724ef31127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:42.449576 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507cc30-dde6-42b9-a869-9efad1bcd8ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:21:42.450780 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507cc30-dde6-42b9-a869-9efad1bcd8ab service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:42.451491 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507cc30-dde6-42b9-a869-9efad1bcd8ab service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:42.453655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507cc30-dde6-42b9-a869-9efad1bcd8ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:42.456627 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a507cc30-dde6-42b9-a869-9efad1bcd8ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:42.468966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 680/1371] 10.222.0.83 () {58 vars in 1060 bytes} [Fri Sep 23 01:21:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:21:42.474193 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a23b7-b1f3-4ade-a50b-85724ef31127 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:21:42.490432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a23b7-b1f3-4ade-a50b-85724ef31127 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:21:42.631295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:42.664130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507cc30-dde6-42b9-a869-9efad1bcd8ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:21:42.667172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507cc30-dde6-42b9-a869-9efad1bcd8ab service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:21:42.674760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f517b-249b-4f6f-aeda-c4b9f9cfd916 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:21:42.676743 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:42.677660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f517b-249b-4f6f-aeda-c4b9f9cfd916 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:42.679413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f517b-249b-4f6f-aeda-c4b9f9cfd916 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:42.679963 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f517b-249b-4f6f-aeda-c4b9f9cfd916 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:42.685518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d30f517b-249b-4f6f-aeda-c4b9f9cfd916 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:42.710838 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 692/1372] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:21:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 784 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:21:42.908564 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f517b-249b-4f6f-aeda-c4b9f9cfd916 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:21:42.913669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f517b-249b-4f6f-aeda-c4b9f9cfd916 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:21:42.957158 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 681/1373] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:21:45.822872 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0c0d2-6dc6-4c9b-9641-173743a284fa None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:45.823704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0c0d2-6dc6-4c9b-9641-173743a284fa None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:45.823704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0c0d2-6dc6-4c9b-9641-173743a284fa None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:45.825185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 693/1374] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:21:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:21:45.835016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613414c-9bc7-4e15-b639-9e4c200510ce None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:45.835662 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613414c-9bc7-4e15-b639-9e4c200510ce None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:45.836048 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613414c-9bc7-4e15-b639-9e4c200510ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:45.974543 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-7613414c-9bc7-4e15-b639-9e4c200510ce None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:21:45.976781 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-7613414c-9bc7-4e15-b639-9e4c200510ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:46.073861 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:46.144912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 682/1375] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:21:46.613389 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0c0d2-6dc6-4c9b-9641-173743a284fa None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:21:46.615672 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-41a0c0d2-6dc6-4c9b-9641-173743a284fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:46.914656 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0c0d2-6dc6-4c9b-9641-173743a284fa None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:21:47.031201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:47.144810 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad2a48-3910-481e-8d99-285124c1608a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:21:47.145353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad2a48-3910-481e-8d99-285124c1608a service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:47.145677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad2a48-3910-481e-8d99-285124c1608a service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:47.145949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad2a48-3910-481e-8d99-285124c1608a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:47.148052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a8ad2a48-3910-481e-8d99-285124c1608a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:47.306322 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad2a48-3910-481e-8d99-285124c1608a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:21:47.310336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad2a48-3910-481e-8d99-285124c1608a service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:21:47.350359 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 694/1376] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 737 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:21:50.394632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e97664-8d1a-4b82-9927-bff35f707a47 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:50.396512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e97664-8d1a-4b82-9927-bff35f707a47 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:50.397631 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e97664-8d1a-4b82-9927-bff35f707a47 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:50.401680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 683/1377] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:21:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:21:50.408443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba39b10-23ed-4067-a379-c42d8b577013 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:50.412356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba39b10-23ed-4067-a379-c42d8b577013 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:50.412356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba39b10-23ed-4067-a379-c42d8b577013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:50.546580 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-4ba39b10-23ed-4067-a379-c42d8b577013 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:21:50.548857 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4ba39b10-23ed-4067-a379-c42d8b577013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:50.578702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:50.747798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 695/1378] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:21:51.158531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e97664-8d1a-4b82-9927-bff35f707a47 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:21:51.160423 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-66e97664-8d1a-4b82-9927-bff35f707a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:51.335900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e97664-8d1a-4b82-9927-bff35f707a47 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:21:51.386953 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:51.487439 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799493e0-3f76-40a2-b1c5-0b18ba15e3c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:21:51.489523 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799493e0-3f76-40a2-b1c5-0b18ba15e3c0 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:51.489523 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799493e0-3f76-40a2-b1c5-0b18ba15e3c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:51.489523 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799493e0-3f76-40a2-b1c5-0b18ba15e3c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:51.490492 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-799493e0-3f76-40a2-b1c5-0b18ba15e3c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:51.622350 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799493e0-3f76-40a2-b1c5-0b18ba15e3c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:21:51.625468 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799493e0-3f76-40a2-b1c5-0b18ba15e3c0 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:21:51.660017 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 684/1379] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:21:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:21:54.385647 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2654ba1-1af7-49d3-9911-8c599013579a None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:54.386433 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2654ba1-1af7-49d3-9911-8c599013579a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:54.386849 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2654ba1-1af7-49d3-9911-8c599013579a None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:54.389426 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 696/1380] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:21:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:21:54.396283 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c52847-6d5f-409a-b475-b41dfd7c8e65 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:54.397388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c52847-6d5f-409a-b475-b41dfd7c8e65 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:54.397388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c52847-6d5f-409a-b475-b41dfd7c8e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:54.491179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:54.511011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-25c52847-6d5f-409a-b475-b41dfd7c8e65 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:21:54.512392 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-25c52847-6d5f-409a-b475-b41dfd7c8e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:54.660477 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 685/1381] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:21:54.964659 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2654ba1-1af7-49d3-9911-8c599013579a None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:21:54.968867 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f2654ba1-1af7-49d3-9911-8c599013579a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:55.215967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:55.230807 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2654ba1-1af7-49d3-9911-8c599013579a None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:21:55.440799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52357e-b49e-4b50-83d6-fd4cb30dff23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:21:55.441939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52357e-b49e-4b50-83d6-fd4cb30dff23 service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:55.442328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52357e-b49e-4b50-83d6-fd4cb30dff23 service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:55.442832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52357e-b49e-4b50-83d6-fd4cb30dff23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:55.446039 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-5e52357e-b49e-4b50-83d6-fd4cb30dff23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:55.589796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52357e-b49e-4b50-83d6-fd4cb30dff23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:21:55.592052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52357e-b49e-4b50-83d6-fd4cb30dff23 service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:21:55.616810 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:55.624777 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 697/1382] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:21:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:21:58.382935 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b404c-df38-4a2e-9f84-9081e3db624b None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:58.389977 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b404c-df38-4a2e-9f84-9081e3db624b None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:58.389977 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b404c-df38-4a2e-9f84-9081e3db624b None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:58.389977 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 686/1383] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:21:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:21:58.395043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b55753-d0bd-4946-bb5a-27252ff2007a None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:58.396206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b55753-d0bd-4946-bb5a-27252ff2007a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:58.396206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b55753-d0bd-4946-bb5a-27252ff2007a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:58.521716 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-49b55753-d0bd-4946-bb5a-27252ff2007a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:21:58.524164 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-49b55753-d0bd-4946-bb5a-27252ff2007a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:58.721485 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 698/1384] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:21:59.085225 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b404c-df38-4a2e-9f84-9081e3db624b None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:21:59.089315 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b87b404c-df38-4a2e-9f84-9081e3db624b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:59.339916 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:59.389587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b404c-df38-4a2e-9f84-9081e3db624b None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:21:59.613811 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727b1cb-733c-40da-80ec-278086f23bf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:21:59.614341 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727b1cb-733c-40da-80ec-278086f23bf5 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:21:59.614781 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727b1cb-733c-40da-80ec-278086f23bf5 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:21:59.615056 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727b1cb-733c-40da-80ec-278086f23bf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:21:59.616881 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d727b1cb-733c-40da-80ec-278086f23bf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:21:59.752854 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:59.768015 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727b1cb-733c-40da-80ec-278086f23bf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:21:59.770020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727b1cb-733c-40da-80ec-278086f23bf5 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:21:59.792350 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 687/1385] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:22:01.757012 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af901a-dc39-4818-b276-14efde03fbbe None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:01.757701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af901a-dc39-4818-b276-14efde03fbbe None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:01.757701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af901a-dc39-4818-b276-14efde03fbbe None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:01.759168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 699/1386] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:22:01.765524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff40da-62b8-4d23-ac50-a921ff13d6fc None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:01.766195 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff40da-62b8-4d23-ac50-a921ff13d6fc None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:01.766195 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff40da-62b8-4d23-ac50-a921ff13d6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:01.869081 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-70ff40da-62b8-4d23-ac50-a921ff13d6fc None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:01.870409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-70ff40da-62b8-4d23-ac50-a921ff13d6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:02.027933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 688/1387] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:22:02.393361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef8f30-64d0-478c-b229-bdc767356e64 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:02.393639 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef8f30-64d0-478c-b229-bdc767356e64 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:02.393990 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef8f30-64d0-478c-b229-bdc767356e64 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:02.395994 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 700/1388] 10.222.0.83 () {54 vars in 962 bytes} [Fri Sep 23 01:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:22:02.404440 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a0e83-fd5d-457b-b1bc-533da40641b4 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:02.404920 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a0e83-fd5d-457b-b1bc-533da40641b4 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:02.407559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a0e83-fd5d-457b-b1bc-533da40641b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:02.553056 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-716a0e83-fd5d-457b-b1bc-533da40641b4 None None] MFA Rules not processed for user `f5b3a7a9a08e40718980143d7c4880ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:02.554461 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-716a0e83-fd5d-457b-b1bc-533da40641b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:02.556991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:02.713539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 689/1389] 10.222.0.83 () {58 vars in 1059 bytes} [Fri Sep 23 01:22:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:22:02.724437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef8f30-64d0-478c-b229-bdc767356e64 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:22:02.726396 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-edef8f30-64d0-478c-b229-bdc767356e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:02.750892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e0f08-7dd2-42b0-bd3b-fdd0f8e9b08f None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:02.751175 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e0f08-7dd2-42b0-bd3b-fdd0f8e9b08f None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:02.751436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e0f08-7dd2-42b0-bd3b-fdd0f8e9b08f None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:02.752907 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 690/1390] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:22:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:22:02.758985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7ccc2-d395-47b7-ab41-b7ef6176c1db None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:02.759272 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7ccc2-d395-47b7-ab41-b7ef6176c1db None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:02.759644 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7ccc2-d395-47b7-ab41-b7ef6176c1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:02.844418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-98d7ccc2-d395-47b7-ab41-b7ef6176c1db None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:02.846234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-98d7ccc2-d395-47b7-ab41-b7ef6176c1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:02.854404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:02.896621 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef8f30-64d0-478c-b229-bdc767356e64 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:22:02.991575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 691/1391] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:22:03.015840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c379f4-e63a-42d1-923f-0941c140c440 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5b3a7a9a08e40718980143d7c4880ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:22:03.016455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c379f4-e63a-42d1-923f-0941c140c440 service glance] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:03.016734 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c379f4-e63a-42d1-923f-0941c140c440 service glance] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:03.017097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c379f4-e63a-42d1-923f-0941c140c440 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:03.019278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-67c379f4-e63a-42d1-923f-0941c140c440 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:03.192443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c379f4-e63a-42d1-923f-0941c140c440 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:22:03.193979 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c379f4-e63a-42d1-923f-0941c140c440 service glance] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:22:03.215927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 701/1392] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:22:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:22:03.369071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7ccc2-d395-47b7-ab41-b7ef6176c1db None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:22:03.370281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-98d7ccc2-d395-47b7-ab41-b7ef6176c1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:03.379474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:03.570317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7ccc2-d395-47b7-ab41-b7ef6176c1db None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:22:03.760958 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e93ba7-7435-4f04-a796-ec0305a1987c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:22:03.761791 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e93ba7-7435-4f04-a796-ec0305a1987c service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:03.762152 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e93ba7-7435-4f04-a796-ec0305a1987c service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:03.762575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e93ba7-7435-4f04-a796-ec0305a1987c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:03.765255 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a2e93ba7-7435-4f04-a796-ec0305a1987c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:03.768204 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:03.899740 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e93ba7-7435-4f04-a796-ec0305a1987c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:22:03.901607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e93ba7-7435-4f04-a796-ec0305a1987c service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:22:03.926558 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 692/1393] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:22:04.385978 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbd645-91c8-4a40-8c49-b58b4f2b0b38 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:04.386859 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbd645-91c8-4a40-8c49-b58b4f2b0b38 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:04.386859 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbd645-91c8-4a40-8c49-b58b4f2b0b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:04.398579 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:04.500739 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-c5dbd645-91c8-4a40-8c49-b58b4f2b0b38 None None] MFA Rules not processed for user `f2cea4c08f324769bf6dcea58c9394b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:04.502093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-c5dbd645-91c8-4a40-8c49-b58b4f2b0b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:04.628608 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 702/1394] 10.222.0.83 () {58 vars in 1009 bytes} [Fri Sep 23 01:22:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:22:04.684299 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d183ca-29a6-4a26-88e6-e05921b11467 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:04.684634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d183ca-29a6-4a26-88e6-e05921b11467 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:04.684860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d183ca-29a6-4a26-88e6-e05921b11467 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:04.686261 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 693/1395] 10.222.0.83 () {54 vars in 943 bytes} [Fri Sep 23 01:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:22:04.694524 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56ab39-fd24-4d6a-8388-e4cac980b33f None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:04.694871 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56ab39-fd24-4d6a-8388-e4cac980b33f None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:04.695088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56ab39-fd24-4d6a-8388-e4cac980b33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:04.796732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-8a56ab39-fd24-4d6a-8388-e4cac980b33f None None] MFA Rules not processed for user `c526c7ad227943d1a2bba7b5e2e039e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:04.797996 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-8a56ab39-fd24-4d6a-8388-e4cac980b33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:04.855990 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:04.986344 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 703/1396] 10.222.0.83 () {58 vars in 1040 bytes} [Fri Sep 23 01:22:04 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:22:04.996148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d183ca-29a6-4a26-88e6-e05921b11467 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:22:04.997732 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b5d183ca-29a6-4a26-88e6-e05921b11467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:05.204270 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:05.218070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d183ca-29a6-4a26-88e6-e05921b11467 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:22:05.380535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bf24e-4bf3-4d63-88ac-7e73e0657afa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526c7ad227943d1a2bba7b5e2e039e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:22:05.381155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bf24e-4bf3-4d63-88ac-7e73e0657afa service swift] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:05.381433 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bf24e-4bf3-4d63-88ac-7e73e0657afa service swift] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:05.381735 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bf24e-4bf3-4d63-88ac-7e73e0657afa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:05.383548 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-4a9bf24e-4bf3-4d63-88ac-7e73e0657afa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:05.513523 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9bf24e-4bf3-4d63-88ac-7e73e0657afa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:22:05.515547 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9bf24e-4bf3-4d63-88ac-7e73e0657afa service swift] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:22:05.526558 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 694/1397] 10.222.0.83 () {60 vars in 1384 bytes} [Fri Sep 23 01:22:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 01:22:06.578828 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e7f22-e059-4aff-aa94-7aa8360a66e4 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:06.579760 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e7f22-e059-4aff-aa94-7aa8360a66e4 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:06.579760 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e7f22-e059-4aff-aa94-7aa8360a66e4 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:06.586082 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 704/1398] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:22:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:22:06.588803 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fc98e-ca68-45c3-8f42-38a1b2472c8e None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:06.589474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fc98e-ca68-45c3-8f42-38a1b2472c8e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:06.589709 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fc98e-ca68-45c3-8f42-38a1b2472c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:06.639485 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:06.685712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-6f1fc98e-ca68-45c3-8f42-38a1b2472c8e None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:06.688354 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-6f1fc98e-ca68-45c3-8f42-38a1b2472c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:06.894896 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 695/1399] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:22:07.193978 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e7f22-e059-4aff-aa94-7aa8360a66e4 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:22:07.194207 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-c13e7f22-e059-4aff-aa94-7aa8360a66e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:07.426639 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e7f22-e059-4aff-aa94-7aa8360a66e4 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:22:07.455400 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:07.634942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645e8d4-f44e-4d98-a6d3-0e7989366273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:22:07.695533 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645e8d4-f44e-4d98-a6d3-0e7989366273 service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:07.695533 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645e8d4-f44e-4d98-a6d3-0e7989366273 service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:07.695533 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645e8d4-f44e-4d98-a6d3-0e7989366273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:07.695533 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-5645e8d4-f44e-4d98-a6d3-0e7989366273 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:07.790333 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645e8d4-f44e-4d98-a6d3-0e7989366273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:22:07.792308 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645e8d4-f44e-4d98-a6d3-0e7989366273 service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:22:07.820436 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 705/1400] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:22:11.296739 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1007c2-c42e-4bdc-8daf-725f3661953e None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:11.298961 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1007c2-c42e-4bdc-8daf-725f3661953e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:11.299389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1007c2-c42e-4bdc-8daf-725f3661953e None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:11.301491 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 696/1401] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:22:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:22:11.307767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c11f2-68f0-480d-a674-a8b2a73c13ca None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:11.308530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c11f2-68f0-480d-a674-a8b2a73c13ca None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:11.308530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c11f2-68f0-480d-a674-a8b2a73c13ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:11.335366 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:11.418676 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-032c11f2-68f0-480d-a674-a8b2a73c13ca None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:11.420548 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-032c11f2-68f0-480d-a674-a8b2a73c13ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:11.621920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 706/1402] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:22:12.113080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1007c2-c42e-4bdc-8daf-725f3661953e None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:22:12.116297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-3b1007c2-c42e-4bdc-8daf-725f3661953e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:12.334160 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:12.419610 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1007c2-c42e-4bdc-8daf-725f3661953e None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:22:12.694210 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd185ea-883d-4bef-b344-0da94e1c520e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:22:12.695268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd185ea-883d-4bef-b344-0da94e1c520e service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:12.695619 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd185ea-883d-4bef-b344-0da94e1c520e service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:12.695966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd185ea-883d-4bef-b344-0da94e1c520e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:12.699381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-4bd185ea-883d-4bef-b344-0da94e1c520e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:12.853854 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:12.887895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd185ea-883d-4bef-b344-0da94e1c520e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:22:12.890964 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd185ea-883d-4bef-b344-0da94e1c520e service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:22:12.920781 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 697/1403] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:22:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 809 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:22:16.289840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6db4da-7a84-4310-8ded-f60fec97fa83 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:16.290905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6db4da-7a84-4310-8ded-f60fec97fa83 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:16.291405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6db4da-7a84-4310-8ded-f60fec97fa83 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:16.295248 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 707/1404] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:22:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:22:16.304509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62ff42-5bed-4f8a-a0e2-6be9c258b8c5 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:16.306092 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62ff42-5bed-4f8a-a0e2-6be9c258b8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:16.306883 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62ff42-5bed-4f8a-a0e2-6be9c258b8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:16.470177 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-7f62ff42-5bed-4f8a-a0e2-6be9c258b8c5 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:16.472456 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-7f62ff42-5bed-4f8a-a0e2-6be9c258b8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:16.699142 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 698/1405] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:22:17.265913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6db4da-7a84-4310-8ded-f60fec97fa83 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:22:17.269867 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-de6db4da-7a84-4310-8ded-f60fec97fa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:17.428776 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:17.522359 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6db4da-7a84-4310-8ded-f60fec97fa83 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:22:17.785783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94aed1-e319-4010-8ce1-d99fb674d6ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:22:17.786939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94aed1-e319-4010-8ce1-d99fb674d6ca service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:17.787511 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94aed1-e319-4010-8ce1-d99fb674d6ca service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:17.787974 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94aed1-e319-4010-8ce1-d99fb674d6ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:17.791435 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4a94aed1-e319-4010-8ce1-d99fb674d6ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:17.941817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:18.036450 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94aed1-e319-4010-8ce1-d99fb674d6ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:22:18.040021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94aed1-e319-4010-8ce1-d99fb674d6ca service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:22:18.090719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 708/1406] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 826 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:22:21.300901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df212d-3d96-437a-8bcb-1f85c6a894ab None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:21.302162 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df212d-3d96-437a-8bcb-1f85c6a894ab None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:21.302162 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df212d-3d96-437a-8bcb-1f85c6a894ab None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:21.306646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 699/1407] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:22:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:22:21.311991 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6c336-90b3-4c02-93cf-361dfcc6a646 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:21.312582 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6c336-90b3-4c02-93cf-361dfcc6a646 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:21.312969 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6c336-90b3-4c02-93cf-361dfcc6a646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:21.422829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-77e6c336-90b3-4c02-93cf-361dfcc6a646 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:21.424303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-77e6c336-90b3-4c02-93cf-361dfcc6a646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:21.614200 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 709/1408] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:22:22.073736 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df212d-3d96-437a-8bcb-1f85c6a894ab None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:22:22.075747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-19df212d-3d96-437a-8bcb-1f85c6a894ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:22.157808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:22.326874 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df212d-3d96-437a-8bcb-1f85c6a894ab None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:22:22.550515 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767da97-1c7d-4755-867d-1e91639496e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:22:22.551586 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767da97-1c7d-4755-867d-1e91639496e2 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:22.552102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767da97-1c7d-4755-867d-1e91639496e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:22.552541 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767da97-1c7d-4755-867d-1e91639496e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:22.555258 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-2767da97-1c7d-4755-867d-1e91639496e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:22.565018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:22.755949 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767da97-1c7d-4755-867d-1e91639496e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:22:22.758010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767da97-1c7d-4755-867d-1e91639496e2 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:22:22.785643 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 700/1409] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:22:31.607376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=85 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:32.779674 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=43 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:36.726131 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c581b3-e6b6-4932-87e6-503a0a431462 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:36.727019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c581b3-e6b6-4932-87e6-503a0a431462 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:36.727019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c581b3-e6b6-4932-87e6-503a0a431462 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:36.728550 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 710/1410] 10.222.0.83 () {54 vars in 918 bytes} [Fri Sep 23 01:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:22:36.737290 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c22d98-8718-41eb-9008-7e8271d6f9bf None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:36.738001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c22d98-8718-41eb-9008-7e8271d6f9bf None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:36.738001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c22d98-8718-41eb-9008-7e8271d6f9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:36.837898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-e9c22d98-8718-41eb-9008-7e8271d6f9bf None None] MFA Rules not processed for user `3eab2cbff5984fa6a8e715ed6553db82`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:36.840030 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-e9c22d98-8718-41eb-9008-7e8271d6f9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:37.008816 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 701/1411] 10.222.0.83 () {58 vars in 1015 bytes} [Fri Sep 23 01:22:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:22:37.029924 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3d2e9-5b4b-44d9-ad72-0ba87f6cfd0d None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:37.030252 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3d2e9-5b4b-44d9-ad72-0ba87f6cfd0d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:37.030473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3d2e9-5b4b-44d9-ad72-0ba87f6cfd0d None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:37.031900 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 711/1412] 10.222.0.83 () {54 vars in 918 bytes} [Fri Sep 23 01:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:22:37.038886 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca181815-8703-4f09-9075-d53183e0d4bf None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:37.039327 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca181815-8703-4f09-9075-d53183e0d4bf None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:37.039786 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca181815-8703-4f09-9075-d53183e0d4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:37.175121 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:37.179689 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-ca181815-8703-4f09-9075-d53183e0d4bf None None] MFA Rules not processed for user `824648d693af4b44ae5df853a3d258f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:37.181110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ca181815-8703-4f09-9075-d53183e0d4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:37.338620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 702/1413] 10.222.0.83 () {58 vars in 1015 bytes} [Fri Sep 23 01:22:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:22:40.672663 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76445f-1104-480d-aff5-bbe7c5abb4ac None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:40.672663 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76445f-1104-480d-aff5-bbe7c5abb4ac None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:40.672663 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76445f-1104-480d-aff5-bbe7c5abb4ac None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:40.672663 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 01:22:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:22:40.681641 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db4fd5-d266-495c-80da-91334305199b None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:40.682263 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db4fd5-d266-495c-80da-91334305199b None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:40.682567 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db4fd5-d266-495c-80da-91334305199b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:40.790363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-c4db4fd5-d266-495c-80da-91334305199b None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:40.792242 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-c4db4fd5-d266-495c-80da-91334305199b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:40.872942 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:40.921037 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 01:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:22:41.215977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76445f-1104-480d-aff5-bbe7c5abb4ac None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:22:41.217781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4e76445f-1104-480d-aff5-bbe7c5abb4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:41.412917 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76445f-1104-480d-aff5-bbe7c5abb4ac None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:22:41.502259 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:41.549196 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12315a63-4264-4f72-8a79-62810a42952b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:22:41.549814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12315a63-4264-4f72-8a79-62810a42952b service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:41.550116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12315a63-4264-4f72-8a79-62810a42952b service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:41.550384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12315a63-4264-4f72-8a79-62810a42952b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:41.552035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-12315a63-4264-4f72-8a79-62810a42952b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:41.661785 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12315a63-4264-4f72-8a79-62810a42952b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:22:41.665022 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12315a63-4264-4f72-8a79-62810a42952b service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:22:41.692454 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 713/1416] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:22:42.920251 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fcc20-fd79-46b4-bc2c-af38a5c6f5f2 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:42.921399 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fcc20-fd79-46b4-bc2c-af38a5c6f5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:42.921399 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fcc20-fd79-46b4-bc2c-af38a5c6f5f2 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:42.922694 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 01:22:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:22:42.929821 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65779f17-18ea-4cd1-86b3-c717aed07a50 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:42.930705 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65779f17-18ea-4cd1-86b3-c717aed07a50 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:42.930705 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65779f17-18ea-4cd1-86b3-c717aed07a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:43.030250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-65779f17-18ea-4cd1-86b3-c717aed07a50 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:43.031933 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-65779f17-18ea-4cd1-86b3-c717aed07a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:43.078539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:43.188382 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 01:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:22:43.363933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fcc20-fd79-46b4-bc2c-af38a5c6f5f2 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:22:43.365230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f14fcc20-fd79-46b4-bc2c-af38a5c6f5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:43.547970 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fcc20-fd79-46b4-bc2c-af38a5c6f5f2 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:22:43.595146 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:43.719040 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71912fe6-8752-4aee-97fb-1a203804d020 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:22:43.719681 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71912fe6-8752-4aee-97fb-1a203804d020 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:43.719957 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71912fe6-8752-4aee-97fb-1a203804d020 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:43.720225 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71912fe6-8752-4aee-97fb-1a203804d020 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:43.721968 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-71912fe6-8752-4aee-97fb-1a203804d020 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:43.826057 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71912fe6-8752-4aee-97fb-1a203804d020 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:22:43.829680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71912fe6-8752-4aee-97fb-1a203804d020 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:22:43.865585 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 705/1419] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:22:45.173963 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc24f47-1deb-48bf-bc13-07def21b2f87 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:45.174501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc24f47-1deb-48bf-bc13-07def21b2f87 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:45.174501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc24f47-1deb-48bf-bc13-07def21b2f87 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:45.175824 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 01:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:22:45.182895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afd77f-652e-470e-a589-4331a3ac41d6 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:45.183537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afd77f-652e-470e-a589-4331a3ac41d6 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:45.183537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afd77f-652e-470e-a589-4331a3ac41d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:45.254782 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:45.278858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-f5afd77f-652e-470e-a589-4331a3ac41d6 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:45.280663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f5afd77f-652e-470e-a589-4331a3ac41d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:45.397775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 01:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:22:45.551585 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc24f47-1deb-48bf-bc13-07def21b2f87 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:22:45.553197 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-bbc24f47-1deb-48bf-bc13-07def21b2f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:45.737913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc24f47-1deb-48bf-bc13-07def21b2f87 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:22:45.751442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:45.880484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30148fa-d7f2-42fd-b4a1-d15c2f0da24c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:22:45.881392 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30148fa-d7f2-42fd-b4a1-d15c2f0da24c service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:45.881678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30148fa-d7f2-42fd-b4a1-d15c2f0da24c service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:45.881955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30148fa-d7f2-42fd-b4a1-d15c2f0da24c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:45.884699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-d30148fa-d7f2-42fd-b4a1-d15c2f0da24c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:45.993503 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30148fa-d7f2-42fd-b4a1-d15c2f0da24c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:22:45.995211 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30148fa-d7f2-42fd-b4a1-d15c2f0da24c service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:22:46.016947 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 716/1422] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:22:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:22:47.288850 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a6f2c-826b-4160-b5b8-e83dec50bbdc None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:47.289467 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a6f2c-826b-4160-b5b8-e83dec50bbdc None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:47.289588 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a6f2c-826b-4160-b5b8-e83dec50bbdc None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:47.291395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 01:22:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:22:47.299001 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a38112-beb1-465a-8448-f6069bf4af2f None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:47.299716 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a38112-beb1-465a-8448-f6069bf4af2f None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:47.299716 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a38112-beb1-465a-8448-f6069bf4af2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:47.324945 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:47.399341 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-98a38112-beb1-465a-8448-f6069bf4af2f None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:47.400724 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-98a38112-beb1-465a-8448-f6069bf4af2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:47.551902 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 01:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:22:47.708581 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a6f2c-826b-4160-b5b8-e83dec50bbdc None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:22:47.710193 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-036a6f2c-826b-4160-b5b8-e83dec50bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:47.845842 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:47.883518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a6f2c-826b-4160-b5b8-e83dec50bbdc None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:22:48.003597 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d7401-fd60-4a4b-886d-e3051f0be754 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:22:48.004203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d7401-fd60-4a4b-886d-e3051f0be754 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:48.004485 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d7401-fd60-4a4b-886d-e3051f0be754 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:48.004756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d7401-fd60-4a4b-886d-e3051f0be754 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:48.006391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-5a0d7401-fd60-4a4b-886d-e3051f0be754 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:48.083786 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:48.098109 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d7401-fd60-4a4b-886d-e3051f0be754 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:22:48.100056 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d7401-fd60-4a4b-886d-e3051f0be754 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:22:48.118661 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 708/1425] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:22:49.263106 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee0173-31e6-4d67-86be-cc13041f43fc None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:49.264203 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee0173-31e6-4d67-86be-cc13041f43fc None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:49.264390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee0173-31e6-4d67-86be-cc13041f43fc None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:49.265731 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 01:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:22:49.272663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff4b83-70e3-4e5a-823f-c52afc45f063 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:49.273224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff4b83-70e3-4e5a-823f-c52afc45f063 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:49.273224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff4b83-70e3-4e5a-823f-c52afc45f063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:49.359204 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-f2ff4b83-70e3-4e5a-823f-c52afc45f063 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:49.360460 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f2ff4b83-70e3-4e5a-823f-c52afc45f063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:49.482951 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 01:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:22:49.634987 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee0173-31e6-4d67-86be-cc13041f43fc None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:22:49.636554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-3fee0173-31e6-4d67-86be-cc13041f43fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:49.726046 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:49.790931 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee0173-31e6-4d67-86be-cc13041f43fc None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:22:49.911675 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d73e9b-0c00-49e6-9c0d-bce71e539f7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:22:49.912269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d73e9b-0c00-49e6-9c0d-bce71e539f7c service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:49.912543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d73e9b-0c00-49e6-9c0d-bce71e539f7c service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:49.912813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d73e9b-0c00-49e6-9c0d-bce71e539f7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:49.914459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-c6d73e9b-0c00-49e6-9c0d-bce71e539f7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:49.965285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:50.007505 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d73e9b-0c00-49e6-9c0d-bce71e539f7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:22:50.009094 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d73e9b-0c00-49e6-9c0d-bce71e539f7c service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:22:50.028012 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 719/1428] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:22:51.220394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1f765-f48b-4a70-91df-87067b3e5acf None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:51.220959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1f765-f48b-4a70-91df-87067b3e5acf None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:51.220959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1f765-f48b-4a70-91df-87067b3e5acf None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:51.222384 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 01:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:22:51.230289 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fda2cd-b5de-47a4-b674-6b0942596565 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:51.230289 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fda2cd-b5de-47a4-b674-6b0942596565 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:51.230289 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fda2cd-b5de-47a4-b674-6b0942596565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:51.315818 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-a4fda2cd-b5de-47a4-b674-6b0942596565 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:51.317063 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a4fda2cd-b5de-47a4-b674-6b0942596565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:51.422848 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 01:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:22:51.575539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1f765-f48b-4a70-91df-87067b3e5acf None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:22:51.577664 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-fdf1f765-f48b-4a70-91df-87067b3e5acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:51.629822 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:51.743666 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1f765-f48b-4a70-91df-87067b3e5acf None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:22:51.874603 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fea18-4886-41f6-bd4e-1e49d4feb753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:22:51.875223 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fea18-4886-41f6-bd4e-1e49d4feb753 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:51.875436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fea18-4886-41f6-bd4e-1e49d4feb753 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:51.875692 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fea18-4886-41f6-bd4e-1e49d4feb753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:51.877338 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f81fea18-4886-41f6-bd4e-1e49d4feb753 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:51.885221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:51.976670 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fea18-4886-41f6-bd4e-1e49d4feb753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:22:51.978300 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fea18-4886-41f6-bd4e-1e49d4feb753 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:22:52.000517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 711/1431] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:22:53.155032 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc7cc4-ab80-4fc0-8c2f-820113ebb3d6 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:53.155660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc7cc4-ab80-4fc0-8c2f-820113ebb3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:53.155660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc7cc4-ab80-4fc0-8c2f-820113ebb3d6 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:53.156828 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 01:22:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:22:53.163876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc8c15-e0ff-421a-a56a-c38324023d7a None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:53.164590 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc8c15-e0ff-421a-a56a-c38324023d7a None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:53.164590 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc8c15-e0ff-421a-a56a-c38324023d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:53.247700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-c8fc8c15-e0ff-421a-a56a-c38324023d7a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:53.249076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-c8fc8c15-e0ff-421a-a56a-c38324023d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:53.325845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:53.361988 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 01:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:22:53.514473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc7cc4-ab80-4fc0-8c2f-820113ebb3d6 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:22:53.516193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f9fc7cc4-ab80-4fc0-8c2f-820113ebb3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:53.534131 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:53.686476 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc7cc4-ab80-4fc0-8c2f-820113ebb3d6 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:22:53.789906 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:53.822819 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d33b3-407a-471d-bd6c-c0a089c5cace service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:22:53.823441 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d33b3-407a-471d-bd6c-c0a089c5cace service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:53.823723 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d33b3-407a-471d-bd6c-c0a089c5cace service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:53.823997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d33b3-407a-471d-bd6c-c0a089c5cace service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:53.825699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-472d33b3-407a-471d-bd6c-c0a089c5cace service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:53.931444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d33b3-407a-471d-bd6c-c0a089c5cace service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:22:53.933149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d33b3-407a-471d-bd6c-c0a089c5cace service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:22:53.953065 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 722/1434] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:22:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:22:55.122528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769decb-0c7d-41b9-afe2-fcec8447d9f6 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:55.123726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769decb-0c7d-41b9-afe2-fcec8447d9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:55.123726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769decb-0c7d-41b9-afe2-fcec8447d9f6 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:55.124896 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 01:22:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:22:55.132165 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6d368-1437-4b9c-9e3f-17f8ca3661d3 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:55.132680 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6d368-1437-4b9c-9e3f-17f8ca3661d3 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:55.132802 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6d368-1437-4b9c-9e3f-17f8ca3661d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:55.218064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-30a6d368-1437-4b9c-9e3f-17f8ca3661d3 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:55.219390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-30a6d368-1437-4b9c-9e3f-17f8ca3661d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:55.267382 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:55.330097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 01:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:22:55.485178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769decb-0c7d-41b9-afe2-fcec8447d9f6 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:22:55.486637 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b769decb-0c7d-41b9-afe2-fcec8447d9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:55.647868 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769decb-0c7d-41b9-afe2-fcec8447d9f6 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:22:55.705661 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:55.770607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c911b4-41c6-477f-98e4-98823e2e66c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:22:55.771241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c911b4-41c6-477f-98e4-98823e2e66c6 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:55.771521 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c911b4-41c6-477f-98e4-98823e2e66c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:55.771798 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c911b4-41c6-477f-98e4-98823e2e66c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:55.773430 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a2c911b4-41c6-477f-98e4-98823e2e66c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:55.873269 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c911b4-41c6-477f-98e4-98823e2e66c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:22:55.875008 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c911b4-41c6-477f-98e4-98823e2e66c6 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:22:55.895207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 714/1437] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:22:57.044590 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266d040-b15f-4fd4-9085-7d62de5b1cb4 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:57.045171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266d040-b15f-4fd4-9085-7d62de5b1cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:57.045171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266d040-b15f-4fd4-9085-7d62de5b1cb4 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:57.046528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 01:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:22:57.053351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd5cdb-06e3-4686-bfd1-925feff9cec9 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:57.053898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd5cdb-06e3-4686-bfd1-925feff9cec9 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:57.054015 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd5cdb-06e3-4686-bfd1-925feff9cec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:57.139869 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-cedd5cdb-06e3-4686-bfd1-925feff9cec9 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:22:57.141192 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-cedd5cdb-06e3-4686-bfd1-925feff9cec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:57.143584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:57.266298 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 01:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:22:57.423553 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266d040-b15f-4fd4-9085-7d62de5b1cb4 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:22:57.425193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a266d040-b15f-4fd4-9085-7d62de5b1cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:57.596365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266d040-b15f-4fd4-9085-7d62de5b1cb4 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:22:57.625942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:57.720763 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6c7aa-d6fe-44bf-8093-992198eb692f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:22:57.721321 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6c7aa-d6fe-44bf-8093-992198eb692f service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:57.721599 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6c7aa-d6fe-44bf-8093-992198eb692f service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:57.721870 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6c7aa-d6fe-44bf-8093-992198eb692f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:57.723959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-7af6c7aa-d6fe-44bf-8093-992198eb692f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:22:57.823187 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6c7aa-d6fe-44bf-8093-992198eb692f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:22:57.824797 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6c7aa-d6fe-44bf-8093-992198eb692f service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:22:57.846235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 725/1440] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:22:59.979402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf5e90-b423-4312-b88e-905557090f83 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:59.979968 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf5e90-b423-4312-b88e-905557090f83 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:59.979968 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf5e90-b423-4312-b88e-905557090f83 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:22:59.981317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 01:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:22:59.987203 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc66707-8df8-4a47-aa97-00d16dcd8565 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:22:59.987933 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc66707-8df8-4a47-aa97-00d16dcd8565 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:22:59.987933 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc66707-8df8-4a47-aa97-00d16dcd8565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:00.033906 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:00.063997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-6cc66707-8df8-4a47-aa97-00d16dcd8565 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:23:00.065119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6cc66707-8df8-4a47-aa97-00d16dcd8565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:00.183362 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 01:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:23:00.476321 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf5e90-b423-4312-b88e-905557090f83 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:23:00.478470 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a6bf5e90-b423-4312-b88e-905557090f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:00.606336 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf5e90-b423-4312-b88e-905557090f83 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:23:00.685392 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:00.734809 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0352b-47d1-437c-b2a8-eeceb1ab9b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:23:00.735499 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0352b-47d1-437c-b2a8-eeceb1ab9b3d service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:00.735779 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0352b-47d1-437c-b2a8-eeceb1ab9b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:00.736046 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0352b-47d1-437c-b2a8-eeceb1ab9b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:00.737783 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-94e0352b-47d1-437c-b2a8-eeceb1ab9b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:00.868324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0352b-47d1-437c-b2a8-eeceb1ab9b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:23:00.869801 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0352b-47d1-437c-b2a8-eeceb1ab9b3d service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:23:00.898619 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 717/1443] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:23:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:23:03.395377 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa235aa-c209-4025-9ed2-6a80173c641b None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:03.395979 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa235aa-c209-4025-9ed2-6a80173c641b None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:03.396302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa235aa-c209-4025-9ed2-6a80173c641b None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:03.398817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 01:23:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:23:03.408459 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66c596-9c62-470d-b059-2684457cf295 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:03.409433 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66c596-9c62-470d-b059-2684457cf295 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:03.409729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66c596-9c62-470d-b059-2684457cf295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:03.489402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-6a66c596-9c62-470d-b059-2684457cf295 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:23:03.490675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-6a66c596-9c62-470d-b059-2684457cf295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:03.505669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:03.605605 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:23:03.896279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa235aa-c209-4025-9ed2-6a80173c641b None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:23:03.897954 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-3aa235aa-c209-4025-9ed2-6a80173c641b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:04.008981 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa235aa-c209-4025-9ed2-6a80173c641b None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:23:04.022917 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:04.088870 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a0285-6730-47a5-9b35-f226b3459f01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:23:04.089517 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a0285-6730-47a5-9b35-f226b3459f01 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:04.089800 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a0285-6730-47a5-9b35-f226b3459f01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:04.090073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a0285-6730-47a5-9b35-f226b3459f01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:04.091993 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-046a0285-6730-47a5-9b35-f226b3459f01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:04.213029 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a0285-6730-47a5-9b35-f226b3459f01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:23:04.214382 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a0285-6730-47a5-9b35-f226b3459f01 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:23:04.235318 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 728/1446] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:23:06.966341 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acca36-daaa-45b0-90d7-bb2f6772bd88 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:06.967599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acca36-daaa-45b0-90d7-bb2f6772bd88 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:06.967599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acca36-daaa-45b0-90d7-bb2f6772bd88 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:06.969530 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 01:23:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:23:06.977301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eefe0-4f05-473d-b493-cd0d582d7ce8 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:06.977916 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eefe0-4f05-473d-b493-cd0d582d7ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:06.978104 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eefe0-4f05-473d-b493-cd0d582d7ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:07.039313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:07.061293 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-254eefe0-4f05-473d-b493-cd0d582d7ce8 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:23:07.062523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-254eefe0-4f05-473d-b493-cd0d582d7ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:07.170155 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 01:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:23:07.453777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acca36-daaa-45b0-90d7-bb2f6772bd88 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:23:07.455368 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-01acca36-daaa-45b0-90d7-bb2f6772bd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:07.566577 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acca36-daaa-45b0-90d7-bb2f6772bd88 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:23:07.610735 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:07.648310 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093675fb-d074-4c50-b067-429dac5044be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:23:07.648929 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093675fb-d074-4c50-b067-429dac5044be service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:07.649210 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093675fb-d074-4c50-b067-429dac5044be service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:07.649474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093675fb-d074-4c50-b067-429dac5044be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:07.651223 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-093675fb-d074-4c50-b067-429dac5044be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:07.766150 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093675fb-d074-4c50-b067-429dac5044be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:23:07.767652 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093675fb-d074-4c50-b067-429dac5044be service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:23:07.786816 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 720/1449] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:23:10.152297 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419232f-a573-48a4-a5b2-27f555b80fed None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:10.152913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419232f-a573-48a4-a5b2-27f555b80fed None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:10.152913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419232f-a573-48a4-a5b2-27f555b80fed None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:10.154693 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 01:23:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:23:10.161882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b1ccd-aa48-4ed5-9f89-587e28a49e33 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:10.162777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b1ccd-aa48-4ed5-9f89-587e28a49e33 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:10.162938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b1ccd-aa48-4ed5-9f89-587e28a49e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:10.248737 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-748b1ccd-aa48-4ed5-9f89-587e28a49e33 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:23:10.250413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-748b1ccd-aa48-4ed5-9f89-587e28a49e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:10.276047 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:10.367742 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 01:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:23:10.652567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419232f-a573-48a4-a5b2-27f555b80fed None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:23:10.654339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e419232f-a573-48a4-a5b2-27f555b80fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:10.783013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419232f-a573-48a4-a5b2-27f555b80fed None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:23:10.805204 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:10.864580 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c6b3b-1f62-4ab1-b573-b94b109bcf2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:23:10.865198 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c6b3b-1f62-4ab1-b573-b94b109bcf2c service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:10.865479 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c6b3b-1f62-4ab1-b573-b94b109bcf2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:10.865751 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c6b3b-1f62-4ab1-b573-b94b109bcf2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:10.867503 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-996c6b3b-1f62-4ab1-b573-b94b109bcf2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:10.987543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c6b3b-1f62-4ab1-b573-b94b109bcf2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:23:10.988911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c6b3b-1f62-4ab1-b573-b94b109bcf2c service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:23:11.008565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 731/1452] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:23:13.319271 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c970d5-0fff-4e44-9760-6ec43f97194e None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:13.319892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c970d5-0fff-4e44-9760-6ec43f97194e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:13.319892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c970d5-0fff-4e44-9760-6ec43f97194e None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:13.321220 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 01:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:23:13.327619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08df24-34b2-4a53-b81f-ec8caf97ce0b None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:13.329735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08df24-34b2-4a53-b81f-ec8caf97ce0b None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:13.329735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08df24-34b2-4a53-b81f-ec8caf97ce0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:13.404614 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:13.408091 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-3e08df24-34b2-4a53-b81f-ec8caf97ce0b None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:23:13.409364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-3e08df24-34b2-4a53-b81f-ec8caf97ce0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:13.537369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 01:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:23:13.829520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c970d5-0fff-4e44-9760-6ec43f97194e None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:23:13.831167 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-86c970d5-0fff-4e44-9760-6ec43f97194e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:13.951607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c970d5-0fff-4e44-9760-6ec43f97194e None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:23:14.008068 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:14.036103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0356b4-9037-4b47-8477-e1bfde9d684e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:23:14.036724 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0356b4-9037-4b47-8477-e1bfde9d684e service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:14.036994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0356b4-9037-4b47-8477-e1bfde9d684e service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:14.037260 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0356b4-9037-4b47-8477-e1bfde9d684e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:14.039009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-6a0356b4-9037-4b47-8477-e1bfde9d684e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:14.162860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0356b4-9037-4b47-8477-e1bfde9d684e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:23:14.164225 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0356b4-9037-4b47-8477-e1bfde9d684e service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:23:14.183687 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 723/1455] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:23:16.484728 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0295c0-7f3c-477c-b78a-efda826a3606 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:16.485300 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0295c0-7f3c-477c-b78a-efda826a3606 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:16.485300 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0295c0-7f3c-477c-b78a-efda826a3606 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:16.486637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 01:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:23:16.492309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcab80-5a5c-4cb1-88e6-03c9d98dd6bf None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:16.492886 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcab80-5a5c-4cb1-88e6-03c9d98dd6bf None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:16.492886 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcab80-5a5c-4cb1-88e6-03c9d98dd6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:16.563425 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-78bcab80-5a5c-4cb1-88e6-03c9d98dd6bf None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:23:16.564777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-78bcab80-5a5c-4cb1-88e6-03c9d98dd6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:16.596769 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:16.676357 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 01:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:23:16.965485 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0295c0-7f3c-477c-b78a-efda826a3606 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:23:16.967323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ca0295c0-7f3c-477c-b78a-efda826a3606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:17.081107 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0295c0-7f3c-477c-b78a-efda826a3606 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:23:17.113509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:17.162468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44e9aa-e3ab-42be-8bf9-72ecd6998c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:23:17.163122 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44e9aa-e3ab-42be-8bf9-72ecd6998c3e service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:17.163395 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44e9aa-e3ab-42be-8bf9-72ecd6998c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:17.163770 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44e9aa-e3ab-42be-8bf9-72ecd6998c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:17.165293 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-1d44e9aa-e3ab-42be-8bf9-72ecd6998c3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:17.282286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44e9aa-e3ab-42be-8bf9-72ecd6998c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:23:17.283770 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44e9aa-e3ab-42be-8bf9-72ecd6998c3e service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:23:17.302632 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 734/1458] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:23:19.608796 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf6cc7-3c40-4a94-93de-7cced9e96316 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:19.609405 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf6cc7-3c40-4a94-93de-7cced9e96316 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:19.609405 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf6cc7-3c40-4a94-93de-7cced9e96316 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:19.610988 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 01:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:23:19.616946 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa6769-cc6f-4fa3-a579-298e284ec7a0 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:19.617555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa6769-cc6f-4fa3-a579-298e284ec7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:19.617753 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa6769-cc6f-4fa3-a579-298e284ec7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:19.700213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-60aa6769-cc6f-4fa3-a579-298e284ec7a0 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:23:19.701905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-60aa6769-cc6f-4fa3-a579-298e284ec7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:19.710846 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:19.808887 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 01:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:23:20.105112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf6cc7-3c40-4a94-93de-7cced9e96316 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:23:20.106701 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-79bf6cc7-3c40-4a94-93de-7cced9e96316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:20.337447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf6cc7-3c40-4a94-93de-7cced9e96316 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:23:20.400986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:20.419640 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83ac48-f5b5-4f66-90d8-2d8766cd96b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:23:20.420866 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ac48-f5b5-4f66-90d8-2d8766cd96b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:20.420866 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ac48-f5b5-4f66-90d8-2d8766cd96b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:20.420866 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ac48-f5b5-4f66-90d8-2d8766cd96b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:20.422432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-8a83ac48-f5b5-4f66-90d8-2d8766cd96b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:20.548133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83ac48-f5b5-4f66-90d8-2d8766cd96b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:23:20.549615 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83ac48-f5b5-4f66-90d8-2d8766cd96b1 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:23:20.570123 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 726/1461] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:23:22.847864 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a13d8f-10de-46de-b1c2-a8330ff4ea9e None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:22.848489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a13d8f-10de-46de-b1c2-a8330ff4ea9e None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:22.848489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a13d8f-10de-46de-b1c2-a8330ff4ea9e None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:22.850033 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 01:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:23:22.855975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e39cf7-4c52-479e-bae6-261cb9d79b35 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:22.856497 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e39cf7-4c52-479e-bae6-261cb9d79b35 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:22.856497 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e39cf7-4c52-479e-bae6-261cb9d79b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:22.925777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-24e39cf7-4c52-479e-bae6-261cb9d79b35 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:23:22.927031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-24e39cf7-4c52-479e-bae6-261cb9d79b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:22.970795 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:23.030575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 01:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:23:23.320348 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a13d8f-10de-46de-b1c2-a8330ff4ea9e None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:23:23.322947 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a0a13d8f-10de-46de-b1c2-a8330ff4ea9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:23.502219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a13d8f-10de-46de-b1c2-a8330ff4ea9e None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:23:23.556898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:23.597664 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2097d8-5720-4c9e-b9d1-453e1fee0dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:23:23.598189 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2097d8-5720-4c9e-b9d1-453e1fee0dec service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:23.598472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2097d8-5720-4c9e-b9d1-453e1fee0dec service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:23.599053 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2097d8-5720-4c9e-b9d1-453e1fee0dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:23.600715 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-fc2097d8-5720-4c9e-b9d1-453e1fee0dec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:23.732773 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2097d8-5720-4c9e-b9d1-453e1fee0dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:23:23.734222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2097d8-5720-4c9e-b9d1-453e1fee0dec service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:23:23.754682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 737/1464] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:23:25.992695 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1187e-09a8-44a0-bf11-f17f3fd1cd9b None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:25.993303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1187e-09a8-44a0-bf11-f17f3fd1cd9b None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:25.993303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1187e-09a8-44a0-bf11-f17f3fd1cd9b None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:25.994673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 01:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:23:26.000806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369662-ddd1-4089-8d74-99fba6ed6b07 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:26.001430 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369662-ddd1-4089-8d74-99fba6ed6b07 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:26.001430 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369662-ddd1-4089-8d74-99fba6ed6b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:26.085551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-ca369662-ddd1-4089-8d74-99fba6ed6b07 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:23:26.086938 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ca369662-ddd1-4089-8d74-99fba6ed6b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:26.111299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:26.201288 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 01:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:23:26.496818 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1187e-09a8-44a0-bf11-f17f3fd1cd9b None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:23:26.498436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b2e1187e-09a8-44a0-bf11-f17f3fd1cd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:26.617462 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1187e-09a8-44a0-bf11-f17f3fd1cd9b None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:23:26.702748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:26.711664 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f6d2c-23c8-4a10-8022-23d133046013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:23:26.713444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f6d2c-23c8-4a10-8022-23d133046013 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:26.713444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f6d2c-23c8-4a10-8022-23d133046013 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:26.713444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f6d2c-23c8-4a10-8022-23d133046013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:26.714557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f96f6d2c-23c8-4a10-8022-23d133046013 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:26.849240 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f6d2c-23c8-4a10-8022-23d133046013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:23:26.850737 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f6d2c-23c8-4a10-8022-23d133046013 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:23:26.876611 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 729/1467] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:23:29.125448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388eafb0-eaa5-4871-b315-ea673b9e6e4c None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:29.126023 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388eafb0-eaa5-4871-b315-ea673b9e6e4c None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:29.126134 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388eafb0-eaa5-4871-b315-ea673b9e6e4c None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:29.127541 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 01:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:23:29.133583 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d38eee-6a84-4cae-9b8c-72654bd589dd None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:29.134133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d38eee-6a84-4cae-9b8c-72654bd589dd None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:29.134133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d38eee-6a84-4cae-9b8c-72654bd589dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:29.204325 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-04d38eee-6a84-4cae-9b8c-72654bd589dd None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:23:29.205479 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-04d38eee-6a84-4cae-9b8c-72654bd589dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:29.255734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:29.308106 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 01:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:23:29.599941 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388eafb0-eaa5-4871-b315-ea673b9e6e4c None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:23:29.601502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-388eafb0-eaa5-4871-b315-ea673b9e6e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:29.724302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388eafb0-eaa5-4871-b315-ea673b9e6e4c None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:23:29.779723 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:29.811222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d4735-148f-4555-9fd1-cf7bd905374b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:23:29.811861 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d4735-148f-4555-9fd1-cf7bd905374b service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:29.812215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d4735-148f-4555-9fd1-cf7bd905374b service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:29.812486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d4735-148f-4555-9fd1-cf7bd905374b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:29.814186 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ba1d4735-148f-4555-9fd1-cf7bd905374b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:29.959411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d4735-148f-4555-9fd1-cf7bd905374b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:23:29.961041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d4735-148f-4555-9fd1-cf7bd905374b service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:23:29.984370 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 740/1470] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:23:39.306342 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=22 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:39.982005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=66 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:51.499052 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa890e-78e7-418c-a1b1-f165680fd0db None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:51.499052 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa890e-78e7-418c-a1b1-f165680fd0db None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:51.499052 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa890e-78e7-418c-a1b1-f165680fd0db None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:51.499052 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 731/1471] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:23:51.500114 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ea1c0-a4bc-42f1-b1d8-9e3df837443a None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:51.500114 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ea1c0-a4bc-42f1-b1d8-9e3df837443a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:51.500114 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ea1c0-a4bc-42f1-b1d8-9e3df837443a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:51.553314 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-7f5ea1c0-a4bc-42f1-b1d8-9e3df837443a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:23:51.554538 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-7f5ea1c0-a4bc-42f1-b1d8-9e3df837443a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:51.663051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 741/1472] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:23:51.991751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fc6d1-a129-454c-b224-1decf660b616 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:51.992034 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fc6d1-a129-454c-b224-1decf660b616 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:51.992311 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fc6d1-a129-454c-b224-1decf660b616 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:51.994049 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 732/1473] 10.222.0.83 () {54 vars in 962 bytes} [Fri Sep 23 01:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:23:52.000237 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28792f34-6116-4644-b168-77cd34faf547 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:52.000521 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28792f34-6116-4644-b168-77cd34faf547 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:52.000817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28792f34-6116-4644-b168-77cd34faf547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:52.086184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-28792f34-6116-4644-b168-77cd34faf547 None None] MFA Rules not processed for user `f5b3a7a9a08e40718980143d7c4880ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:23:52.087447 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-28792f34-6116-4644-b168-77cd34faf547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:52.112261 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:52.172243 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 742/1474] 10.222.0.83 () {58 vars in 1059 bytes} [Fri Sep 23 01:23:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:23:52.183111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fc6d1-a129-454c-b224-1decf660b616 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:23:52.184731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-174fc6d1-a129-454c-b224-1decf660b616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:52.302715 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fc6d1-a129-454c-b224-1decf660b616 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:23:52.390851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693d5af-a1a0-4e93-870b-56764499d9b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5b3a7a9a08e40718980143d7c4880ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:23:52.391465 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693d5af-a1a0-4e93-870b-56764499d9b5 service glance] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:52.391778 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693d5af-a1a0-4e93-870b-56764499d9b5 service glance] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:52.392155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693d5af-a1a0-4e93-870b-56764499d9b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:52.393932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-2693d5af-a1a0-4e93-870b-56764499d9b5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:52.463655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:52.530820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693d5af-a1a0-4e93-870b-56764499d9b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:23:52.532993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693d5af-a1a0-4e93-870b-56764499d9b5 service glance] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:23:52.553096 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 733/1475] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:23:54.885838 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa649547-f577-4c73-8ef9-678c4185d323 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:54.886481 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa649547-f577-4c73-8ef9-678c4185d323 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:54.887039 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa649547-f577-4c73-8ef9-678c4185d323 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:54.890065 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 743/1476] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:23:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:23:54.896429 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c53a4-fd49-4b63-8d64-14d9fc1f802d None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:54.896990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c53a4-fd49-4b63-8d64-14d9fc1f802d None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:54.897101 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c53a4-fd49-4b63-8d64-14d9fc1f802d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:54.981492 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-d25c53a4-fd49-4b63-8d64-14d9fc1f802d None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:23:54.982810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d25c53a4-fd49-4b63-8d64-14d9fc1f802d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:55.099922 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 734/1477] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:23:55.384275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa649547-f577-4c73-8ef9-678c4185d323 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:23:55.385844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-aa649547-f577-4c73-8ef9-678c4185d323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:55.537937 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa649547-f577-4c73-8ef9-678c4185d323 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:23:55.612303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:55.674049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9577b5-57b2-4960-b1c9-e279b4a1e61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:23:55.674705 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9577b5-57b2-4960-b1c9-e279b4a1e61c admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:55.674985 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9577b5-57b2-4960-b1c9-e279b4a1e61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:55.675257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9577b5-57b2-4960-b1c9-e279b4a1e61c admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:55.675903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9577b5-57b2-4960-b1c9-e279b4a1e61c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:23:55.677687 dv-cinder-849143-7-smb devstack@keystone.service[81923]: WARNING py.warnings [None req-cf9577b5-57b2-4960-b1c9-e279b4a1e61c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 01:23:55.677687 dv-cinder-849143-7-smb devstack@keystone.service[81923]: warnings.warn(msg) Sep 23 01:23:55.677687 dv-cinder-849143-7-smb devstack@keystone.service[81923]: Sep 23 01:23:55.678874 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9577b5-57b2-4960-b1c9-e279b4a1e61c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:23:55.700287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 744/1478] 10.222.0.83 () {56 vars in 1108 bytes} [Fri Sep 23 01:23:55 2022] GET /identity/v3/projects => generated 2553 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:23:57.968303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84583d0f-6eed-453a-95c7-d86e87d20558 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:57.968861 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84583d0f-6eed-453a-95c7-d86e87d20558 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:57.968949 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84583d0f-6eed-453a-95c7-d86e87d20558 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:57.970320 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 735/1479] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:23:57.976132 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6f3ae-db84-4629-956d-32758dd4e13b None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:57.976586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6f3ae-db84-4629-956d-32758dd4e13b None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:57.976693 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6f3ae-db84-4629-956d-32758dd4e13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:58.044285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-b2c6f3ae-db84-4629-956d-32758dd4e13b None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:23:58.045512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b2c6f3ae-db84-4629-956d-32758dd4e13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:58.142031 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 745/1480] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:23:58.444362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84583d0f-6eed-453a-95c7-d86e87d20558 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:23:58.446058 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-84583d0f-6eed-453a-95c7-d86e87d20558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:58.456440 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:58.613288 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84583d0f-6eed-453a-95c7-d86e87d20558 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:23:58.696944 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:58.731837 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94659005-4fb9-4803-99a8-efe67ac89adb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:23:58.732554 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94659005-4fb9-4803-99a8-efe67ac89adb service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:23:58.732731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94659005-4fb9-4803-99a8-efe67ac89adb service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:23:58.733033 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94659005-4fb9-4803-99a8-efe67ac89adb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:23:58.734701 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-94659005-4fb9-4803-99a8-efe67ac89adb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:23:58.826827 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94659005-4fb9-4803-99a8-efe67ac89adb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:23:58.828462 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94659005-4fb9-4803-99a8-efe67ac89adb service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:23:58.847922 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 736/1481] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:24:01.236352 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac28dfd-e4c7-4c5a-820f-250ec9368bf6 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:24:01.236922 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac28dfd-e4c7-4c5a-820f-250ec9368bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:24:01.236922 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac28dfd-e4c7-4c5a-820f-250ec9368bf6 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:24:01.238182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 746/1482] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:24:01.244689 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdb427-1a06-4f7e-a920-1826125ba72b None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:24:01.245249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdb427-1a06-4f7e-a920-1826125ba72b None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:24:01.245249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdb427-1a06-4f7e-a920-1826125ba72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:24:01.315831 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-becdb427-1a06-4f7e-a920-1826125ba72b None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:24:01.317071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-becdb427-1a06-4f7e-a920-1826125ba72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:24:01.367301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:24:01.422450 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 737/1483] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:24:01.707633 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac28dfd-e4c7-4c5a-820f-250ec9368bf6 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:24:01.709294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6ac28dfd-e4c7-4c5a-820f-250ec9368bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:24:01.736937 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:24:01.820813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac28dfd-e4c7-4c5a-820f-250ec9368bf6 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:24:01.908139 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878154e-15d8-4da6-9740-287f38e19265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:24:01.908767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878154e-15d8-4da6-9740-287f38e19265 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:24:01.909029 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878154e-15d8-4da6-9740-287f38e19265 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:24:01.909294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878154e-15d8-4da6-9740-287f38e19265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:24:01.910970 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b878154e-15d8-4da6-9740-287f38e19265 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:24:01.999094 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:24:02.038791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878154e-15d8-4da6-9740-287f38e19265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:24:02.040250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878154e-15d8-4da6-9740-287f38e19265 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:24:02.061446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 747/1484] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:24:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:24:04.347189 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b602fb-fd4d-4c95-a9f5-e9aa52e89c8d None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:24:04.347847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b602fb-fd4d-4c95-a9f5-e9aa52e89c8d None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:24:04.347847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b602fb-fd4d-4c95-a9f5-e9aa52e89c8d None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:24:04.349193 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 738/1485] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:24:04.356882 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eb988-0e26-43de-b110-700445b25011 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:24:04.357390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eb988-0e26-43de-b110-700445b25011 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:24:04.357573 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eb988-0e26-43de-b110-700445b25011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:24:04.443408 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-816eb988-0e26-43de-b110-700445b25011 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:24:04.444646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-816eb988-0e26-43de-b110-700445b25011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:24:04.548951 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 748/1486] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:24:04.837624 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b602fb-fd4d-4c95-a9f5-e9aa52e89c8d None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:24:04.839565 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-40b602fb-fd4d-4c95-a9f5-e9aa52e89c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:24:04.950063 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b602fb-fd4d-4c95-a9f5-e9aa52e89c8d None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:24:05.026610 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:24:05.028700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c02de-e056-40f6-a333-e700f9db6a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:24:05.029313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c02de-e056-40f6-a333-e700f9db6a76 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:24:05.029591 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c02de-e056-40f6-a333-e700f9db6a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:24:05.029869 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c02de-e056-40f6-a333-e700f9db6a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:24:05.031547 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-037c02de-e056-40f6-a333-e700f9db6a76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:24:05.146364 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c02de-e056-40f6-a333-e700f9db6a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:24:05.147776 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c02de-e056-40f6-a333-e700f9db6a76 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:24:05.166527 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 739/1487] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:24:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:24:07.583341 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b7ec8-8a5c-4be7-a48b-87359056a9c2 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:24:07.583928 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b7ec8-8a5c-4be7-a48b-87359056a9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:24:07.584035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b7ec8-8a5c-4be7-a48b-87359056a9c2 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:24:07.585374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 749/1488] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:24:07.593098 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efd7be-d9e0-4e37-b888-fe18a3b81e4f None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:24:07.593658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efd7be-d9e0-4e37-b888-fe18a3b81e4f None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:24:07.593658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efd7be-d9e0-4e37-b888-fe18a3b81e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:24:07.664863 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-78efd7be-d9e0-4e37-b888-fe18a3b81e4f None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:24:07.666079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-78efd7be-d9e0-4e37-b888-fe18a3b81e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:24:07.724842 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:24:07.777712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 740/1489] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:24:08.078101 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b7ec8-8a5c-4be7-a48b-87359056a9c2 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:24:08.079800 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-d18b7ec8-8a5c-4be7-a48b-87359056a9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:24:08.118867 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:24:08.191181 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b7ec8-8a5c-4be7-a48b-87359056a9c2 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:24:08.269581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165a693-be17-43f4-8700-6d03c97b77f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:24:08.270200 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165a693-be17-43f4-8700-6d03c97b77f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:24:08.270487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165a693-be17-43f4-8700-6d03c97b77f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:24:08.270800 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165a693-be17-43f4-8700-6d03c97b77f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:24:08.272429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-9165a693-be17-43f4-8700-6d03c97b77f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:24:08.357922 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:24:08.387770 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165a693-be17-43f4-8700-6d03c97b77f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:24:08.389205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165a693-be17-43f4-8700-6d03c97b77f6 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:24:08.410073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 750/1490] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:24:11.234489 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fc7cb-9972-4181-a471-93647e1f9ca9 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:24:11.235071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fc7cb-9972-4181-a471-93647e1f9ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:24:11.235071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fc7cb-9972-4181-a471-93647e1f9ca9 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:24:11.236337 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 741/1491] 10.222.0.83 () {54 vars in 927 bytes} [Fri Sep 23 01:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:24:11.242295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c97fc-753f-4cad-88a0-2eb38c177975 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:24:11.242832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c97fc-753f-4cad-88a0-2eb38c177975 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:24:11.242925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c97fc-753f-4cad-88a0-2eb38c177975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:24:11.326527 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-db9c97fc-753f-4cad-88a0-2eb38c177975 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:24:11.332702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-db9c97fc-753f-4cad-88a0-2eb38c177975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:24:11.436855 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 751/1492] 10.222.0.83 () {58 vars in 1024 bytes} [Fri Sep 23 01:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:24:11.729507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fc7cb-9972-4181-a471-93647e1f9ca9 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:24:11.731615 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-e60fc7cb-9972-4181-a471-93647e1f9ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:24:11.843746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fc7cb-9972-4181-a471-93647e1f9ca9 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:24:11.927916 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3631a-3bbf-4ab9-b4e3-efcad3629986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:24:11.928982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3631a-3bbf-4ab9-b4e3-efcad3629986 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:24:11.928982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3631a-3bbf-4ab9-b4e3-efcad3629986 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:24:11.929194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3631a-3bbf-4ab9-b4e3-efcad3629986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:24:11.930818 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-dde3631a-3bbf-4ab9-b4e3-efcad3629986 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:24:11.940482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:24:12.062338 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3631a-3bbf-4ab9-b4e3-efcad3629986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:24:12.063929 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3631a-3bbf-4ab9-b4e3-efcad3629986 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:24:12.083973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 742/1493] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:24:21.435009 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=82 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:24:22.081501 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=50 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:26:07.418520 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b80d5a-4959-4c13-9d53-847c70f6bc52 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:26:07.419178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b80d5a-4959-4c13-9d53-847c70f6bc52 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:26:07.419178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b80d5a-4959-4c13-9d53-847c70f6bc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:26:07.507176 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-46b80d5a-4959-4c13-9d53-847c70f6bc52 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:26:07.508392 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-46b80d5a-4959-4c13-9d53-847c70f6bc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:26:07.632157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 752/1494] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:26:07.640480 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd21bc7-05ce-4512-a176-c9d0a8715053 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:26:07.641035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd21bc7-05ce-4512-a176-c9d0a8715053 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:26:07.641035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd21bc7-05ce-4512-a176-c9d0a8715053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:26:07.661663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-1fd21bc7-05ce-4512-a176-c9d0a8715053 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:26:07.662891 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-1fd21bc7-05ce-4512-a176-c9d0a8715053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:26:07.672326 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 743/1495] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:26:07.676953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b80d5a-4959-4c13-9d53-847c70f6bc52 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:26:07.688460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b80d5a-4959-4c13-9d53-847c70f6bc52 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:26:07.693182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468a433-2e45-4633-b63c-0dde3e98e207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:26:07.693799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468a433-2e45-4633-b63c-0dde3e98e207 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:26:07.694070 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468a433-2e45-4633-b63c-0dde3e98e207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:26:07.694338 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468a433-2e45-4633-b63c-0dde3e98e207 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:26:07.695026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468a433-2e45-4633-b63c-0dde3e98e207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:26:07.695322 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468a433-2e45-4633-b63c-0dde3e98e207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:26:07.696473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: WARNING py.warnings [None req-7468a433-2e45-4633-b63c-0dde3e98e207 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 01:26:07.696473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: warnings.warn(msg) Sep 23 01:26:07.696473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: Sep 23 01:26:07.697355 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468a433-2e45-4633-b63c-0dde3e98e207 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:26:07.711429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 753/1496] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:26:07.719796 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd21bc7-05ce-4512-a176-c9d0a8715053 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:26:07.730669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd21bc7-05ce-4512-a176-c9d0a8715053 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:26:07.736119 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b9db2-2d34-429f-b935-02685ba00478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:26:07.736740 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b9db2-2d34-429f-b935-02685ba00478 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:26:07.737015 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b9db2-2d34-429f-b935-02685ba00478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:26:07.737285 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b9db2-2d34-429f-b935-02685ba00478 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:26:07.737936 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b9db2-2d34-429f-b935-02685ba00478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:26:07.739739 dv-cinder-849143-7-smb devstack@keystone.service[81924]: WARNING py.warnings [None req-b69b9db2-2d34-429f-b935-02685ba00478 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 01:26:07.739739 dv-cinder-849143-7-smb devstack@keystone.service[81924]: warnings.warn(msg) Sep 23 01:26:07.739739 dv-cinder-849143-7-smb devstack@keystone.service[81924]: Sep 23 01:26:07.741028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b9db2-2d34-429f-b935-02685ba00478 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:26:07.845641 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 744/1497] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:26:07 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:26:07.851125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468a433-2e45-4633-b63c-0dde3e98e207 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:26:07.866187 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468a433-2e45-4633-b63c-0dde3e98e207 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:26:07.921068 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:26:07.928017 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa10d6f-7313-472b-82b3-2ad12f4099dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:26:07.928558 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa10d6f-7313-472b-82b3-2ad12f4099dc admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:26:07.928841 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa10d6f-7313-472b-82b3-2ad12f4099dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:26:07.929079 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa10d6f-7313-472b-82b3-2ad12f4099dc admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:26:07.929709 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa10d6f-7313-472b-82b3-2ad12f4099dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:26:07.930749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: WARNING py.warnings [None req-7aa10d6f-7313-472b-82b3-2ad12f4099dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 01:26:07.930749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: warnings.warn(msg) Sep 23 01:26:07.930749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: Sep 23 01:26:07.933651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa10d6f-7313-472b-82b3-2ad12f4099dc admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:26:08.004050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 754/1498] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:26:07 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:26:08.008586 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b9db2-2d34-429f-b935-02685ba00478 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:26:08.019053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b9db2-2d34-429f-b935-02685ba00478 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:26:08.023779 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebdf1c-b336-4534-8157-a72849bf0663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:26:08.024316 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebdf1c-b336-4534-8157-a72849bf0663 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:26:08.024601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebdf1c-b336-4534-8157-a72849bf0663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:26:08.024875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebdf1c-b336-4534-8157-a72849bf0663 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:26:08.025632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebdf1c-b336-4534-8157-a72849bf0663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:26:08.026679 dv-cinder-849143-7-smb devstack@keystone.service[81924]: WARNING py.warnings [None req-a8ebdf1c-b336-4534-8157-a72849bf0663 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 01:26:08.026679 dv-cinder-849143-7-smb devstack@keystone.service[81924]: warnings.warn(msg) Sep 23 01:26:08.026679 dv-cinder-849143-7-smb devstack@keystone.service[81924]: Sep 23 01:26:08.027560 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebdf1c-b336-4534-8157-a72849bf0663 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:26:08.041050 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 745/1499] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:26:08.045976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa10d6f-7313-472b-82b3-2ad12f4099dc admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:26:08.056452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa10d6f-7313-472b-82b3-2ad12f4099dc admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:26:08.062008 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc740104-19c5-490d-b54e-4ddb5253976f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:26:08.062638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc740104-19c5-490d-b54e-4ddb5253976f admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:26:08.062917 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc740104-19c5-490d-b54e-4ddb5253976f admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:26:08.063182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc740104-19c5-490d-b54e-4ddb5253976f admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:26:08.063819 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc740104-19c5-490d-b54e-4ddb5253976f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:26:08.064846 dv-cinder-849143-7-smb devstack@keystone.service[81923]: WARNING py.warnings [None req-dc740104-19c5-490d-b54e-4ddb5253976f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 01:26:08.064846 dv-cinder-849143-7-smb devstack@keystone.service[81923]: warnings.warn(msg) Sep 23 01:26:08.064846 dv-cinder-849143-7-smb devstack@keystone.service[81923]: Sep 23 01:26:08.065731 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc740104-19c5-490d-b54e-4ddb5253976f admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:26:08.080256 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 755/1500] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:26:08.084763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebdf1c-b336-4534-8157-a72849bf0663 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:26:08.095377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebdf1c-b336-4534-8157-a72849bf0663 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:26:08.100577 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562c253-0e8f-4024-b2ec-3827c23f30c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:26:08.101234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562c253-0e8f-4024-b2ec-3827c23f30c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:26:08.101769 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562c253-0e8f-4024-b2ec-3827c23f30c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:26:08.102041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562c253-0e8f-4024-b2ec-3827c23f30c0 admin admin] PATH_INFO: `/v3/projects/aecfd88e0f9a421d85534672339cf564/users/f1d7823737754fb190a981c614feeb81/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:26:08.117947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562c253-0e8f-4024-b2ec-3827c23f30c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aecfd88e0f9a421d85534672339cf564, user_id=f1d7823737754fb190a981c614feeb81, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:26:08.119264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: WARNING py.warnings [None req-1562c253-0e8f-4024-b2ec-3827c23f30c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 01:26:08.119264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: warnings.warn(msg) Sep 23 01:26:08.119264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: Sep 23 01:26:08.121360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562c253-0e8f-4024-b2ec-3827c23f30c0 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:26:08.193000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 746/1501] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:26:08 2022] PUT /identity/v3/projects/aecfd88e0f9a421d85534672339cf564/users/f1d7823737754fb190a981c614feeb81/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:26:08.205090 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c2d4d-0b23-498f-88a8-503f3c227f2c None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:26:08.205454 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c2d4d-0b23-498f-88a8-503f3c227f2c None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:26:08.205813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c2d4d-0b23-498f-88a8-503f3c227f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:26:08.237611 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-2f5c2d4d-0b23-498f-88a8-503f3c227f2c None None] MFA Rules not processed for user `f1d7823737754fb190a981c614feeb81`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:26:08.238937 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-2f5c2d4d-0b23-498f-88a8-503f3c227f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:26:08.311069 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 756/1502] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:26:08.325287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c3cd1-b6f8-4c5c-9b83-8091cfac6892 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:26:08.325599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c3cd1-b6f8-4c5c-9b83-8091cfac6892 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:26:08.325878 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c3cd1-b6f8-4c5c-9b83-8091cfac6892 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:26:08.327450 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 747/1503] 10.222.0.83 () {54 vars in 963 bytes} [Fri Sep 23 01:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:26:08.332749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda946d-0321-47a5-899f-bebe7daeb01f None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:26:08.333035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda946d-0321-47a5-899f-bebe7daeb01f None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:26:08.333374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda946d-0321-47a5-899f-bebe7daeb01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:26:08.399957 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-5bda946d-0321-47a5-899f-bebe7daeb01f None None] MFA Rules not processed for user `9f71db705b08460996a729a88c82bb63`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:26:08.401711 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-5bda946d-0321-47a5-899f-bebe7daeb01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:26:08.485682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 757/1504] 10.222.0.83 () {58 vars in 1060 bytes} [Fri Sep 23 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:26:08.495503 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c3cd1-b6f8-4c5c-9b83-8091cfac6892 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:26:08.506570 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c3cd1-b6f8-4c5c-9b83-8091cfac6892 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:26:08.510259 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eec8c-2d13-4beb-aa0e-a61b7179f9a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:26:08.511434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eec8c-2d13-4beb-aa0e-a61b7179f9a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:26:08.511716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eec8c-2d13-4beb-aa0e-a61b7179f9a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:26:08.511984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eec8c-2d13-4beb-aa0e-a61b7179f9a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:26:08.520702 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73eec8c-2d13-4beb-aa0e-a61b7179f9a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:26:08.522139 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73eec8c-2d13-4beb-aa0e-a61b7179f9a9 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:26:08.532333 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 748/1505] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:26:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:26:08.579136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa8e2c-b5e4-4227-81d7-f6385d462e5f None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:26:08.579422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa8e2c-b5e4-4227-81d7-f6385d462e5f None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:26:08.579696 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa8e2c-b5e4-4227-81d7-f6385d462e5f None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:26:08.580964 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 758/1506] 10.222.0.83 () {52 vars in 830 bytes} [Fri Sep 23 01:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:26:08.585303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eec8c-2d13-4beb-aa0e-a61b7179f9a9 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:26:08.655732 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eec8c-2d13-4beb-aa0e-a61b7179f9a9 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:26:08.660777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb394d48-4d93-4e22-b1d6-5ed7bbdbda77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:26:08.661244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb394d48-4d93-4e22-b1d6-5ed7bbdbda77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:26:08.661523 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb394d48-4d93-4e22-b1d6-5ed7bbdbda77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:26:08.661793 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb394d48-4d93-4e22-b1d6-5ed7bbdbda77 admin admin] PATH_INFO: `/v3/users/f1d7823737754fb190a981c614feeb81` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:26:08.662966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb394d48-4d93-4e22-b1d6-5ed7bbdbda77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d7823737754fb190a981c614feeb81)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:26:08.664001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: WARNING py.warnings [None req-cb394d48-4d93-4e22-b1d6-5ed7bbdbda77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 01:26:08.664001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: warnings.warn(msg) Sep 23 01:26:08.664001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: Sep 23 01:26:08.665327 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb394d48-4d93-4e22-b1d6-5ed7bbdbda77 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:26:08.907557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-cb394d48-4d93-4e22-b1d6-5ed7bbdbda77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d7823737754fb190a981c614feeb81'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:26:08.997752 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-cb394d48-4d93-4e22-b1d6-5ed7bbdbda77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d7823737754fb190a981c614feeb81'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:26:08.998477 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-cb394d48-4d93-4e22-b1d6-5ed7bbdbda77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d7823737754fb190a981c614feeb81'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:26:09.014938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-cb394d48-4d93-4e22-b1d6-5ed7bbdbda77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d7823737754fb190a981c614feeb81'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:26:09.015692 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-cb394d48-4d93-4e22-b1d6-5ed7bbdbda77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d7823737754fb190a981c614feeb81'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:26:09.038005 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:26:09.047096 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 749/1507] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:26:08 2022] DELETE /identity/v3/users/f1d7823737754fb190a981c614feeb81 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:26:09.051743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ae9d5-bef6-43ee-87f8-3cca1f2abfcd None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:26:09.052030 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ae9d5-bef6-43ee-87f8-3cca1f2abfcd None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:26:09.052283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ae9d5-bef6-43ee-87f8-3cca1f2abfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:26:09.072439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-006ae9d5-bef6-43ee-87f8-3cca1f2abfcd None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:26:09.074295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-006ae9d5-bef6-43ee-87f8-3cca1f2abfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:26:09.084928 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:26:09.136848 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 759/1508] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:26:09.146956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb394d48-4d93-4e22-b1d6-5ed7bbdbda77 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:26:09.148410 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-cb394d48-4d93-4e22-b1d6-5ed7bbdbda77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:26:09.242466 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb394d48-4d93-4e22-b1d6-5ed7bbdbda77 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:26:09.246881 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a94b3-7db5-446a-a3f0-a1783971ee11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:26:09.247493 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a94b3-7db5-446a-a3f0-a1783971ee11 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:26:09.247767 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a94b3-7db5-446a-a3f0-a1783971ee11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:26:09.248079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a94b3-7db5-446a-a3f0-a1783971ee11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:26:09.258284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a94b3-7db5-446a-a3f0-a1783971ee11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:26:09.259765 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a94b3-7db5-446a-a3f0-a1783971ee11 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:26:09.269412 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 750/1509] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:26:09.817383 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ae9d5-bef6-43ee-87f8-3cca1f2abfcd None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:26:09.818919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-006ae9d5-bef6-43ee-87f8-3cca1f2abfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:26:09.834375 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ae9d5-bef6-43ee-87f8-3cca1f2abfcd None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:26:09.840892 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a298fa-c16d-472f-8c70-d98fb5310ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:26:09.841483 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a298fa-c16d-472f-8c70-d98fb5310ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:26:09.842475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a298fa-c16d-472f-8c70-d98fb5310ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:26:09.842475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a298fa-c16d-472f-8c70-d98fb5310ede admin admin] PATH_INFO: `/v3/projects/aecfd88e0f9a421d85534672339cf564` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:26:09.843298 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a298fa-c16d-472f-8c70-d98fb5310ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=aecfd88e0f9a421d85534672339cf564)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:26:09.844615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: WARNING py.warnings [None req-c3a298fa-c16d-472f-8c70-d98fb5310ede admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 01:26:09.844615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: warnings.warn(msg) Sep 23 01:26:09.844615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: Sep 23 01:26:09.846001 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a298fa-c16d-472f-8c70-d98fb5310ede admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:26:09.965374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c3a298fa-c16d-472f-8c70-d98fb5310ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aecfd88e0f9a421d85534672339cf564', 'request_id': 'req-c3a298fa-c16d-472f-8c70-d98fb5310ede'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:26:10.020560 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c3a298fa-c16d-472f-8c70-d98fb5310ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aecfd88e0f9a421d85534672339cf564', 'request_id': 'req-c3a298fa-c16d-472f-8c70-d98fb5310ede'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:26:10.028153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c3a298fa-c16d-472f-8c70-d98fb5310ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aecfd88e0f9a421d85534672339cf564', 'request_id': 'req-c3a298fa-c16d-472f-8c70-d98fb5310ede'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:26:10.047309 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c3a298fa-c16d-472f-8c70-d98fb5310ede admin admin] The token cache is being invalidate because project aecfd88e0f9a421d85534672339cf564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:26:10.047630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c3a298fa-c16d-472f-8c70-d98fb5310ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:26:10.048424 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c3a298fa-c16d-472f-8c70-d98fb5310ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:26:10.049927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 760/1510] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:26:09 2022] DELETE /identity/v3/projects/aecfd88e0f9a421d85534672339cf564 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:26:19.265007 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:26:20.043957 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:27:48.818203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d095ad-0e50-405b-9888-2fb4255cf356 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:27:48.818831 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d095ad-0e50-405b-9888-2fb4255cf356 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:27:48.818831 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d095ad-0e50-405b-9888-2fb4255cf356 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:27:48.820116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 01:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:27:48.825703 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08814c-fd0a-445f-b44f-583195f4c2b0 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:27:48.826178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08814c-fd0a-445f-b44f-583195f4c2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:27:48.826280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08814c-fd0a-445f-b44f-583195f4c2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:27:48.848608 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-3b08814c-fd0a-445f-b44f-583195f4c2b0 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:27:48.849810 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-3b08814c-fd0a-445f-b44f-583195f4c2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:27:48.910471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 01:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:27:49.064660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d095ad-0e50-405b-9888-2fb4255cf356 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:27:49.069311 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-27d095ad-0e50-405b-9888-2fb4255cf356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:27:49.173398 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d095ad-0e50-405b-9888-2fb4255cf356 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:27:49.179157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2569384-77ed-4a27-8493-038961351596 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:27:49.179772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2569384-77ed-4a27-8493-038961351596 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:27:49.180057 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2569384-77ed-4a27-8493-038961351596 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:27:49.180330 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2569384-77ed-4a27-8493-038961351596 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:27:49.189877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2569384-77ed-4a27-8493-038961351596 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:27:49.191540 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2569384-77ed-4a27-8493-038961351596 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:27:49.201863 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 752/1513] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:27:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:27:50.306745 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c960958-c008-4ce6-8bbd-ca7edb47db95 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:27:50.307346 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c960958-c008-4ce6-8bbd-ca7edb47db95 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:27:50.307346 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c960958-c008-4ce6-8bbd-ca7edb47db95 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:27:50.308672 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 01:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:27:50.315997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d159f-71cd-4b28-9a18-acc38b5ca881 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:27:50.315997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d159f-71cd-4b28-9a18-acc38b5ca881 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:27:50.315997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d159f-71cd-4b28-9a18-acc38b5ca881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:27:50.342269 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-180d159f-71cd-4b28-9a18-acc38b5ca881 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:27:50.343581 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-180d159f-71cd-4b28-9a18-acc38b5ca881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:27:50.352772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 01:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:27:50.437286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287abac-5d0d-46db-9a34-cb00a9b8a329 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:27:50.437566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287abac-5d0d-46db-9a34-cb00a9b8a329 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:27:50.437844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287abac-5d0d-46db-9a34-cb00a9b8a329 None None] PATH_INFO: `/v3` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:27:50.439198 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 763/1516] 10.222.0.88 () {54 vars in 925 bytes} [Fri Sep 23 01:27:50 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:27:50.445978 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a340f-0c7e-4109-a91d-b7276fe7c31e None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:27:50.446258 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a340f-0c7e-4109-a91d-b7276fe7c31e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:27:50.446574 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a340f-0c7e-4109-a91d-b7276fe7c31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:27:50.501947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-549a340f-0c7e-4109-a91d-b7276fe7c31e None None] MFA Rules not processed for user `3eab2cbff5984fa6a8e715ed6553db82`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:27:50.503179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-549a340f-0c7e-4109-a91d-b7276fe7c31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:27:50.508616 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287abac-5d0d-46db-9a34-cb00a9b8a329 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:27:50.523812 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287abac-5d0d-46db-9a34-cb00a9b8a329 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:27:50.529380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9096e2d-e7a6-4265-9645-20c63d12b4cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:27:50.529986 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9096e2d-e7a6-4265-9645-20c63d12b4cf service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:27:50.530270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9096e2d-e7a6-4265-9645-20c63d12b4cf service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:27:50.530535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9096e2d-e7a6-4265-9645-20c63d12b4cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:27:50.540100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9096e2d-e7a6-4265-9645-20c63d12b4cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:27:50.541751 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9096e2d-e7a6-4265-9645-20c63d12b4cf service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:27:50.551554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 764/1517] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:27:50.579263 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 754/1518] 10.222.0.88 () {58 vars in 1015 bytes} [Fri Sep 23 01:27:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:27:59.781073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc90f1-2aba-4726-8551-5a426ab815f2 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:27:59.781654 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc90f1-2aba-4726-8551-5a426ab815f2 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:27:59.781654 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc90f1-2aba-4726-8551-5a426ab815f2 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:27:59.783212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 765/1519] 10.222.0.83 () {54 vars in 961 bytes} [Fri Sep 23 01:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:27:59.790077 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df64f3-4ca6-4994-a784-9c84708ca60d None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:27:59.790077 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df64f3-4ca6-4994-a784-9c84708ca60d None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:27:59.790077 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df64f3-4ca6-4994-a784-9c84708ca60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:27:59.809961 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-04df64f3-4ca6-4994-a784-9c84708ca60d None None] MFA Rules not processed for user `3eab2cbff5984fa6a8e715ed6553db82`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:27:59.811245 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-04df64f3-4ca6-4994-a784-9c84708ca60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:27:59.820301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 755/1520] 10.222.0.83 () {58 vars in 1058 bytes} [Fri Sep 23 01:27:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:27:59.829323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc90f1-2aba-4726-8551-5a426ab815f2 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:27:59.845868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc90f1-2aba-4726-8551-5a426ab815f2 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:27:59.851662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88767fdb-0111-45df-b97d-e50f398b3b23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eab2cbff5984fa6a8e715ed6553db82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:27:59.852279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88767fdb-0111-45df-b97d-e50f398b3b23 service placement] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:27:59.852560 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88767fdb-0111-45df-b97d-e50f398b3b23 service placement] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:27:59.852831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88767fdb-0111-45df-b97d-e50f398b3b23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:27:59.861971 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88767fdb-0111-45df-b97d-e50f398b3b23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:27:59.863597 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88767fdb-0111-45df-b97d-e50f398b3b23 service placement] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:27:59.873365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 766/1521] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:27:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:28:02.062403 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bb1c2-8945-42d3-9a6d-9dcbeefc8d4d None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:28:02.063014 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bb1c2-8945-42d3-9a6d-9dcbeefc8d4d None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:28:02.063014 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bb1c2-8945-42d3-9a6d-9dcbeefc8d4d None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:28:02.064340 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 01:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:28:02.071012 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc65751-af1c-4871-8518-ca011c99f96e None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:28:02.071528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc65751-af1c-4871-8518-ca011c99f96e None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:28:02.071656 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc65751-af1c-4871-8518-ca011c99f96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:28:02.092668 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-7dc65751-af1c-4871-8518-ca011c99f96e None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:28:02.093905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-7dc65751-af1c-4871-8518-ca011c99f96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:28:02.101972 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 01:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:28:02.260066 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bb1c2-8945-42d3-9a6d-9dcbeefc8d4d None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:28:02.275092 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bb1c2-8945-42d3-9a6d-9dcbeefc8d4d None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:28:02.281538 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c9291-6fc9-445e-98c2-5c21010bf972 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:28:02.281538 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c9291-6fc9-445e-98c2-5c21010bf972 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:28:02.281855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c9291-6fc9-445e-98c2-5c21010bf972 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:28:02.282022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c9291-6fc9-445e-98c2-5c21010bf972 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:28:02.295009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:28:02.301381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c9291-6fc9-445e-98c2-5c21010bf972 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:28:02.303038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c9291-6fc9-445e-98c2-5c21010bf972 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:28:02.314773 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 757/1524] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:28:03.419287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f899d4-057b-45cb-a570-45f8f7062f8f None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:28:03.419845 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f899d4-057b-45cb-a570-45f8f7062f8f None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:28:03.419845 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f899d4-057b-45cb-a570-45f8f7062f8f None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:28:03.421266 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 01:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:28:03.427965 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0968835-8c2c-457c-a10c-b8a9092c4cbe None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:28:03.428540 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0968835-8c2c-457c-a10c-b8a9092c4cbe None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:28:03.428540 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0968835-8c2c-457c-a10c-b8a9092c4cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:28:03.450859 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-a0968835-8c2c-457c-a10c-b8a9092c4cbe None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:28:03.452096 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a0968835-8c2c-457c-a10c-b8a9092c4cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:28:03.460229 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 01:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:28:03.615176 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f899d4-057b-45cb-a570-45f8f7062f8f None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:28:03.630429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f899d4-057b-45cb-a570-45f8f7062f8f None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:28:03.636889 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd1d94-8cff-44f9-b553-1784a353adb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:28:03.637515 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd1d94-8cff-44f9-b553-1784a353adb3 service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:28:03.637794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd1d94-8cff-44f9-b553-1784a353adb3 service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:28:03.638073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd1d94-8cff-44f9-b553-1784a353adb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:28:03.646848 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd1d94-8cff-44f9-b553-1784a353adb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:28:03.656679 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd1d94-8cff-44f9-b553-1784a353adb3 service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:28:03.659052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 769/1527] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:28:07.832186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb903d-6938-41cf-950b-e0313d2210f5 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:28:07.832804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb903d-6938-41cf-950b-e0313d2210f5 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:28:07.832804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb903d-6938-41cf-950b-e0313d2210f5 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:28:07.834104 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 01:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:28:07.839657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4a75b-3d6f-4c8b-85a2-afbe0c0b27d6 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:28:07.840685 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4a75b-3d6f-4c8b-85a2-afbe0c0b27d6 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:28:07.840786 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4a75b-3d6f-4c8b-85a2-afbe0c0b27d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:28:07.861450 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-b3b4a75b-3d6f-4c8b-85a2-afbe0c0b27d6 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:28:07.862696 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b3b4a75b-3d6f-4c8b-85a2-afbe0c0b27d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:28:07.871045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 01:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:28:08.169757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb903d-6938-41cf-950b-e0313d2210f5 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:28:08.171628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-7edb903d-6938-41cf-950b-e0313d2210f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:28:08.230717 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb903d-6938-41cf-950b-e0313d2210f5 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:28:08.234279 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9abaa2-04e6-4b54-9b38-8aefdda873a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:28:08.234923 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9abaa2-04e6-4b54-9b38-8aefdda873a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:28:08.235192 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9abaa2-04e6-4b54-9b38-8aefdda873a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:28:08.235455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9abaa2-04e6-4b54-9b38-8aefdda873a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:28:08.244539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9abaa2-04e6-4b54-9b38-8aefdda873a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:28:08.245971 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9abaa2-04e6-4b54-9b38-8aefdda873a5 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:28:08.259122 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 760/1530] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:28:10.444454 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850f5e7-ce9d-40df-a9bb-6b20c4c30673 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:28:10.445087 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850f5e7-ce9d-40df-a9bb-6b20c4c30673 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:28:10.445087 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850f5e7-ce9d-40df-a9bb-6b20c4c30673 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:28:10.446329 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 01:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:28:10.451810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d7065-d2c2-48d5-b20a-998b1c072ecf None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:28:10.452285 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d7065-d2c2-48d5-b20a-998b1c072ecf None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:28:10.452397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d7065-d2c2-48d5-b20a-998b1c072ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:28:10.471878 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-8a5d7065-d2c2-48d5-b20a-998b1c072ecf None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:28:10.473113 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-8a5d7065-d2c2-48d5-b20a-998b1c072ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:28:10.482070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 01:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:28:10.774372 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850f5e7-ce9d-40df-a9bb-6b20c4c30673 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:28:10.776251 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-0850f5e7-ce9d-40df-a9bb-6b20c4c30673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:28:10.783805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=52 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:28:10.790468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850f5e7-ce9d-40df-a9bb-6b20c4c30673 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:28:10.793566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b6d1b-d273-4128-b706-2aa69ad73164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:28:10.794252 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b6d1b-d273-4128-b706-2aa69ad73164 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:28:10.794528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b6d1b-d273-4128-b706-2aa69ad73164 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:28:10.794823 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b6d1b-d273-4128-b706-2aa69ad73164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:28:10.804290 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b6d1b-d273-4128-b706-2aa69ad73164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:28:10.805720 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b6d1b-d273-4128-b706-2aa69ad73164 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:28:10.816264 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 772/1533] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:28:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:28:14.558957 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a8eae-d4c9-4500-877e-2ed6434c31a8 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:28:14.559481 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a8eae-d4c9-4500-877e-2ed6434c31a8 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:28:14.559582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a8eae-d4c9-4500-877e-2ed6434c31a8 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:28:14.560859 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 01:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:28:14.566043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce40ee1-0a59-47e8-ad67-162a909e450f None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:28:14.566485 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce40ee1-0a59-47e8-ad67-162a909e450f None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:28:14.566614 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce40ee1-0a59-47e8-ad67-162a909e450f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:28:14.585822 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-bce40ee1-0a59-47e8-ad67-162a909e450f None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:28:14.587052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-bce40ee1-0a59-47e8-ad67-162a909e450f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:28:14.595406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 01:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:28:14.903934 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a8eae-d4c9-4500-877e-2ed6434c31a8 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:28:14.905633 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-893a8eae-d4c9-4500-877e-2ed6434c31a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:28:14.964274 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a8eae-d4c9-4500-877e-2ed6434c31a8 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:28:14.968743 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e945b-165f-4c2a-b79a-c7961da8693d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:28:14.969299 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e945b-165f-4c2a-b79a-c7961da8693d service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:28:14.969628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e945b-165f-4c2a-b79a-c7961da8693d service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:28:14.970292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e945b-165f-4c2a-b79a-c7961da8693d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:28:14.980431 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e945b-165f-4c2a-b79a-c7961da8693d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:28:14.981986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e945b-165f-4c2a-b79a-c7961da8693d service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:28:14.992288 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 763/1536] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:28:17.191353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f323c-74fa-48ab-92da-892f3dd41fe0 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:28:17.191950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f323c-74fa-48ab-92da-892f3dd41fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:28:17.191950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f323c-74fa-48ab-92da-892f3dd41fe0 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:28:17.193286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 01:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:28:17.198995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822319c-4e58-4c06-959f-bb0d80fda748 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:28:17.199519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822319c-4e58-4c06-959f-bb0d80fda748 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:28:17.199519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822319c-4e58-4c06-959f-bb0d80fda748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:28:17.219262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-c822319c-4e58-4c06-959f-bb0d80fda748 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:28:17.220514 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-c822319c-4e58-4c06-959f-bb0d80fda748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:28:17.228997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:28:17.536860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f323c-74fa-48ab-92da-892f3dd41fe0 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:28:17.538692 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-1f9f323c-74fa-48ab-92da-892f3dd41fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:28:17.552447 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f323c-74fa-48ab-92da-892f3dd41fe0 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:28:17.556067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98271078-1a98-47b3-9f8a-76057f3e2d43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:28:17.556673 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271078-1a98-47b3-9f8a-76057f3e2d43 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:28:17.556949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271078-1a98-47b3-9f8a-76057f3e2d43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:28:17.557215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271078-1a98-47b3-9f8a-76057f3e2d43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:28:17.567053 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98271078-1a98-47b3-9f8a-76057f3e2d43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:28:17.568493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98271078-1a98-47b3-9f8a-76057f3e2d43 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:28:17.578258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 775/1539] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:28:27.213483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=63 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:28:27.573868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=14 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:48.990526 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674aa48-458e-42b5-82fa-72e3ce14c6c4 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:48.991513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674aa48-458e-42b5-82fa-72e3ce14c6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:48.991685 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674aa48-458e-42b5-82fa-72e3ce14c6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:49.039070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-8674aa48-458e-42b5-82fa-72e3ce14c6c4 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:49.041411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-8674aa48-458e-42b5-82fa-72e3ce14c6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:49.063585 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 765/1540] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:49.082477 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10ba77-9662-4025-a323-1b75d0323fda None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:49.084202 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10ba77-9662-4025-a323-1b75d0323fda None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:49.085018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10ba77-9662-4025-a323-1b75d0323fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:49.122686 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-ee10ba77-9662-4025-a323-1b75d0323fda None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:49.124117 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ee10ba77-9662-4025-a323-1b75d0323fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:49.144805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 776/1541] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:49.152043 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674aa48-458e-42b5-82fa-72e3ce14c6c4 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:49.172187 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e1b85-fcf8-4313-a5ed-48304aeaa48e None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:49.172505 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e1b85-fcf8-4313-a5ed-48304aeaa48e None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:49.172866 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e1b85-fcf8-4313-a5ed-48304aeaa48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:49.183530 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674aa48-458e-42b5-82fa-72e3ce14c6c4 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:49.198230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc66b71-1957-46c5-b3c1-28e630c9db3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:49.199319 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc66b71-1957-46c5-b3c1-28e630c9db3a admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:49.199799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc66b71-1957-46c5-b3c1-28e630c9db3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:49.200277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc66b71-1957-46c5-b3c1-28e630c9db3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:49.201417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc66b71-1957-46c5-b3c1-28e630c9db3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:29:49.201937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc66b71-1957-46c5-b3c1-28e630c9db3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:49.204755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: WARNING py.warnings [None req-bdc66b71-1957-46c5-b3c1-28e630c9db3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 01:29:49.204755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: warnings.warn(msg) Sep 23 01:29:49.204755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: Sep 23 01:29:49.206485 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc66b71-1957-46c5-b3c1-28e630c9db3a admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:49.221708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-598e1b85-fcf8-4313-a5ed-48304aeaa48e None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:49.223189 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-598e1b85-fcf8-4313-a5ed-48304aeaa48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:49.239603 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 777/1542] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:29:49.241453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218cd4e-718f-4e7b-aea4-0be4abb15d98 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:49.241810 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218cd4e-718f-4e7b-aea4-0be4abb15d98 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:49.242383 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218cd4e-718f-4e7b-aea4-0be4abb15d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:49.250973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 766/1543] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:29:49.253393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db3576-657a-402a-8a28-c3e6effdcd95 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:49.253909 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db3576-657a-402a-8a28-c3e6effdcd95 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:49.254398 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db3576-657a-402a-8a28-c3e6effdcd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:49.276641 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-2218cd4e-718f-4e7b-aea4-0be4abb15d98 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:49.283188 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-2218cd4e-718f-4e7b-aea4-0be4abb15d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:49.299808 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 778/1544] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:49.301929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d6d9d-7cac-4f36-b091-6b965ce6e8f9 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:49.302295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d6d9d-7cac-4f36-b091-6b965ce6e8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:49.302467 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d6d9d-7cac-4f36-b091-6b965ce6e8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:49.319762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-31db3576-657a-402a-8a28-c3e6effdcd95 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:49.328577 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-31db3576-657a-402a-8a28-c3e6effdcd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:49.360764 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-e41d6d9d-7cac-4f36-b091-6b965ce6e8f9 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:49.360764 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e41d6d9d-7cac-4f36-b091-6b965ce6e8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:49.372759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 779/1545] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:49.377592 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d6d9d-7cac-4f36-b091-6b965ce6e8f9 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:49.377815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 767/1546] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:49.379621 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf095be-b3e0-406c-8d50-323d48a63097 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:49.380102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf095be-b3e0-406c-8d50-323d48a63097 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:49.380590 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf095be-b3e0-406c-8d50-323d48a63097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:49.396421 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d6d9d-7cac-4f36-b091-6b965ce6e8f9 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:49.408139 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066bedc-24aa-44cc-901a-d435c9f3f7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:49.408876 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066bedc-24aa-44cc-901a-d435c9f3f7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:49.409223 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066bedc-24aa-44cc-901a-d435c9f3f7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:49.409632 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066bedc-24aa-44cc-901a-d435c9f3f7f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:49.410459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066bedc-24aa-44cc-901a-d435c9f3f7f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:49.412618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: WARNING py.warnings [None req-9066bedc-24aa-44cc-901a-d435c9f3f7f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 01:29:49.412618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: warnings.warn(msg) Sep 23 01:29:49.412618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: Sep 23 01:29:49.420108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066bedc-24aa-44cc-901a-d435c9f3f7f8 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:49.457180 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-9bf095be-b3e0-406c-8d50-323d48a63097 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:49.463369 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-9bf095be-b3e0-406c-8d50-323d48a63097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:49.481439 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 768/1547] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:49.482029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf095be-b3e0-406c-8d50-323d48a63097 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:49.499243 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf095be-b3e0-406c-8d50-323d48a63097 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:49.509335 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847d90b-ed24-4598-9742-86e6a655b6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:49.509984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847d90b-ed24-4598-9742-86e6a655b6bd admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:49.510276 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847d90b-ed24-4598-9742-86e6a655b6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:49.510536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847d90b-ed24-4598-9742-86e6a655b6bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:49.512104 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847d90b-ed24-4598-9742-86e6a655b6bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:29:49.512451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847d90b-ed24-4598-9742-86e6a655b6bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:49.514113 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847d90b-ed24-4598-9742-86e6a655b6bd admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:49.538793 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 769/1548] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:29:49.540185 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4b073-d6e0-4de5-a9de-0bc54778236a None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:49.540479 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4b073-d6e0-4de5-a9de-0bc54778236a None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:49.540744 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4b073-d6e0-4de5-a9de-0bc54778236a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:49.569508 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 780/1549] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:29:49 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:49.572334 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066bedc-24aa-44cc-901a-d435c9f3f7f8 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:49.603036 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-82a4b073-d6e0-4de5-a9de-0bc54778236a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:49.605995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-82a4b073-d6e0-4de5-a9de-0bc54778236a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:49.722860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066bedc-24aa-44cc-901a-d435c9f3f7f8 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:49.732395 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1991a-4044-46c5-b9de-72c095a11c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:49.733701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1991a-4044-46c5-b9de-72c095a11c24 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:49.734506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1991a-4044-46c5-b9de-72c095a11c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:49.735126 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1991a-4044-46c5-b9de-72c095a11c24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:49.736749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1991a-4044-46c5-b9de-72c095a11c24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:29:49.737249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1991a-4044-46c5-b9de-72c095a11c24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:49.740414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1991a-4044-46c5-b9de-72c095a11c24 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:49.767335 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 781/1550] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:29:49.769571 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1991a-4044-46c5-b9de-72c095a11c24 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:49.772668 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 770/1551] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:49.774071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4b073-d6e0-4de5-a9de-0bc54778236a None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:49.793319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1991a-4044-46c5-b9de-72c095a11c24 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:49.794230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4b073-d6e0-4de5-a9de-0bc54778236a None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:49.802823 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4552204-03c0-46ad-b97d-16dda7a241ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:49.804735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ada57f-6fde-4dee-9fe6-8a8fd1fd70f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:49.804993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4552204-03c0-46ad-b97d-16dda7a241ac admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:49.805467 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4552204-03c0-46ad-b97d-16dda7a241ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:49.805864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4552204-03c0-46ad-b97d-16dda7a241ac admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:49.807019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4552204-03c0-46ad-b97d-16dda7a241ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:49.807920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ada57f-6fde-4dee-9fe6-8a8fd1fd70f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:49.808753 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ada57f-6fde-4dee-9fe6-8a8fd1fd70f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:49.809111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: WARNING py.warnings [None req-b4552204-03c0-46ad-b97d-16dda7a241ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 01:29:49.809111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: warnings.warn(msg) Sep 23 01:29:49.809111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: Sep 23 01:29:49.810160 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ada57f-6fde-4dee-9fe6-8a8fd1fd70f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:49.811495 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4552204-03c0-46ad-b97d-16dda7a241ac admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:49.812169 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ada57f-6fde-4dee-9fe6-8a8fd1fd70f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:49.817511 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ada57f-6fde-4dee-9fe6-8a8fd1fd70f6 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:49.943554 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 771/1552] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:29:49 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:49.945304 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85785a-73b3-485d-ae7f-c9b992ad7c1f None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:49.945631 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85785a-73b3-485d-ae7f-c9b992ad7c1f None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:49.945864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85785a-73b3-485d-ae7f-c9b992ad7c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:49.969669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-7c85785a-73b3-485d-ae7f-c9b992ad7c1f None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:49.971122 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-7c85785a-73b3-485d-ae7f-c9b992ad7c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:49.975645 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 782/1553] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:29:49 2022] POST /identity/v3/projects => generated 389 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:49.977443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c585ca-cfdb-4d40-a3d6-400711191da0 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:49.977919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c585ca-cfdb-4d40-a3d6-400711191da0 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:49.978421 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c585ca-cfdb-4d40-a3d6-400711191da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.005519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-36c585ca-cfdb-4d40-a3d6-400711191da0 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:50.007113 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-36c585ca-cfdb-4d40-a3d6-400711191da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:50.093174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 772/1554] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:50.093174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85785a-73b3-485d-ae7f-c9b992ad7c1f None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:50.097174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 783/1555] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:50.098560 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c585ca-cfdb-4d40-a3d6-400711191da0 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:50.104061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85785a-73b3-485d-ae7f-c9b992ad7c1f None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:50.111230 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c585ca-cfdb-4d40-a3d6-400711191da0 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:50.112994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fe3bb-73bc-46a2-97af-9c7e1bdccedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:50.113772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fe3bb-73bc-46a2-97af-9c7e1bdccedd admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.114072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fe3bb-73bc-46a2-97af-9c7e1bdccedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.114445 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fe3bb-73bc-46a2-97af-9c7e1bdccedd admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.115274 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927fe3bb-73bc-46a2-97af-9c7e1bdccedd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:29:50.115657 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927fe3bb-73bc-46a2-97af-9c7e1bdccedd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:50.117407 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda5dd3-b2d5-4f8e-8c17-812c7819100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:50.118072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927fe3bb-73bc-46a2-97af-9c7e1bdccedd admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:50.118273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda5dd3-b2d5-4f8e-8c17-812c7819100e admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.118717 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda5dd3-b2d5-4f8e-8c17-812c7819100e admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.119179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda5dd3-b2d5-4f8e-8c17-812c7819100e admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.120015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda5dd3-b2d5-4f8e-8c17-812c7819100e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:50.122442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda5dd3-b2d5-4f8e-8c17-812c7819100e admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:50.134365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 773/1556] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:29:50.136931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06574122-ca9a-4aef-b3d4-982b453efa9e None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.137529 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06574122-ca9a-4aef-b3d4-982b453efa9e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.138113 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06574122-ca9a-4aef-b3d4-982b453efa9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.165932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-06574122-ca9a-4aef-b3d4-982b453efa9e None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:50.167497 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-06574122-ca9a-4aef-b3d4-982b453efa9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:50.176208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 774/1557] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:50.177718 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4bb16-4c2a-4d33-acba-6df792e9a86a None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.178004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4bb16-4c2a-4d33-acba-6df792e9a86a None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.178281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4bb16-4c2a-4d33-acba-6df792e9a86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.200849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-aaa4bb16-4c2a-4d33-acba-6df792e9a86a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:50.203949 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-aaa4bb16-4c2a-4d33-acba-6df792e9a86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:50.211422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 775/1558] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:50.212610 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4bb16-4c2a-4d33-acba-6df792e9a86a None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:50.224606 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4bb16-4c2a-4d33-acba-6df792e9a86a None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:50.232400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1ee12-a346-4087-beb0-1e7bd80d09c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:50.233117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1ee12-a346-4087-beb0-1e7bd80d09c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.233479 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1ee12-a346-4087-beb0-1e7bd80d09c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.233934 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1ee12-a346-4087-beb0-1e7bd80d09c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.234894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1ee12-a346-4087-beb0-1e7bd80d09c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:50.236896 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1ee12-a346-4087-beb0-1e7bd80d09c8 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:50.242576 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 784/1559] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:29:50 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:50.243817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda5dd3-b2d5-4f8e-8c17-812c7819100e admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:50.245640 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:50.253785 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:50.254213 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 776/1560] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:50.255846 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639ac26-42e6-4f30-b968-d1bf24ef594e None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.256257 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639ac26-42e6-4f30-b968-d1bf24ef594e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.256663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639ac26-42e6-4f30-b968-d1bf24ef594e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.288417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-b639ac26-42e6-4f30-b968-d1bf24ef594e None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:50.291119 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b639ac26-42e6-4f30-b968-d1bf24ef594e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:50.340673 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda5dd3-b2d5-4f8e-8c17-812c7819100e admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:50.346992 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aed00f-28f6-4fa7-9c6d-8aebd6ef7058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:50.347869 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aed00f-28f6-4fa7-9c6d-8aebd6ef7058 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.348626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aed00f-28f6-4fa7-9c6d-8aebd6ef7058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.348626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aed00f-28f6-4fa7-9c6d-8aebd6ef7058 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.349459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aed00f-28f6-4fa7-9c6d-8aebd6ef7058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:50.351831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aed00f-28f6-4fa7-9c6d-8aebd6ef7058 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:50.373602 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 777/1561] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:50.375828 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8dcdd-3e24-44d5-a34d-f46c704f91ff None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.376118 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8dcdd-3e24-44d5-a34d-f46c704f91ff None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.376386 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8dcdd-3e24-44d5-a34d-f46c704f91ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.400428 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-63f8dcdd-3e24-44d5-a34d-f46c704f91ff None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:50.402319 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-63f8dcdd-3e24-44d5-a34d-f46c704f91ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:50.412206 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 778/1562] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:50.413721 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8dcdd-3e24-44d5-a34d-f46c704f91ff None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:50.427197 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8dcdd-3e24-44d5-a34d-f46c704f91ff None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:50.433123 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0e359-8807-4cca-8825-346d6df58be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:50.433801 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0e359-8807-4cca-8825-346d6df58be6 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.434202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0e359-8807-4cca-8825-346d6df58be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.434556 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0e359-8807-4cca-8825-346d6df58be6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.435332 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0e359-8807-4cca-8825-346d6df58be6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:50.438896 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0e359-8807-4cca-8825-346d6df58be6 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:50.512522 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 785/1563] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:29:50 2022] POST /identity/v3/users => generated 295 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:50.514062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd983-0e7a-4f3b-8218-e379398a2937 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.514328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd983-0e7a-4f3b-8218-e379398a2937 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.514658 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd983-0e7a-4f3b-8218-e379398a2937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.537106 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-be6cd983-0e7a-4f3b-8218-e379398a2937 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:50.538531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-be6cd983-0e7a-4f3b-8218-e379398a2937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:50.551740 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 786/1564] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:50.553629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656e934-b2a8-413b-b0a1-c7fc364bb5d0 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.553919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656e934-b2a8-413b-b0a1-c7fc364bb5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.554226 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656e934-b2a8-413b-b0a1-c7fc364bb5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.560620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 779/1565] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:29:50 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:50.561796 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0e359-8807-4cca-8825-346d6df58be6 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:50.583376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-9656e934-b2a8-413b-b0a1-c7fc364bb5d0 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:50.584909 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-9656e934-b2a8-413b-b0a1-c7fc364bb5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:50.646095 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0e359-8807-4cca-8825-346d6df58be6 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:50.651891 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f01414-76f8-4e96-a9bf-b6d7d96e0c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:50.652522 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f01414-76f8-4e96-a9bf-b6d7d96e0c14 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.652804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f01414-76f8-4e96-a9bf-b6d7d96e0c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.653081 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f01414-76f8-4e96-a9bf-b6d7d96e0c14 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.653875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f01414-76f8-4e96-a9bf-b6d7d96e0c14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:50.656625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f01414-76f8-4e96-a9bf-b6d7d96e0c14 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:50.678250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 787/1566] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:50.679471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656e934-b2a8-413b-b0a1-c7fc364bb5d0 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:50.690344 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656e934-b2a8-413b-b0a1-c7fc364bb5d0 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:50.696408 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219ebde-d8de-42ce-b217-8b3527921ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:50.697088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219ebde-d8de-42ce-b217-8b3527921ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.697365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219ebde-d8de-42ce-b217-8b3527921ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.697703 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219ebde-d8de-42ce-b217-8b3527921ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.698479 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219ebde-d8de-42ce-b217-8b3527921ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:50.700426 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219ebde-d8de-42ce-b217-8b3527921ae3 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:50.712877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 788/1567] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:50.736732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219ebde-d8de-42ce-b217-8b3527921ae3 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:50.736732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219ebde-d8de-42ce-b217-8b3527921ae3 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:50.736732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5e6dd-3d13-42c3-b6de-1dd0212a21e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:50.736732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5e6dd-3d13-42c3-b6de-1dd0212a21e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.737388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5e6dd-3d13-42c3-b6de-1dd0212a21e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.737388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5e6dd-3d13-42c3-b6de-1dd0212a21e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.737388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5e6dd-3d13-42c3-b6de-1dd0212a21e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:29:50.737388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5e6dd-3d13-42c3-b6de-1dd0212a21e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:50.737388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5e6dd-3d13-42c3-b6de-1dd0212a21e0 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:50.752276 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 789/1568] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:29:50.753358 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5e6dd-3d13-42c3-b6de-1dd0212a21e0 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:50.770902 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5e6dd-3d13-42c3-b6de-1dd0212a21e0 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:50.770902 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68d66a-dbdc-40a0-8a1a-ab06f583d2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:50.771544 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68d66a-dbdc-40a0-8a1a-ab06f583d2ae admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.771805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68d66a-dbdc-40a0-8a1a-ab06f583d2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.772089 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68d66a-dbdc-40a0-8a1a-ab06f583d2ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.772752 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68d66a-dbdc-40a0-8a1a-ab06f583d2ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:29:50.773071 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68d66a-dbdc-40a0-8a1a-ab06f583d2ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:50.774775 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68d66a-dbdc-40a0-8a1a-ab06f583d2ae admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:50.789438 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 790/1569] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:29:50.791040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68d66a-dbdc-40a0-8a1a-ab06f583d2ae admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:50.808071 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68d66a-dbdc-40a0-8a1a-ab06f583d2ae admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:50.811365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 780/1570] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:29:50 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:50.811365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f01414-76f8-4e96-a9bf-b6d7d96e0c14 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:50.816202 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769a150-3048-49be-88cb-e6b26919da02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:50.816982 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769a150-3048-49be-88cb-e6b26919da02 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.817373 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769a150-3048-49be-88cb-e6b26919da02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.817748 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769a150-3048-49be-88cb-e6b26919da02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.818522 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769a150-3048-49be-88cb-e6b26919da02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:50.820591 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769a150-3048-49be-88cb-e6b26919da02 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:50.826693 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f01414-76f8-4e96-a9bf-b6d7d96e0c14 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:50.834024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424faee-ab2f-407a-90ea-0f513f963d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:50.839953 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424faee-ab2f-407a-90ea-0f513f963d8b admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.839953 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424faee-ab2f-407a-90ea-0f513f963d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.839953 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424faee-ab2f-407a-90ea-0f513f963d8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.840429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 791/1571] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:50.840580 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424faee-ab2f-407a-90ea-0f513f963d8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:29:50.840580 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424faee-ab2f-407a-90ea-0f513f963d8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:50.840847 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769a150-3048-49be-88cb-e6b26919da02 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:50.841073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424faee-ab2f-407a-90ea-0f513f963d8b admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:50.856005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769a150-3048-49be-88cb-e6b26919da02 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:50.863783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b33e3d-110f-43c1-a815-594df463a2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:50.868684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b33e3d-110f-43c1-a815-594df463a2aa admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.868684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b33e3d-110f-43c1-a815-594df463a2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.868684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b33e3d-110f-43c1-a815-594df463a2aa admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.869224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 781/1572] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:29:50.869397 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b33e3d-110f-43c1-a815-594df463a2aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:50.869560 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424faee-ab2f-407a-90ea-0f513f963d8b admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:50.870787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b33e3d-110f-43c1-a815-594df463a2aa admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:50.883482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424faee-ab2f-407a-90ea-0f513f963d8b admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:50.896623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8413a-e99b-4935-9c81-59e8369c3c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:50.896623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8413a-e99b-4935-9c81-59e8369c3c2e admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.896623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8413a-e99b-4935-9c81-59e8369c3c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.896623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8413a-e99b-4935-9c81-59e8369c3c2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.897285 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8413a-e99b-4935-9c81-59e8369c3c2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:29:50.897285 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8413a-e99b-4935-9c81-59e8369c3c2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:50.897285 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8413a-e99b-4935-9c81-59e8369c3c2e admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:50.911970 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 782/1573] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:29:50.913024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8413a-e99b-4935-9c81-59e8369c3c2e admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:50.926142 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8413a-e99b-4935-9c81-59e8369c3c2e admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:50.937424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab688fa-8975-474a-a6d0-4e7e6e9cedef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:50.937424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab688fa-8975-474a-a6d0-4e7e6e9cedef admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:50.937424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab688fa-8975-474a-a6d0-4e7e6e9cedef admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:50.937424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab688fa-8975-474a-a6d0-4e7e6e9cedef admin admin] PATH_INFO: `/v3/projects/dcff9fa0637f4373827830aa86d59acf/users/5a51ddfac8db466a8da79d07822225b1/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:50.951550 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab688fa-8975-474a-a6d0-4e7e6e9cedef admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcff9fa0637f4373827830aa86d59acf, user_id=5a51ddfac8db466a8da79d07822225b1, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:50.954667 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab688fa-8975-474a-a6d0-4e7e6e9cedef admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:51.016436 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 792/1574] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:29:50 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:51.017578 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b33e3d-110f-43c1-a815-594df463a2aa admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:51.036044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b33e3d-110f-43c1-a815-594df463a2aa admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:51.040333 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 783/1575] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:29:50 2022] PUT /identity/v3/projects/dcff9fa0637f4373827830aa86d59acf/users/5a51ddfac8db466a8da79d07822225b1/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:29:51.041583 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab688fa-8975-474a-a6d0-4e7e6e9cedef admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:51.070178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:51.070718 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:51.126496 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f2379-42ec-4e22-b871-ac7ed0093695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:51.127623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2379-42ec-4e22-b871-ac7ed0093695 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:51.128005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2379-42ec-4e22-b871-ac7ed0093695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:51.128405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2379-42ec-4e22-b871-ac7ed0093695 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:51.129455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f2379-42ec-4e22-b871-ac7ed0093695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:51.132790 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f2379-42ec-4e22-b871-ac7ed0093695 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:51.151514 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab688fa-8975-474a-a6d0-4e7e6e9cedef admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:51.161444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e51a39-6471-4acd-8fd1-db0443ef792c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:51.162176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e51a39-6471-4acd-8fd1-db0443ef792c admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:51.162461 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e51a39-6471-4acd-8fd1-db0443ef792c admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:51.163048 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e51a39-6471-4acd-8fd1-db0443ef792c admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:51.163606 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e51a39-6471-4acd-8fd1-db0443ef792c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:51.166525 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e51a39-6471-4acd-8fd1-db0443ef792c admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:51.302909 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 793/1576] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:29:51 2022] POST /identity/v3/projects => generated 385 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:51.304032 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f2379-42ec-4e22-b871-ac7ed0093695 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:51.341333 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 784/1577] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:29:51 2022] POST /identity/v3/projects => generated 379 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:51.345077 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e51a39-6471-4acd-8fd1-db0443ef792c admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:51.402475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f2379-42ec-4e22-b871-ac7ed0093695 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:51.456575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e51a39-6471-4acd-8fd1-db0443ef792c admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:51.463994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fd994-886b-4392-ac9b-4d3824fd4231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:51.465187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fd994-886b-4392-ac9b-4d3824fd4231 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:51.465436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fd994-886b-4392-ac9b-4d3824fd4231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:51.465862 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fd994-886b-4392-ac9b-4d3824fd4231 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:51.467089 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fd994-886b-4392-ac9b-4d3824fd4231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:51.469741 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fd994-886b-4392-ac9b-4d3824fd4231 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:51.487454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 785/1578] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:51.488503 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fd994-886b-4392-ac9b-4d3824fd4231 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:51.503989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fd994-886b-4392-ac9b-4d3824fd4231 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:51.506221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e2830-1e73-42ce-bcbc-ac622d1c1beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:51.507431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e2830-1e73-42ce-bcbc-ac622d1c1beb admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:51.507816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e2830-1e73-42ce-bcbc-ac622d1c1beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:51.513538 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e2830-1e73-42ce-bcbc-ac622d1c1beb admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:51.513538 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e2830-1e73-42ce-bcbc-ac622d1c1beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:51.513871 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1aa085-503e-48cb-84a3-71ea148f1b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:51.514050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e2830-1e73-42ce-bcbc-ac622d1c1beb admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:51.514197 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1aa085-503e-48cb-84a3-71ea148f1b75 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:51.514197 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1aa085-503e-48cb-84a3-71ea148f1b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:51.514197 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1aa085-503e-48cb-84a3-71ea148f1b75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:51.514632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1aa085-503e-48cb-84a3-71ea148f1b75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:51.518250 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1aa085-503e-48cb-84a3-71ea148f1b75 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:51.534666 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 794/1579] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:51.534666 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e2830-1e73-42ce-bcbc-ac622d1c1beb admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:51.549739 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e2830-1e73-42ce-bcbc-ac622d1c1beb admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:51.559279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b8e18-7dd4-454f-9407-6ef7af321753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:51.559279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b8e18-7dd4-454f-9407-6ef7af321753 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:51.559279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b8e18-7dd4-454f-9407-6ef7af321753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:51.559279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b8e18-7dd4-454f-9407-6ef7af321753 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:51.560176 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b8e18-7dd4-454f-9407-6ef7af321753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:51.560176 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b8e18-7dd4-454f-9407-6ef7af321753 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:51.685407 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 786/1580] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:29:51 2022] POST /identity/v3/projects => generated 379 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:51.691580 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1aa085-503e-48cb-84a3-71ea148f1b75 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:51.772049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 795/1581] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:29:51 2022] POST /identity/v3/projects => generated 385 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:51.773502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37beeb1-621d-4441-94af-ee1e67f5d878 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:51.773863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37beeb1-621d-4441-94af-ee1e67f5d878 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:51.774147 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37beeb1-621d-4441-94af-ee1e67f5d878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:51.811140 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-a37beeb1-621d-4441-94af-ee1e67f5d878 None None] MFA Rules not processed for user `5a51ddfac8db466a8da79d07822225b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:51.811736 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1aa085-503e-48cb-84a3-71ea148f1b75 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:51.813113 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a37beeb1-621d-4441-94af-ee1e67f5d878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:51.830207 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:51.835280 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:51.903365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 796/1582] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:51.904279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37beeb1-621d-4441-94af-ee1e67f5d878 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:51.929927 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66277c-81cc-4f94-8e37-0f7aa8210587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:51.930990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66277c-81cc-4f94-8e37-0f7aa8210587 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:51.931549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66277c-81cc-4f94-8e37-0f7aa8210587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:51.931969 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66277c-81cc-4f94-8e37-0f7aa8210587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:51.933670 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66277c-81cc-4f94-8e37-0f7aa8210587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:51.937780 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66277c-81cc-4f94-8e37-0f7aa8210587 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:51.963638 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 787/1583] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:51.963638 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66277c-81cc-4f94-8e37-0f7aa8210587 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:51.982858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66277c-81cc-4f94-8e37-0f7aa8210587 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:51.992503 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb32dae-14f0-4d63-a3ff-42173b6265ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:51.993789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb32dae-14f0-4d63-a3ff-42173b6265ea admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:51.994289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb32dae-14f0-4d63-a3ff-42173b6265ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:51.994935 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb32dae-14f0-4d63-a3ff-42173b6265ea admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:51.996183 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb32dae-14f0-4d63-a3ff-42173b6265ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:52.000712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb32dae-14f0-4d63-a3ff-42173b6265ea admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:52.012106 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37beeb1-621d-4441-94af-ee1e67f5d878 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:52.017798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e6791-842a-44a1-aa4c-97244ea7d8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:52.018447 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e6791-842a-44a1-aa4c-97244ea7d8df admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:52.018772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e6791-842a-44a1-aa4c-97244ea7d8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:52.021888 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e6791-842a-44a1-aa4c-97244ea7d8df admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:52.021888 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e6791-842a-44a1-aa4c-97244ea7d8df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:52.022325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e6791-842a-44a1-aa4c-97244ea7d8df admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:52.132931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 788/1584] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:29:51 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:52.133155 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 797/1585] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:29:51 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:52.134567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e6791-842a-44a1-aa4c-97244ea7d8df admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:52.134997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb32dae-14f0-4d63-a3ff-42173b6265ea admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:52.149483 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e6791-842a-44a1-aa4c-97244ea7d8df admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:52.150646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb32dae-14f0-4d63-a3ff-42173b6265ea admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:52.155537 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f3e84-2958-4aa8-8b8d-86e2d0be5189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:52.156244 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f3e84-2958-4aa8-8b8d-86e2d0be5189 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:52.156526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f3e84-2958-4aa8-8b8d-86e2d0be5189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:52.156804 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f3e84-2958-4aa8-8b8d-86e2d0be5189 admin admin] PATH_INFO: `/v3/projects/f0f4fc2c13b049f88634df7b8c0770d1/users/1541fedac9514a2eb65e8da0cc609fd2/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:52.156986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def40415-fb97-4dd1-b08a-3e29b314f04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:52.157692 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def40415-fb97-4dd1-b08a-3e29b314f04d admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:52.158039 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def40415-fb97-4dd1-b08a-3e29b314f04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:52.158391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def40415-fb97-4dd1-b08a-3e29b314f04d admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:52.159774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def40415-fb97-4dd1-b08a-3e29b314f04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:52.163077 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def40415-fb97-4dd1-b08a-3e29b314f04d admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:52.177504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 789/1586] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:52.178455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def40415-fb97-4dd1-b08a-3e29b314f04d admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:52.178890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f3e84-2958-4aa8-8b8d-86e2d0be5189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f4fc2c13b049f88634df7b8c0770d1, user_id=1541fedac9514a2eb65e8da0cc609fd2, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:52.181223 dv-cinder-849143-7-smb devstack@keystone.service[81923]: WARNING py.warnings [None req-cf3f3e84-2958-4aa8-8b8d-86e2d0be5189 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 01:29:52.181223 dv-cinder-849143-7-smb devstack@keystone.service[81923]: warnings.warn(msg) Sep 23 01:29:52.181223 dv-cinder-849143-7-smb devstack@keystone.service[81923]: Sep 23 01:29:52.185623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f3e84-2958-4aa8-8b8d-86e2d0be5189 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:52.193044 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def40415-fb97-4dd1-b08a-3e29b314f04d admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:52.199298 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee0592-bef7-4aef-8d5e-fbb81e6d6622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:52.200235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee0592-bef7-4aef-8d5e-fbb81e6d6622 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:52.204976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee0592-bef7-4aef-8d5e-fbb81e6d6622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:52.204976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee0592-bef7-4aef-8d5e-fbb81e6d6622 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:52.204976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee0592-bef7-4aef-8d5e-fbb81e6d6622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:52.205524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee0592-bef7-4aef-8d5e-fbb81e6d6622 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:52.266107 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 798/1587] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:29:52 2022] PUT /identity/v3/projects/f0f4fc2c13b049f88634df7b8c0770d1/users/1541fedac9514a2eb65e8da0cc609fd2/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:29:52.267476 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f3e84-2958-4aa8-8b8d-86e2d0be5189 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:52.292862 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 790/1588] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:29:52 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:52.296553 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b4d1e-a86b-4bc3-b352-f9a231fe5433 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:52.297497 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b4d1e-a86b-4bc3-b352-f9a231fe5433 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:52.297714 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b4d1e-a86b-4bc3-b352-f9a231fe5433 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:52.300229 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 791/1589] 10.222.0.83 () {54 vars in 961 bytes} [Fri Sep 23 01:29:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:29:52.301982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b4d1e-a86b-4bc3-b352-f9a231fe5433 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:52.358330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f3e84-2958-4aa8-8b8d-86e2d0be5189 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:52.364507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca6a3e-0687-4c3c-a641-0ca69cd8072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:52.365141 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca6a3e-0687-4c3c-a641-0ca69cd8072c admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:52.365428 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca6a3e-0687-4c3c-a641-0ca69cd8072c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:52.365702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca6a3e-0687-4c3c-a641-0ca69cd8072c admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:52.366725 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca6a3e-0687-4c3c-a641-0ca69cd8072c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:52.368715 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca6a3e-0687-4c3c-a641-0ca69cd8072c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:52.413396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b4d1e-a86b-4bc3-b352-f9a231fe5433 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:52.421396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39677679-abde-4401-8e1b-b13216b89759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:52.422122 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39677679-abde-4401-8e1b-b13216b89759 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:52.422480 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39677679-abde-4401-8e1b-b13216b89759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:52.422864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39677679-abde-4401-8e1b-b13216b89759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:52.423574 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39677679-abde-4401-8e1b-b13216b89759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:52.425269 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39677679-abde-4401-8e1b-b13216b89759 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:52.437435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 792/1590] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:52.438416 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39677679-abde-4401-8e1b-b13216b89759 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:52.450211 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39677679-abde-4401-8e1b-b13216b89759 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:52.457005 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da28d1-7b09-4535-aefe-f2ad9653cf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:52.457796 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da28d1-7b09-4535-aefe-f2ad9653cf71 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:52.458246 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da28d1-7b09-4535-aefe-f2ad9653cf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:52.458653 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da28d1-7b09-4535-aefe-f2ad9653cf71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:52.459431 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da28d1-7b09-4535-aefe-f2ad9653cf71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:52.461385 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da28d1-7b09-4535-aefe-f2ad9653cf71 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:52.476024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 793/1591] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:52.477782 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da28d1-7b09-4535-aefe-f2ad9653cf71 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:52.491553 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da28d1-7b09-4535-aefe-f2ad9653cf71 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:52.500426 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1116d-be25-45a4-8678-fba0cfab9c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:52.501438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1116d-be25-45a4-8678-fba0cfab9c3b admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:52.501954 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1116d-be25-45a4-8678-fba0cfab9c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:52.502362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1116d-be25-45a4-8678-fba0cfab9c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:52.503533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1116d-be25-45a4-8678-fba0cfab9c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:52.506677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1116d-be25-45a4-8678-fba0cfab9c3b admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:52.508257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 799/1592] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:29:52 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:52.509584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca6a3e-0687-4c3c-a641-0ca69cd8072c admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:52.523937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 794/1593] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:52.526361 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb048804-8ee3-4861-b113-7cdcaab420c1 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:52.526785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb048804-8ee3-4861-b113-7cdcaab420c1 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:52.527273 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb048804-8ee3-4861-b113-7cdcaab420c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:52.532376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca6a3e-0687-4c3c-a641-0ca69cd8072c admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:52.539331 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c2967-00be-4107-a9d4-ab5c5c794323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:52.539331 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c2967-00be-4107-a9d4-ab5c5c794323 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:52.542334 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c2967-00be-4107-a9d4-ab5c5c794323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:52.542334 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c2967-00be-4107-a9d4-ab5c5c794323 admin admin] PATH_INFO: `/v3/projects/8a77a64019ad4b3399adfa6d00142bad/users/cf1a02c5be0941f88e2fd616ef8fdd4b/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:52.552187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-cb048804-8ee3-4861-b113-7cdcaab420c1 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:52.552805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:52.553479 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-cb048804-8ee3-4861-b113-7cdcaab420c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:52.563352 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 795/1594] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:52.563623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c2967-00be-4107-a9d4-ab5c5c794323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a77a64019ad4b3399adfa6d00142bad, user_id=cf1a02c5be0941f88e2fd616ef8fdd4b, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:52.564267 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb048804-8ee3-4861-b113-7cdcaab420c1 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:52.570133 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c2967-00be-4107-a9d4-ab5c5c794323 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:52.577198 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb048804-8ee3-4861-b113-7cdcaab420c1 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:52.582551 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bd483-8f88-4bd5-97be-01dd9c7bd356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:52.583321 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bd483-8f88-4bd5-97be-01dd9c7bd356 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:52.583479 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bd483-8f88-4bd5-97be-01dd9c7bd356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:52.583757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bd483-8f88-4bd5-97be-01dd9c7bd356 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:52.584414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bd483-8f88-4bd5-97be-01dd9c7bd356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:52.586098 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bd483-8f88-4bd5-97be-01dd9c7bd356 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:52.598070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 796/1595] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:52.599593 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77454a15-68f0-4937-bd9c-53027fe1a343 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:52.600015 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77454a15-68f0-4937-bd9c-53027fe1a343 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:52.600182 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77454a15-68f0-4937-bd9c-53027fe1a343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:52.649455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-77454a15-68f0-4937-bd9c-53027fe1a343 None None] MFA Rules not processed for user `824648d693af4b44ae5df853a3d258f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:52.650933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-77454a15-68f0-4937-bd9c-53027fe1a343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:52.657623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:52.676120 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 800/1596] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:29:52 2022] PUT /identity/v3/projects/8a77a64019ad4b3399adfa6d00142bad/users/cf1a02c5be0941f88e2fd616ef8fdd4b/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:29:52.677472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c2967-00be-4107-a9d4-ab5c5c794323 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:52.762963 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 797/1597] 10.222.0.83 () {58 vars in 1058 bytes} [Fri Sep 23 01:29:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:52.764149 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77454a15-68f0-4937-bd9c-53027fe1a343 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:52.782897 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77454a15-68f0-4937-bd9c-53027fe1a343 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:52.789445 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c2967-00be-4107-a9d4-ab5c5c794323 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:52.789776 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db6431-7207-4117-8201-b6268d3923c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:52.790437 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db6431-7207-4117-8201-b6268d3923c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:52.790879 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db6431-7207-4117-8201-b6268d3923c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:52.791245 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db6431-7207-4117-8201-b6268d3923c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:52.792176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db6431-7207-4117-8201-b6268d3923c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:52.794069 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db6431-7207-4117-8201-b6268d3923c0 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:52.795496 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4f270-561b-4869-bf8b-23fbf89624eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:52.796410 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4f270-561b-4869-bf8b-23fbf89624eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:52.796755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4f270-561b-4869-bf8b-23fbf89624eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:52.797091 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4f270-561b-4869-bf8b-23fbf89624eb admin admin] PATH_INFO: `/v3/projects/c6eb69ff09b040bfb8d93798e76393d6/users/e7bd32cb680e4d9aa9bbaa32c94e68de/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:52.814075 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 798/1598] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:52.814075 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db6431-7207-4117-8201-b6268d3923c0 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:52.821675 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4f270-561b-4869-bf8b-23fbf89624eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6eb69ff09b040bfb8d93798e76393d6, user_id=e7bd32cb680e4d9aa9bbaa32c94e68de, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:52.824172 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db6431-7207-4117-8201-b6268d3923c0 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:52.826321 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4f270-561b-4869-bf8b-23fbf89624eb admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:52.830522 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846f374-d57b-40ed-9ba4-bb95b372249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:52.831244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846f374-d57b-40ed-9ba4-bb95b372249e admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:52.831591 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846f374-d57b-40ed-9ba4-bb95b372249e admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:52.831894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846f374-d57b-40ed-9ba4-bb95b372249e admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:52.832607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846f374-d57b-40ed-9ba4-bb95b372249e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:52.834522 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846f374-d57b-40ed-9ba4-bb95b372249e admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:52.847786 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 799/1599] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:52.848529 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846f374-d57b-40ed-9ba4-bb95b372249e admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:52.859959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846f374-d57b-40ed-9ba4-bb95b372249e admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:52.865322 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ae3ca-adaf-470e-a1e4-3de63817d6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:52.866083 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ae3ca-adaf-470e-a1e4-3de63817d6bf admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:52.866371 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ae3ca-adaf-470e-a1e4-3de63817d6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:52.866676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ae3ca-adaf-470e-a1e4-3de63817d6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:52.867364 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ae3ca-adaf-470e-a1e4-3de63817d6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:52.869548 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ae3ca-adaf-470e-a1e4-3de63817d6bf admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:52.883873 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 800/1600] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:52.884523 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ae3ca-adaf-470e-a1e4-3de63817d6bf admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:52.946203 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 801/1601] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:29:52 2022] PUT /identity/v3/projects/c6eb69ff09b040bfb8d93798e76393d6/users/e7bd32cb680e4d9aa9bbaa32c94e68de/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:29:52.947670 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4f270-561b-4869-bf8b-23fbf89624eb admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:52.964205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ae3ca-adaf-470e-a1e4-3de63817d6bf admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:53.037074 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deea876-2e27-400f-bd4e-aa74751fc106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:53.037933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deea876-2e27-400f-bd4e-aa74751fc106 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:53.038411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deea876-2e27-400f-bd4e-aa74751fc106 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:53.038825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deea876-2e27-400f-bd4e-aa74751fc106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:53.051165 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deea876-2e27-400f-bd4e-aa74751fc106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:53.052507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4f270-561b-4869-bf8b-23fbf89624eb admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:53.053002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deea876-2e27-400f-bd4e-aa74751fc106 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:53.061172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61340497-448a-431b-b1a7-3b733999aec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:53.062901 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61340497-448a-431b-b1a7-3b733999aec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:53.063378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61340497-448a-431b-b1a7-3b733999aec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:53.063827 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61340497-448a-431b-b1a7-3b733999aec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:53.065028 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61340497-448a-431b-b1a7-3b733999aec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:53.068073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61340497-448a-431b-b1a7-3b733999aec2 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:53.069355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 801/1602] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:29:53.071510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7540580-5e15-4ea1-b393-768af0c5acde None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:53.071974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7540580-5e15-4ea1-b393-768af0c5acde None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:53.072474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7540580-5e15-4ea1-b393-768af0c5acde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:53.088935 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 802/1603] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:53.091320 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61340497-448a-431b-b1a7-3b733999aec2 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:53.122631 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-b7540580-5e15-4ea1-b393-768af0c5acde None None] MFA Rules not processed for user `cf1a02c5be0941f88e2fd616ef8fdd4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:53.124775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b7540580-5e15-4ea1-b393-768af0c5acde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:53.154411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:53.203011 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:53.209498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61340497-448a-431b-b1a7-3b733999aec2 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:53.219300 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6873f-5efd-4dd4-b1a1-1333508eab11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:53.220118 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6873f-5efd-4dd4-b1a1-1333508eab11 service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:53.232015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6873f-5efd-4dd4-b1a1-1333508eab11 service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:53.232015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6873f-5efd-4dd4-b1a1-1333508eab11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:53.257787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 802/1604] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:53.258767 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7540580-5e15-4ea1-b393-768af0c5acde None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:53.277348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7540580-5e15-4ea1-b393-768af0c5acde None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:53.286454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25118b1-bc5c-411e-ae62-381d27796491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:53.288422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25118b1-bc5c-411e-ae62-381d27796491 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:53.288422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25118b1-bc5c-411e-ae62-381d27796491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:53.288422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25118b1-bc5c-411e-ae62-381d27796491 admin admin] PATH_INFO: `/v3/projects/9f40545606fe496bb405e5c0426563d1/users/2ab70dd69a8e4ac9b7f1f343b6b3eea0/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:53.316830 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25118b1-bc5c-411e-ae62-381d27796491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f40545606fe496bb405e5c0426563d1, user_id=2ab70dd69a8e4ac9b7f1f343b6b3eea0, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:53.321985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25118b1-bc5c-411e-ae62-381d27796491 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:53.339428 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6873f-5efd-4dd4-b1a1-1333508eab11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:53.342566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6873f-5efd-4dd4-b1a1-1333508eab11 service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:53.357224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 803/1605] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:29:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:29:53.358137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6873f-5efd-4dd4-b1a1-1333508eab11 service nova] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:53.370188 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6873f-5efd-4dd4-b1a1-1333508eab11 service nova] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:53.375620 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbb51d-e2b8-49e2-8a2a-383cc25402f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:53.377280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbb51d-e2b8-49e2-8a2a-383cc25402f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:53.377280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbb51d-e2b8-49e2-8a2a-383cc25402f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:53.377280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbb51d-e2b8-49e2-8a2a-383cc25402f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:53.377798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbb51d-e2b8-49e2-8a2a-383cc25402f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:53.379783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbb51d-e2b8-49e2-8a2a-383cc25402f6 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:53.394056 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 804/1606] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:53.395698 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbb51d-e2b8-49e2-8a2a-383cc25402f6 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:53.415556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbb51d-e2b8-49e2-8a2a-383cc25402f6 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:53.424456 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575a067-b202-496a-97f0-6c5f72725a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:53.425822 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575a067-b202-496a-97f0-6c5f72725a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:53.426273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575a067-b202-496a-97f0-6c5f72725a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:53.426806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575a067-b202-496a-97f0-6c5f72725a40 admin admin] PATH_INFO: `/v3/projects/e935769c8b844d9f9af50e8e39e8f318/users/ecdc95ca148f497595ba32bccaa2b359/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:53.442728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 803/1607] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:29:53 2022] PUT /identity/v3/projects/9f40545606fe496bb405e5c0426563d1/users/2ab70dd69a8e4ac9b7f1f343b6b3eea0/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:29:53.445752 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb631bec-5a1a-4cac-9462-14682fc2d03c None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:53.446476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb631bec-5a1a-4cac-9462-14682fc2d03c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:53.447012 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb631bec-5a1a-4cac-9462-14682fc2d03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:53.466746 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575a067-b202-496a-97f0-6c5f72725a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e935769c8b844d9f9af50e8e39e8f318, user_id=ecdc95ca148f497595ba32bccaa2b359, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:53.470826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575a067-b202-496a-97f0-6c5f72725a40 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:53.497245 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-fb631bec-5a1a-4cac-9462-14682fc2d03c None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:53.500284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-fb631bec-5a1a-4cac-9462-14682fc2d03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:53.585471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 805/1608] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:29:53 2022] PUT /identity/v3/projects/e935769c8b844d9f9af50e8e39e8f318/users/ecdc95ca148f497595ba32bccaa2b359/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:29:53.585471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575a067-b202-496a-97f0-6c5f72725a40 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:53.672995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 804/1609] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:53.674215 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb631bec-5a1a-4cac-9462-14682fc2d03c None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:53.692477 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb631bec-5a1a-4cac-9462-14682fc2d03c None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:53.739886 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575a067-b202-496a-97f0-6c5f72725a40 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:53.746111 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac5011-d7dd-4ca4-ab82-f65d8c4446cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:53.746845 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac5011-d7dd-4ca4-ab82-f65d8c4446cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:53.747713 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac5011-d7dd-4ca4-ab82-f65d8c4446cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:53.747713 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac5011-d7dd-4ca4-ab82-f65d8c4446cf admin admin] PATH_INFO: `/v3/projects/6023955c03b4428e8c2bceccd706da12/users/ca2a9d6e977f4ac7abd8745d092a9472/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:53.769288 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac5011-d7dd-4ca4-ab82-f65d8c4446cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6023955c03b4428e8c2bceccd706da12, user_id=ca2a9d6e977f4ac7abd8745d092a9472, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:53.772343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac5011-d7dd-4ca4-ab82-f65d8c4446cf admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:53.795259 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d7a85-a869-4d8e-8b3a-c4bf886ee504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:53.796161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d7a85-a869-4d8e-8b3a-c4bf886ee504 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:53.797391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d7a85-a869-4d8e-8b3a-c4bf886ee504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:53.797891 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d7a85-a869-4d8e-8b3a-c4bf886ee504 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:53.798796 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d7a85-a869-4d8e-8b3a-c4bf886ee504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:53.801077 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d7a85-a869-4d8e-8b3a-c4bf886ee504 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:53.922416 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 806/1610] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:29:53 2022] PUT /identity/v3/projects/6023955c03b4428e8c2bceccd706da12/users/ca2a9d6e977f4ac7abd8745d092a9472/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:29:53.923710 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac5011-d7dd-4ca4-ab82-f65d8c4446cf admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:54.016880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 805/1611] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:29:53 2022] POST /identity/v3/projects => generated 371 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:54.016880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d5b55-9d4c-4cfd-895f-953fd52e0291 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:54.016880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d5b55-9d4c-4cfd-895f-953fd52e0291 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:54.016880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d5b55-9d4c-4cfd-895f-953fd52e0291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:54.026111 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:54.049928 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac5011-d7dd-4ca4-ab82-f65d8c4446cf admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:54.065738 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-e24d5b55-9d4c-4cfd-895f-953fd52e0291 None None] MFA Rules not processed for user `2ab70dd69a8e4ac9b7f1f343b6b3eea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:54.067178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-e24d5b55-9d4c-4cfd-895f-953fd52e0291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:54.081061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:54.177191 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e8706-aad8-4c0e-ae5e-3072e3803d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:54.178612 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e8706-aad8-4c0e-ae5e-3072e3803d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:54.179443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e8706-aad8-4c0e-ae5e-3072e3803d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:54.179979 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e8706-aad8-4c0e-ae5e-3072e3803d64 admin admin] PATH_INFO: `/v3/projects/ec922942147b4c0bb122eb30c6cd1bc7/users/67b89827871f45738162611b31a23509/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:54.204544 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 806/1612] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:54.206998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879f1bc-1f05-45af-8811-c7653b8cad4e None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:54.207460 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879f1bc-1f05-45af-8811-c7653b8cad4e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:54.207948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879f1bc-1f05-45af-8811-c7653b8cad4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:54.213127 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e8706-aad8-4c0e-ae5e-3072e3803d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec922942147b4c0bb122eb30c6cd1bc7, user_id=67b89827871f45738162611b31a23509, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:54.218880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e8706-aad8-4c0e-ae5e-3072e3803d64 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:54.262730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-d879f1bc-1f05-45af-8811-c7653b8cad4e None None] MFA Rules not processed for user `ecdc95ca148f497595ba32bccaa2b359`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:54.264972 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d879f1bc-1f05-45af-8811-c7653b8cad4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:54.335691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 807/1613] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:29:53 2022] PUT /identity/v3/projects/ec922942147b4c0bb122eb30c6cd1bc7/users/67b89827871f45738162611b31a23509/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:29:54.336860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e8706-aad8-4c0e-ae5e-3072e3803d64 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:54.364708 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 807/1614] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:54.366173 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4984d-fb9b-4b04-a682-6bcafe06d8ad None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:54.366498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4984d-fb9b-4b04-a682-6bcafe06d8ad None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:54.366856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4984d-fb9b-4b04-a682-6bcafe06d8ad None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:54.375109 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 808/1615] 10.222.0.83 () {54 vars in 912 bytes} [Fri Sep 23 01:29:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:29:54.378270 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b755eaa-76e8-4183-9192-4d00f33b8605 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:54.378270 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b755eaa-76e8-4183-9192-4d00f33b8605 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:54.378562 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b755eaa-76e8-4183-9192-4d00f33b8605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:54.666272 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-4b755eaa-76e8-4183-9192-4d00f33b8605 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:54.666272 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-4b755eaa-76e8-4183-9192-4d00f33b8605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:54.666493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e8706-aad8-4c0e-ae5e-3072e3803d64 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:54.666493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29dc73-7197-4b92-87ba-25b374f2d4f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:54.666493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29dc73-7197-4b92-87ba-25b374f2d4f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:54.666493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29dc73-7197-4b92-87ba-25b374f2d4f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:54.666969 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29dc73-7197-4b92-87ba-25b374f2d4f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:54.667097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 809/1616] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:54.667097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b755eaa-76e8-4183-9192-4d00f33b8605 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:54.667097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b755eaa-76e8-4183-9192-4d00f33b8605 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:54.667097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4c9ad-8564-45aa-8492-3a90790cd432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:54.667763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4c9ad-8564-45aa-8492-3a90790cd432 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:54.667763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4c9ad-8564-45aa-8492-3a90790cd432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:54.667763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4c9ad-8564-45aa-8492-3a90790cd432 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:54.667763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4c9ad-8564-45aa-8492-3a90790cd432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:54.667763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4c9ad-8564-45aa-8492-3a90790cd432 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:54.668423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29dc73-7197-4b92-87ba-25b374f2d4f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:54.668423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29dc73-7197-4b92-87ba-25b374f2d4f6 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:54.668423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 808/1617] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:29:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:29:54.668423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29dc73-7197-4b92-87ba-25b374f2d4f6 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:54.668423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29dc73-7197-4b92-87ba-25b374f2d4f6 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:54.668994 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36987af-1e59-470e-9b03-9b8b2a5a7ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:54.668994 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36987af-1e59-470e-9b03-9b8b2a5a7ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:54.668994 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36987af-1e59-470e-9b03-9b8b2a5a7ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:54.668994 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36987af-1e59-470e-9b03-9b8b2a5a7ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:54.669429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36987af-1e59-470e-9b03-9b8b2a5a7ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:54.669429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36987af-1e59-470e-9b03-9b8b2a5a7ed3 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:54.669697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 810/1618] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:29:54 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:54.669697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfa895-05f4-4eb3-9a61-8e2b813ed039 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:54.669697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfa895-05f4-4eb3-9a61-8e2b813ed039 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:54.669697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfa895-05f4-4eb3-9a61-8e2b813ed039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:54.690060 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-59dfa895-05f4-4eb3-9a61-8e2b813ed039 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:54.691652 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-59dfa895-05f4-4eb3-9a61-8e2b813ed039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:54.701675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 811/1619] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:54.703011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfa895-05f4-4eb3-9a61-8e2b813ed039 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:54.717568 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfa895-05f4-4eb3-9a61-8e2b813ed039 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:54.724110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca25462-d07c-4369-8a02-d4dddf84d81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:54.724921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca25462-d07c-4369-8a02-d4dddf84d81a admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:54.725287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca25462-d07c-4369-8a02-d4dddf84d81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:54.762912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca25462-d07c-4369-8a02-d4dddf84d81a admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:54.762912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca25462-d07c-4369-8a02-d4dddf84d81a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:54.762912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca25462-d07c-4369-8a02-d4dddf84d81a admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:54.762912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:54.859968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 809/1620] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:29:54 2022] POST /identity/v3/projects => generated 383 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:54.861552 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ed01c-fc88-4bd7-8419-313647b1a991 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:54.861895 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ed01c-fc88-4bd7-8419-313647b1a991 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:54.862130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ed01c-fc88-4bd7-8419-313647b1a991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:54.886294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-194ed01c-fc88-4bd7-8419-313647b1a991 None None] MFA Rules not processed for user `824648d693af4b44ae5df853a3d258f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:54.887552 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-194ed01c-fc88-4bd7-8419-313647b1a991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:54.893422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:54.921379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 812/1621] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:29:54 2022] POST /identity/v3/projects => generated 381 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:54.921379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca25462-d07c-4369-8a02-d4dddf84d81a admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:55.023482 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 810/1622] 10.222.0.83 () {58 vars in 1009 bytes} [Fri Sep 23 01:29:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:55.024711 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ed01c-fc88-4bd7-8419-313647b1a991 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:55.025488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca25462-d07c-4369-8a02-d4dddf84d81a admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:55.033611 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f1fc6-21ba-4673-9060-517adf5fbb6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:55.034616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f1fc6-21ba-4673-9060-517adf5fbb6f service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:55.035142 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f1fc6-21ba-4673-9060-517adf5fbb6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:55.035539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f1fc6-21ba-4673-9060-517adf5fbb6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:55.137509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f1fc6-21ba-4673-9060-517adf5fbb6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:55.139699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ed01c-fc88-4bd7-8419-313647b1a991 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:55.140496 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f1fc6-21ba-4673-9060-517adf5fbb6f service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:55.146236 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729f4bd-a79d-4db8-951e-2d4f0cf86127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:55.146970 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729f4bd-a79d-4db8-951e-2d4f0cf86127 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:55.147275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729f4bd-a79d-4db8-951e-2d4f0cf86127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:55.147674 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729f4bd-a79d-4db8-951e-2d4f0cf86127 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:55.152606 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729f4bd-a79d-4db8-951e-2d4f0cf86127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:55.152606 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729f4bd-a79d-4db8-951e-2d4f0cf86127 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:55.162410 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 813/1623] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:29:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:29:55.164187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f1fc6-21ba-4673-9060-517adf5fbb6f service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:55.170966 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 811/1624] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:55.172643 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729f4bd-a79d-4db8-951e-2d4f0cf86127 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:55.181995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f1fc6-21ba-4673-9060-517adf5fbb6f service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:55.185786 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729f4bd-a79d-4db8-951e-2d4f0cf86127 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:55.189120 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecb60d-2c03-4d5c-ba24-6abfd8a4a51a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:55.190365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecb60d-2c03-4d5c-ba24-6abfd8a4a51a service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:55.190914 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecb60d-2c03-4d5c-ba24-6abfd8a4a51a service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:55.191565 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecb60d-2c03-4d5c-ba24-6abfd8a4a51a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:55.193956 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25eda6-0166-4050-90fa-49344eef4f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:55.194979 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25eda6-0166-4050-90fa-49344eef4f9a admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:55.195598 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25eda6-0166-4050-90fa-49344eef4f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:55.198527 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25eda6-0166-4050-90fa-49344eef4f9a admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:55.198527 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25eda6-0166-4050-90fa-49344eef4f9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:55.201661 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25eda6-0166-4050-90fa-49344eef4f9a admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:55.216293 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ecb60d-2c03-4d5c-ba24-6abfd8a4a51a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:55.220688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ecb60d-2c03-4d5c-ba24-6abfd8a4a51a service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:55.242678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 814/1625] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:29:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:29:55.244780 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecb60d-2c03-4d5c-ba24-6abfd8a4a51a service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:55.267020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecb60d-2c03-4d5c-ba24-6abfd8a4a51a service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:55.275979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80096d32-97d9-441c-91bb-66c8c0ced00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:55.277676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80096d32-97d9-441c-91bb-66c8c0ced00c admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:55.277676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80096d32-97d9-441c-91bb-66c8c0ced00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:55.278442 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80096d32-97d9-441c-91bb-66c8c0ced00c admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:55.279760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80096d32-97d9-441c-91bb-66c8c0ced00c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:55.284692 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80096d32-97d9-441c-91bb-66c8c0ced00c admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:55.333270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 812/1626] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:29:55 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:55.335405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25eda6-0166-4050-90fa-49344eef4f9a admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:55.439354 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 815/1627] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:29:55 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:29:55.442683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80096d32-97d9-441c-91bb-66c8c0ced00c admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:55.470890 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80096d32-97d9-441c-91bb-66c8c0ced00c admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:55.471361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25eda6-0166-4050-90fa-49344eef4f9a admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:55.480438 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e91e76-2f2c-4921-a1cc-210e5e6150be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:55.481124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e91e76-2f2c-4921-a1cc-210e5e6150be service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:55.481619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e91e76-2f2c-4921-a1cc-210e5e6150be service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:55.482691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e91e76-2f2c-4921-a1cc-210e5e6150be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:55.485322 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4907e-09d0-4090-a8d4-ab66d6cdf2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:55.486362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4907e-09d0-4090-a8d4-ab66d6cdf2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:55.486854 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4907e-09d0-4090-a8d4-ab66d6cdf2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:55.487267 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4907e-09d0-4090-a8d4-ab66d6cdf2d6 admin admin] PATH_INFO: `/v3/projects/9779467a7e34485e8dc5a85c1c9054a5/users/f098dc6eb2fb436ea0d0c8a2e670f88c/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:55.524027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4907e-09d0-4090-a8d4-ab66d6cdf2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9779467a7e34485e8dc5a85c1c9054a5, user_id=f098dc6eb2fb436ea0d0c8a2e670f88c, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:55.529599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4907e-09d0-4090-a8d4-ab66d6cdf2d6 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:55.583456 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:55.659752 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 816/1628] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:29:55 2022] PUT /identity/v3/projects/9779467a7e34485e8dc5a85c1c9054a5/users/f098dc6eb2fb436ea0d0c8a2e670f88c/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:29:55.661292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4907e-09d0-4090-a8d4-ab66d6cdf2d6 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:55.705612 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e91e76-2f2c-4921-a1cc-210e5e6150be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:55.708384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e91e76-2f2c-4921-a1cc-210e5e6150be service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:55.731106 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 813/1629] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:29:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:29:55.732125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e91e76-2f2c-4921-a1cc-210e5e6150be service cinder] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:55.745893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e91e76-2f2c-4921-a1cc-210e5e6150be service cinder] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:55.803108 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:55.822842 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4907e-09d0-4090-a8d4-ab66d6cdf2d6 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:55.830554 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d184d-2fc4-4cae-951f-aaff6e5604b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:55.831242 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d184d-2fc4-4cae-951f-aaff6e5604b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:55.831500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d184d-2fc4-4cae-951f-aaff6e5604b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:55.831771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d184d-2fc4-4cae-951f-aaff6e5604b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:55.832444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d184d-2fc4-4cae-951f-aaff6e5604b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:55.836082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d184d-2fc4-4cae-951f-aaff6e5604b9 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:55.844346 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f4a37-88ca-4618-9bf2-41abe211a8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:55.847567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f4a37-88ca-4618-9bf2-41abe211a8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:55.847955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f4a37-88ca-4618-9bf2-41abe211a8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:55.850974 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f4a37-88ca-4618-9bf2-41abe211a8d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:55.855493 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 817/1630] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:55.856481 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d184d-2fc4-4cae-951f-aaff6e5604b9 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:55.860786 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f4a37-88ca-4618-9bf2-41abe211a8d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:55.868092 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d184d-2fc4-4cae-951f-aaff6e5604b9 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:55.868332 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f4a37-88ca-4618-9bf2-41abe211a8d4 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:55.875985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f932c-3ea2-4a37-97fd-56cac86fca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:55.876673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f932c-3ea2-4a37-97fd-56cac86fca0b admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:55.876962 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f932c-3ea2-4a37-97fd-56cac86fca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:55.877985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f932c-3ea2-4a37-97fd-56cac86fca0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:55.878099 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f932c-3ea2-4a37-97fd-56cac86fca0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:55.880492 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f932c-3ea2-4a37-97fd-56cac86fca0b admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:55.899517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 818/1631] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:55.900605 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f932c-3ea2-4a37-97fd-56cac86fca0b admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:55.917420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 814/1632] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:55.922323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f4a37-88ca-4618-9bf2-41abe211a8d4 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:55.928397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f932c-3ea2-4a37-97fd-56cac86fca0b admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:55.935468 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661221a-2af5-4f21-a5a1-a69d2bfaf3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:55.936298 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661221a-2af5-4f21-a5a1-a69d2bfaf3b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:55.937354 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661221a-2af5-4f21-a5a1-a69d2bfaf3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:55.937706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661221a-2af5-4f21-a5a1-a69d2bfaf3b2 admin admin] PATH_INFO: `/v3/projects/1143c7ff3b334e45a34b1c2d689ebff3/users/65b42856393c4bd0a747615710e05822/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:55.958464 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f4a37-88ca-4618-9bf2-41abe211a8d4 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:55.976983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661221a-2af5-4f21-a5a1-a69d2bfaf3b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1143c7ff3b334e45a34b1c2d689ebff3, user_id=65b42856393c4bd0a747615710e05822, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:55.979081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6ca5e-91e8-4b14-a343-dc1e0cf5ee9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:55.980991 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6ca5e-91e8-4b14-a343-dc1e0cf5ee9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:55.981472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6ca5e-91e8-4b14-a343-dc1e0cf5ee9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:55.982961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6ca5e-91e8-4b14-a343-dc1e0cf5ee9a admin admin] PATH_INFO: `/v3/projects/9779467a7e34485e8dc5a85c1c9054a5/users/f098dc6eb2fb436ea0d0c8a2e670f88c/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:55.984650 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661221a-2af5-4f21-a5a1-a69d2bfaf3b2 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:55.989129 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6ca5e-91e8-4b14-a343-dc1e0cf5ee9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9779467a7e34485e8dc5a85c1c9054a5, user_id=f098dc6eb2fb436ea0d0c8a2e670f88c, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:55.995089 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6ca5e-91e8-4b14-a343-dc1e0cf5ee9a admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:56.032872 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 815/1633] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:29:55 2022] PUT /identity/v3/projects/9779467a7e34485e8dc5a85c1c9054a5/users/f098dc6eb2fb436ea0d0c8a2e670f88c/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:29:56.032872 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6ca5e-91e8-4b14-a343-dc1e0cf5ee9a admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:56.130864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 819/1634] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:29:55 2022] PUT /identity/v3/projects/1143c7ff3b334e45a34b1c2d689ebff3/users/65b42856393c4bd0a747615710e05822/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:29:56.131747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74591e28-c948-4714-bf2f-eab2e99e6b1c None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:56.133055 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74591e28-c948-4714-bf2f-eab2e99e6b1c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:56.133349 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74591e28-c948-4714-bf2f-eab2e99e6b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:56.220849 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6ca5e-91e8-4b14-a343-dc1e0cf5ee9a admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:56.247191 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-74591e28-c948-4714-bf2f-eab2e99e6b1c None None] MFA Rules not processed for user `f098dc6eb2fb436ea0d0c8a2e670f88c`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:56.248602 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-74591e28-c948-4714-bf2f-eab2e99e6b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:56.389661 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:56.421998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3c01b-42d0-48f0-8306-9e6158dedaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:56.424215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3c01b-42d0-48f0-8306-9e6158dedaf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:56.432082 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3c01b-42d0-48f0-8306-9e6158dedaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:56.432764 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3c01b-42d0-48f0-8306-9e6158dedaf6 admin admin] PATH_INFO: `/v3/projects/3338e3a1145444b48b3c81ce59a65878/users/5b501cbbf73b4a31bc15bbc71e171c99/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:56.437311 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 820/1635] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:56.439291 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74591e28-c948-4714-bf2f-eab2e99e6b1c None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:56.485605 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74591e28-c948-4714-bf2f-eab2e99e6b1c None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:56.495454 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3c01b-42d0-48f0-8306-9e6158dedaf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3338e3a1145444b48b3c81ce59a65878, user_id=5b501cbbf73b4a31bc15bbc71e171c99, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:56.503183 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3c01b-42d0-48f0-8306-9e6158dedaf6 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:56.505288 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e07dc1-d7c3-4975-a8c8-b6855db86906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:56.506845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e07dc1-d7c3-4975-a8c8-b6855db86906 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:56.506976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e07dc1-d7c3-4975-a8c8-b6855db86906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:56.507703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e07dc1-d7c3-4975-a8c8-b6855db86906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:56.508638 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e07dc1-d7c3-4975-a8c8-b6855db86906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:56.521420 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e07dc1-d7c3-4975-a8c8-b6855db86906 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:56.547636 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 821/1636] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:56.549932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e07dc1-d7c3-4975-a8c8-b6855db86906 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:56.613380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 816/1637] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:29:56 2022] PUT /identity/v3/projects/3338e3a1145444b48b3c81ce59a65878/users/5b501cbbf73b4a31bc15bbc71e171c99/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:29:56.614561 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3c01b-42d0-48f0-8306-9e6158dedaf6 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:56.680342 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e07dc1-d7c3-4975-a8c8-b6855db86906 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:56.781195 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:56.783760 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3c01b-42d0-48f0-8306-9e6158dedaf6 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:56.794240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109b5a0-7825-404e-98cf-1d4da3553d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:56.797093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109b5a0-7825-404e-98cf-1d4da3553d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:56.797093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109b5a0-7825-404e-98cf-1d4da3553d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:56.797093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109b5a0-7825-404e-98cf-1d4da3553d48 admin admin] PATH_INFO: `/v3/projects/1143c7ff3b334e45a34b1c2d689ebff3/users/65b42856393c4bd0a747615710e05822/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:56.800968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109b5a0-7825-404e-98cf-1d4da3553d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1143c7ff3b334e45a34b1c2d689ebff3, user_id=65b42856393c4bd0a747615710e05822, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:56.803475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109b5a0-7825-404e-98cf-1d4da3553d48 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:56.820528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 817/1638] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:29:56 2022] PUT /identity/v3/projects/1143c7ff3b334e45a34b1c2d689ebff3/users/65b42856393c4bd0a747615710e05822/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:29:56.821983 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109b5a0-7825-404e-98cf-1d4da3553d48 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:56.822473 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e53fcc-1074-473c-b0ff-b4d00a635518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:56.825430 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e53fcc-1074-473c-b0ff-b4d00a635518 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:56.825937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e53fcc-1074-473c-b0ff-b4d00a635518 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:56.830268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e53fcc-1074-473c-b0ff-b4d00a635518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:56.963645 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109b5a0-7825-404e-98cf-1d4da3553d48 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:56.991178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a7318-424b-455f-a197-7e2a8a0eb421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:56.993372 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a7318-424b-455f-a197-7e2a8a0eb421 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:56.994262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a7318-424b-455f-a197-7e2a8a0eb421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:56.995198 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a7318-424b-455f-a197-7e2a8a0eb421 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:56.996677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a7318-424b-455f-a197-7e2a8a0eb421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:57.002761 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a7318-424b-455f-a197-7e2a8a0eb421 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:57.012498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e53fcc-1074-473c-b0ff-b4d00a635518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:57.014225 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e53fcc-1074-473c-b0ff-b4d00a635518 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:57.061286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 818/1639] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:29:57.066676 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822fc93-75c7-4550-ac4d-6f18f09901f0 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:57.067336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822fc93-75c7-4550-ac4d-6f18f09901f0 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:57.068071 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822fc93-75c7-4550-ac4d-6f18f09901f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:57.075457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 822/1640] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:29:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:29:57.076620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e53fcc-1074-473c-b0ff-b4d00a635518 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:57.116046 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e53fcc-1074-473c-b0ff-b4d00a635518 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:57.127009 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-4822fc93-75c7-4550-ac4d-6f18f09901f0 None None] MFA Rules not processed for user `65b42856393c4bd0a747615710e05822`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:57.131018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4822fc93-75c7-4550-ac4d-6f18f09901f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:57.134972 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad479a4-b17e-4320-8384-6273d5921242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:57.139285 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad479a4-b17e-4320-8384-6273d5921242 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:57.139606 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad479a4-b17e-4320-8384-6273d5921242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:57.139922 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad479a4-b17e-4320-8384-6273d5921242 admin admin] PATH_INFO: `/v3/projects/3338e3a1145444b48b3c81ce59a65878/users/5b501cbbf73b4a31bc15bbc71e171c99/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:57.149668 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad479a4-b17e-4320-8384-6273d5921242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3338e3a1145444b48b3c81ce59a65878, user_id=5b501cbbf73b4a31bc15bbc71e171c99, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:57.157153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad479a4-b17e-4320-8384-6273d5921242 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:57.188537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 823/1641] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:29:57 2022] PUT /identity/v3/projects/3338e3a1145444b48b3c81ce59a65878/users/5b501cbbf73b4a31bc15bbc71e171c99/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:29:57.216831 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead56649-e1bb-4d49-b6b5-1b179a8b76d7 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:57.217655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead56649-e1bb-4d49-b6b5-1b179a8b76d7 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:57.217655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead56649-e1bb-4d49-b6b5-1b179a8b76d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:57.330419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 819/1642] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:29:57.330674 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-ead56649-e1bb-4d49-b6b5-1b179a8b76d7 None None] MFA Rules not processed for user `5b501cbbf73b4a31bc15bbc71e171c99`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:57.330674 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ead56649-e1bb-4d49-b6b5-1b179a8b76d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:57.521634 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822fc93-75c7-4550-ac4d-6f18f09901f0 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:57.524237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 824/1643] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:29:57.667391 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:57.678171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822fc93-75c7-4550-ac4d-6f18f09901f0 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:57.748010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead56649-e1bb-4d49-b6b5-1b179a8b76d7 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:57.847435 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103938e-435c-44a0-b294-b582b7cb86e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:57.848085 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103938e-435c-44a0-b294-b582b7cb86e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:57.848366 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103938e-435c-44a0-b294-b582b7cb86e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:57.848646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103938e-435c-44a0-b294-b582b7cb86e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:57.881982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead56649-e1bb-4d49-b6b5-1b179a8b76d7 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:57.901906 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1b10d-d979-4133-9ae4-5415efe38351 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:57.916723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1b10d-d979-4133-9ae4-5415efe38351 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:57.917090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1b10d-d979-4133-9ae4-5415efe38351 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:57.917371 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1b10d-d979-4133-9ae4-5415efe38351 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:57.957842 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103938e-435c-44a0-b294-b582b7cb86e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:57.959976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103938e-435c-44a0-b294-b582b7cb86e2 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:57.993227 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 820/1644] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:29:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:29:58.055500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:58.089752 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1b10d-d979-4133-9ae4-5415efe38351 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:58.092465 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1b10d-d979-4133-9ae4-5415efe38351 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:58.112936 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 825/1645] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:29:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:29:58.170439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103938e-435c-44a0-b294-b582b7cb86e2 service cinder] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:58.181197 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103938e-435c-44a0-b294-b582b7cb86e2 service cinder] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:58.190127 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cb20c-50cc-49b6-84fe-5aff83e49d81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:58.190962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cb20c-50cc-49b6-84fe-5aff83e49d81 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:58.191349 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cb20c-50cc-49b6-84fe-5aff83e49d81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:58.191815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cb20c-50cc-49b6-84fe-5aff83e49d81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:58.213373 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cb20c-50cc-49b6-84fe-5aff83e49d81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:58.215166 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cb20c-50cc-49b6-84fe-5aff83e49d81 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:58.229202 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 821/1646] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:29:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:29:58.725483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1b10d-d979-4133-9ae4-5415efe38351 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:58.914761 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1b10d-d979-4133-9ae4-5415efe38351 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:58.934670 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5d5f5-e6bc-4367-8d7f-03ea16a63a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:58.937534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5d5f5-e6bc-4367-8d7f-03ea16a63a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:58.937534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5d5f5-e6bc-4367-8d7f-03ea16a63a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:58.937819 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5d5f5-e6bc-4367-8d7f-03ea16a63a78 admin admin] PATH_INFO: `/v3/users/2ab70dd69a8e4ac9b7f1f343b6b3eea0` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:58.945007 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5d5f5-e6bc-4367-8d7f-03ea16a63a78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ab70dd69a8e4ac9b7f1f343b6b3eea0)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:58.947456 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5d5f5-e6bc-4367-8d7f-03ea16a63a78 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:59.001133 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cb20c-50cc-49b6-84fe-5aff83e49d81 service cinder] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:59.034789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cb20c-50cc-49b6-84fe-5aff83e49d81 service cinder] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:59.070060 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912b8dc-fca6-4267-8271-f997fe1bb053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:59.072592 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912b8dc-fca6-4267-8271-f997fe1bb053 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:59.073684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912b8dc-fca6-4267-8271-f997fe1bb053 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:59.074398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912b8dc-fca6-4267-8271-f997fe1bb053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:59.205525 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:59.256729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912b8dc-fca6-4267-8271-f997fe1bb053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:59.264726 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912b8dc-fca6-4267-8271-f997fe1bb053 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:59.299686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-21b5d5f5-e6bc-4367-8d7f-03ea16a63a78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ab70dd69a8e4ac9b7f1f343b6b3eea0'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:29:59.302467 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 822/1647] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:29:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:29:59.411075 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b8134-bdd8-4782-b566-2654bd1cd0ce None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:59.411958 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b8134-bdd8-4782-b566-2654bd1cd0ce None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:59.412520 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b8134-bdd8-4782-b566-2654bd1cd0ce None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:59.416691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 823/1648] 10.222.0.83 () {54 vars in 961 bytes} [Fri Sep 23 01:29:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:29:59.432455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6119fb-5eec-4077-873b-1c5ff507ddd9 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:59.432999 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6119fb-5eec-4077-873b-1c5ff507ddd9 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:59.433374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-21b5d5f5-e6bc-4367-8d7f-03ea16a63a78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ab70dd69a8e4ac9b7f1f343b6b3eea0'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:29:59.433526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6119fb-5eec-4077-873b-1c5ff507ddd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:59.434728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-21b5d5f5-e6bc-4367-8d7f-03ea16a63a78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ab70dd69a8e4ac9b7f1f343b6b3eea0'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:29:59.455833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-21b5d5f5-e6bc-4367-8d7f-03ea16a63a78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ab70dd69a8e4ac9b7f1f343b6b3eea0'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:29:59.456957 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-21b5d5f5-e6bc-4367-8d7f-03ea16a63a78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ab70dd69a8e4ac9b7f1f343b6b3eea0'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:29:59.478893 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-bb6119fb-5eec-4077-873b-1c5ff507ddd9 None None] MFA Rules not processed for user `824648d693af4b44ae5df853a3d258f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:59.481905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-bb6119fb-5eec-4077-873b-1c5ff507ddd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:59.507761 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 826/1649] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:29:58 2022] DELETE /identity/v3/users/2ab70dd69a8e4ac9b7f1f343b6b3eea0 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:29:59.513723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919f0fc-8d5d-4f14-a537-5efe19bb3cd8 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:59.514266 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919f0fc-8d5d-4f14-a537-5efe19bb3cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:59.514540 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919f0fc-8d5d-4f14-a537-5efe19bb3cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:59.562549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-0919f0fc-8d5d-4f14-a537-5efe19bb3cd8 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:59.565317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-0919f0fc-8d5d-4f14-a537-5efe19bb3cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:59.650248 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 824/1650] 10.222.0.83 () {58 vars in 1058 bytes} [Fri Sep 23 01:29:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:29:59.652515 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1613b-4e9c-4bfb-a96e-520bb7561725 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:59.652736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1613b-4e9c-4bfb-a96e-520bb7561725 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:59.652972 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1613b-4e9c-4bfb-a96e-520bb7561725 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:59.665628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:59.669299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 825/1651] 10.222.0.83 () {54 vars in 912 bytes} [Fri Sep 23 01:29:59 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:29:59.677032 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2a99e-6219-4964-8634-5039ca84754a None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:59.677527 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2a99e-6219-4964-8634-5039ca84754a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:59.678005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2a99e-6219-4964-8634-5039ca84754a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:59.728811 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 827/1652] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:29:59.755739 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919f0fc-8d5d-4f14-a537-5efe19bb3cd8 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:29:59.758297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-0919f0fc-8d5d-4f14-a537-5efe19bb3cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:59.759713 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-53f2a99e-6219-4964-8634-5039ca84754a None None] MFA Rules not processed for user `824648d693af4b44ae5df853a3d258f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:29:59.762103 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-53f2a99e-6219-4964-8634-5039ca84754a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:29:59.875905 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919f0fc-8d5d-4f14-a537-5efe19bb3cd8 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:29:59.889370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb96b53-3934-4102-9394-61969d5b61e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:29:59.890902 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb96b53-3934-4102-9394-61969d5b61e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:29:59.891188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb96b53-3934-4102-9394-61969d5b61e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:29:59.891581 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb96b53-3934-4102-9394-61969d5b61e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:29:59.932024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb96b53-3934-4102-9394-61969d5b61e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:29:59.947166 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb96b53-3934-4102-9394-61969d5b61e7 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:29:59.981916 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 828/1653] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:29:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:29:59.989322 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 826/1654] 10.222.0.83 () {58 vars in 1009 bytes} [Fri Sep 23 01:29:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:30:00.009848 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb96b53-3934-4102-9394-61969d5b61e7 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:00.012731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ecb96b53-3934-4102-9394-61969d5b61e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:00.157877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb96b53-3934-4102-9394-61969d5b61e7 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:00.168198 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d9209-f30c-43ff-94b9-9488a5cea743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:00.169717 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d9209-f30c-43ff-94b9-9488a5cea743 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:00.170189 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d9209-f30c-43ff-94b9-9488a5cea743 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:00.170878 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d9209-f30c-43ff-94b9-9488a5cea743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:00.198074 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d9209-f30c-43ff-94b9-9488a5cea743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:00.205799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d9209-f30c-43ff-94b9-9488a5cea743 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:00.265600 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 829/1655] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:30:01.938721 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2a99e-6219-4964-8634-5039ca84754a None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:01.940827 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-53f2a99e-6219-4964-8634-5039ca84754a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:01.999599 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2a99e-6219-4964-8634-5039ca84754a None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:02.023975 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de3e10-cf64-41d0-a264-31fd3c6c85ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:02.026554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de3e10-cf64-41d0-a264-31fd3c6c85ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:02.036298 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de3e10-cf64-41d0-a264-31fd3c6c85ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:02.036615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de3e10-cf64-41d0-a264-31fd3c6c85ff admin admin] PATH_INFO: `/v3/projects/9f40545606fe496bb405e5c0426563d1` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:02.052287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de3e10-cf64-41d0-a264-31fd3c6c85ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f40545606fe496bb405e5c0426563d1)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:02.060653 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de3e10-cf64-41d0-a264-31fd3c6c85ff admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:02.389247 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d8de3e10-cf64-41d0-a264-31fd3c6c85ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f40545606fe496bb405e5c0426563d1', 'request_id': 'req-d8de3e10-cf64-41d0-a264-31fd3c6c85ff'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:02.575988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d8de3e10-cf64-41d0-a264-31fd3c6c85ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f40545606fe496bb405e5c0426563d1', 'request_id': 'req-d8de3e10-cf64-41d0-a264-31fd3c6c85ff'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:02.581138 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:02.598330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d8de3e10-cf64-41d0-a264-31fd3c6c85ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f40545606fe496bb405e5c0426563d1', 'request_id': 'req-d8de3e10-cf64-41d0-a264-31fd3c6c85ff'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:02.646888 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d8de3e10-cf64-41d0-a264-31fd3c6c85ff admin admin] The token cache is being invalidate because project 9f40545606fe496bb405e5c0426563d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:30:02.646888 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d8de3e10-cf64-41d0-a264-31fd3c6c85ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:02.658767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d8de3e10-cf64-41d0-a264-31fd3c6c85ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:02.669003 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d9209-f30c-43ff-94b9-9488a5cea743 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:02.676859 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 827/1656] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:30:01 2022] DELETE /identity/v3/projects/9f40545606fe496bb405e5c0426563d1 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:02.694195 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d9209-f30c-43ff-94b9-9488a5cea743 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:02.937442 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff282537-574b-484c-b220-f367e4b03e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:02.939090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff282537-574b-484c-b220-f367e4b03e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:02.939868 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff282537-574b-484c-b220-f367e4b03e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:02.941972 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff282537-574b-484c-b220-f367e4b03e45 admin admin] PATH_INFO: `/v3/users/65b42856393c4bd0a747615710e05822` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:02.945919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff282537-574b-484c-b220-f367e4b03e45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b42856393c4bd0a747615710e05822)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:02.952226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff282537-574b-484c-b220-f367e4b03e45 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:03.103447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:03.341755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-ff282537-574b-484c-b220-f367e4b03e45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b42856393c4bd0a747615710e05822'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:03.456852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-ff282537-574b-484c-b220-f367e4b03e45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b42856393c4bd0a747615710e05822'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:03.459458 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-ff282537-574b-484c-b220-f367e4b03e45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b42856393c4bd0a747615710e05822'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:03.485421 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-ff282537-574b-484c-b220-f367e4b03e45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b42856393c4bd0a747615710e05822'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:03.489268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-ff282537-574b-484c-b220-f367e4b03e45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b42856393c4bd0a747615710e05822'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:03.578731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 830/1657] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:30:02 2022] DELETE /identity/v3/users/65b42856393c4bd0a747615710e05822 => generated 0 bytes in 911 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:06.316215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de3e10-cf64-41d0-a264-31fd3c6c85ff admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:06.317642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-d8de3e10-cf64-41d0-a264-31fd3c6c85ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:06.385246 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de3e10-cf64-41d0-a264-31fd3c6c85ff admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:06.672031 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e29ea-869d-42fc-98c4-fe48c72ec95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:06.672759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e29ea-869d-42fc-98c4-fe48c72ec95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:06.673143 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e29ea-869d-42fc-98c4-fe48c72ec95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:06.681229 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e29ea-869d-42fc-98c4-fe48c72ec95f admin admin] PATH_INFO: `/v3/projects/1143c7ff3b334e45a34b1c2d689ebff3` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:06.687659 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e29ea-869d-42fc-98c4-fe48c72ec95f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1143c7ff3b334e45a34b1c2d689ebff3)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:06.696816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e29ea-869d-42fc-98c4-fe48c72ec95f admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:07.052965 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-8f7e29ea-869d-42fc-98c4-fe48c72ec95f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1143c7ff3b334e45a34b1c2d689ebff3', 'request_id': 'req-8f7e29ea-869d-42fc-98c4-fe48c72ec95f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:07.182556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-8f7e29ea-869d-42fc-98c4-fe48c72ec95f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1143c7ff3b334e45a34b1c2d689ebff3', 'request_id': 'req-8f7e29ea-869d-42fc-98c4-fe48c72ec95f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:07.201934 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-8f7e29ea-869d-42fc-98c4-fe48c72ec95f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1143c7ff3b334e45a34b1c2d689ebff3', 'request_id': 'req-8f7e29ea-869d-42fc-98c4-fe48c72ec95f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:07.276298 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-8f7e29ea-869d-42fc-98c4-fe48c72ec95f admin admin] The token cache is being invalidate because project 1143c7ff3b334e45a34b1c2d689ebff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:30:07.276827 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-8f7e29ea-869d-42fc-98c4-fe48c72ec95f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:07.284177 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-8f7e29ea-869d-42fc-98c4-fe48c72ec95f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:07.300236 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 828/1658] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:30:06 2022] DELETE /identity/v3/projects/1143c7ff3b334e45a34b1c2d689ebff3 => generated 0 bytes in 977 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:07.300491 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418145e-26fe-4a50-80f5-edd214269f9c None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:07.300491 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418145e-26fe-4a50-80f5-edd214269f9c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:07.302958 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418145e-26fe-4a50-80f5-edd214269f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:07.373310 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-3418145e-26fe-4a50-80f5-edd214269f9c None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:07.378886 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-3418145e-26fe-4a50-80f5-edd214269f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:07.640406 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 831/1659] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:30:07.656290 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb9e65-c277-4077-9821-4f634ab04984 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:07.660209 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb9e65-c277-4077-9821-4f634ab04984 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:07.660706 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb9e65-c277-4077-9821-4f634ab04984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:07.728571 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-56cb9e65-c277-4077-9821-4f634ab04984 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:07.730243 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-56cb9e65-c277-4077-9821-4f634ab04984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:07.766765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 829/1660] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:07.768791 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418145e-26fe-4a50-80f5-edd214269f9c None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:07.805620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418145e-26fe-4a50-80f5-edd214269f9c None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:07.845952 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6df267-80fb-41ce-a15e-f09eac48ef49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:07.847204 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6df267-80fb-41ce-a15e-f09eac48ef49 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:07.847721 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6df267-80fb-41ce-a15e-f09eac48ef49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:07.848222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6df267-80fb-41ce-a15e-f09eac48ef49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:07.849504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6df267-80fb-41ce-a15e-f09eac48ef49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:30:07.850032 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6df267-80fb-41ce-a15e-f09eac48ef49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:07.856671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6df267-80fb-41ce-a15e-f09eac48ef49 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:07.903615 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 832/1661] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:30:07.909979 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb9e65-c277-4077-9821-4f634ab04984 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:07.931668 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb9e65-c277-4077-9821-4f634ab04984 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:07.953304 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2968cd-8267-4062-8a01-42b8f39a7dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:07.954340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2968cd-8267-4062-8a01-42b8f39a7dda admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:07.954850 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2968cd-8267-4062-8a01-42b8f39a7dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:07.955316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2968cd-8267-4062-8a01-42b8f39a7dda admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:07.956572 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2968cd-8267-4062-8a01-42b8f39a7dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:07.978258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2968cd-8267-4062-8a01-42b8f39a7dda admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:08.210231 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 830/1662] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:30:07 2022] POST /identity/v3/projects => generated 381 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:30:08.221412 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6df267-80fb-41ce-a15e-f09eac48ef49 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:08.263204 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6df267-80fb-41ce-a15e-f09eac48ef49 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:08.557917 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4eac7-4c6e-49fe-8317-e769db1dbc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:08.559090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4eac7-4c6e-49fe-8317-e769db1dbc48 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:08.559795 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4eac7-4c6e-49fe-8317-e769db1dbc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:08.560278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4eac7-4c6e-49fe-8317-e769db1dbc48 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:08.569623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4eac7-4c6e-49fe-8317-e769db1dbc48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:08.569623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4eac7-4c6e-49fe-8317-e769db1dbc48 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:08.684168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2968cd-8267-4062-8a01-42b8f39a7dda admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:08.687259 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-bf2968cd-8267-4062-8a01-42b8f39a7dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:08.720323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2968cd-8267-4062-8a01-42b8f39a7dda admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:08.732631 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052d8c0-331a-4ed4-9512-ecdce1b60d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:08.736405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052d8c0-331a-4ed4-9512-ecdce1b60d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:08.737398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052d8c0-331a-4ed4-9512-ecdce1b60d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:08.738139 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052d8c0-331a-4ed4-9512-ecdce1b60d99 admin admin] PATH_INFO: `/v3/users/5a51ddfac8db466a8da79d07822225b1` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:08.742907 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052d8c0-331a-4ed4-9512-ecdce1b60d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a51ddfac8db466a8da79d07822225b1)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:08.747476 dv-cinder-849143-7-smb devstack@keystone.service[81923]: WARNING py.warnings [None req-2052d8c0-331a-4ed4-9512-ecdce1b60d99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 01:30:08.747476 dv-cinder-849143-7-smb devstack@keystone.service[81923]: warnings.warn(msg) Sep 23 01:30:08.747476 dv-cinder-849143-7-smb devstack@keystone.service[81923]: Sep 23 01:30:08.751040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052d8c0-331a-4ed4-9512-ecdce1b60d99 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:08.831706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 833/1663] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:30:08 2022] POST /identity/v3/users => generated 291 bytes in 611 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:30:08.838929 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4eac7-4c6e-49fe-8317-e769db1dbc48 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:08.898252 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4eac7-4c6e-49fe-8317-e769db1dbc48 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:08.919414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd685fd-0af8-4a8f-a94e-6449909fb7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:08.921281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd685fd-0af8-4a8f-a94e-6449909fb7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:08.922148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd685fd-0af8-4a8f-a94e-6449909fb7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:08.923055 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd685fd-0af8-4a8f-a94e-6449909fb7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:08.929347 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd685fd-0af8-4a8f-a94e-6449909fb7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:08.933431 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd685fd-0af8-4a8f-a94e-6449909fb7b4 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:08.999099 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 834/1664] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:30:09.005410 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd685fd-0af8-4a8f-a94e-6449909fb7b4 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:09.028581 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd685fd-0af8-4a8f-a94e-6449909fb7b4 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:09.039250 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f09d1-d30a-4ad1-8196-1204daaf5795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:09.040984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f09d1-d30a-4ad1-8196-1204daaf5795 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:09.041797 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f09d1-d30a-4ad1-8196-1204daaf5795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:09.042532 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f09d1-d30a-4ad1-8196-1204daaf5795 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:09.044841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f09d1-d30a-4ad1-8196-1204daaf5795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:09.049699 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f09d1-d30a-4ad1-8196-1204daaf5795 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:09.052055 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:09.095555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 835/1665] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:30:09.098358 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f09d1-d30a-4ad1-8196-1204daaf5795 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:09.183567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:09.192750 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-2052d8c0-331a-4ed4-9512-ecdce1b60d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a51ddfac8db466a8da79d07822225b1'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:09.207931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f09d1-d30a-4ad1-8196-1204daaf5795 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:09.224871 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ccfe6-b2b8-49a9-b008-c62daad9b160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:09.227728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ccfe6-b2b8-49a9-b008-c62daad9b160 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:09.231500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ccfe6-b2b8-49a9-b008-c62daad9b160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:09.233784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ccfe6-b2b8-49a9-b008-c62daad9b160 admin admin] PATH_INFO: `/v3/projects/a051f313757a45b2814189721e5d846e/users/baf97a34c7834519b1e3f8e3c2d06c84/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:09.243478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-2052d8c0-331a-4ed4-9512-ecdce1b60d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a51ddfac8db466a8da79d07822225b1'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:09.285254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ccfe6-b2b8-49a9-b008-c62daad9b160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a051f313757a45b2814189721e5d846e, user_id=baf97a34c7834519b1e3f8e3c2d06c84, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:09.293766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ccfe6-b2b8-49a9-b008-c62daad9b160 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:09.396923 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-2052d8c0-331a-4ed4-9512-ecdce1b60d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a51ddfac8db466a8da79d07822225b1'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:09.397865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-2052d8c0-331a-4ed4-9512-ecdce1b60d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a51ddfac8db466a8da79d07822225b1'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:09.437326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-2052d8c0-331a-4ed4-9512-ecdce1b60d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a51ddfac8db466a8da79d07822225b1'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:09.453916 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 836/1666] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:30:09 2022] PUT /identity/v3/projects/a051f313757a45b2814189721e5d846e/users/baf97a34c7834519b1e3f8e3c2d06c84/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:09.463702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 831/1667] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:30:08 2022] DELETE /identity/v3/users/5a51ddfac8db466a8da79d07822225b1 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:30:09.469197 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6da3e-f8c1-4ab5-8290-379e0e7fa6e5 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:09.469197 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6da3e-f8c1-4ab5-8290-379e0e7fa6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:09.469197 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6da3e-f8c1-4ab5-8290-379e0e7fa6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:09.478931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c62b34-43f6-4dd2-8b4c-43a4f70b8027 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:09.494229 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c62b34-43f6-4dd2-8b4c-43a4f70b8027 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:09.495244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c62b34-43f6-4dd2-8b4c-43a4f70b8027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:09.563353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-1eb6da3e-f8c1-4ab5-8290-379e0e7fa6e5 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:09.575337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-1eb6da3e-f8c1-4ab5-8290-379e0e7fa6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:09.673758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-90c62b34-43f6-4dd2-8b4c-43a4f70b8027 None None] MFA Rules not processed for user `baf97a34c7834519b1e3f8e3c2d06c84`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:09.686374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-90c62b34-43f6-4dd2-8b4c-43a4f70b8027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:10.049828 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 832/1668] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 583 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:10.155916 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6da3e-f8c1-4ab5-8290-379e0e7fa6e5 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:10.158368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-1eb6da3e-f8c1-4ab5-8290-379e0e7fa6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:10.193998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 837/1669] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 717 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:10.201261 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c62b34-43f6-4dd2-8b4c-43a4f70b8027 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:10.205917 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-90c62b34-43f6-4dd2-8b4c-43a4f70b8027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:10.330726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c62b34-43f6-4dd2-8b4c-43a4f70b8027 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:10.369139 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59928993-d9bf-47d6-a313-98bbf6675d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:10.378259 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59928993-d9bf-47d6-a313-98bbf6675d27 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:10.378634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59928993-d9bf-47d6-a313-98bbf6675d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:10.379176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59928993-d9bf-47d6-a313-98bbf6675d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:10.385243 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59928993-d9bf-47d6-a313-98bbf6675d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:10.395229 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59928993-d9bf-47d6-a313-98bbf6675d27 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:10.527551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6da3e-f8c1-4ab5-8290-379e0e7fa6e5 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:10.576316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9dadc5-2770-40da-890f-0e77f5b5fb00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:10.580058 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dadc5-2770-40da-890f-0e77f5b5fb00 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:10.580516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dadc5-2770-40da-890f-0e77f5b5fb00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:10.580972 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dadc5-2770-40da-890f-0e77f5b5fb00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:10.628681 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9dadc5-2770-40da-890f-0e77f5b5fb00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:10.637217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9dadc5-2770-40da-890f-0e77f5b5fb00 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:10.664142 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 838/1670] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:30:10 2022] POST /identity/v3/projects => generated 381 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:30:10.673949 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59928993-d9bf-47d6-a313-98bbf6675d27 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:10.690120 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 833/1671] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:30:11.032375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59928993-d9bf-47d6-a313-98bbf6675d27 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:11.057943 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf41cd4-a2eb-4943-8f53-71fc860c1389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:11.058532 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf41cd4-a2eb-4943-8f53-71fc860c1389 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:11.059192 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf41cd4-a2eb-4943-8f53-71fc860c1389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:11.059192 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf41cd4-a2eb-4943-8f53-71fc860c1389 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:11.059818 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf41cd4-a2eb-4943-8f53-71fc860c1389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:11.062288 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf41cd4-a2eb-4943-8f53-71fc860c1389 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:11.208251 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 839/1672] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:30:10 2022] POST /identity/v3/users => generated 297 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:30:11.209870 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9dadc5-2770-40da-890f-0e77f5b5fb00 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:11.233219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9dadc5-2770-40da-890f-0e77f5b5fb00 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:11.245833 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba870a0-a7c1-42c4-9d0a-67f3ef5d60c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:11.247397 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba870a0-a7c1-42c4-9d0a-67f3ef5d60c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:11.248263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba870a0-a7c1-42c4-9d0a-67f3ef5d60c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:11.248771 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba870a0-a7c1-42c4-9d0a-67f3ef5d60c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:11.249844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba870a0-a7c1-42c4-9d0a-67f3ef5d60c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:11.253381 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba870a0-a7c1-42c4-9d0a-67f3ef5d60c4 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:11.276856 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 834/1673] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:30:11.283657 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf41cd4-a2eb-4943-8f53-71fc860c1389 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:11.305412 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf41cd4-a2eb-4943-8f53-71fc860c1389 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:11.318176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001e572-6c03-4ccb-a503-7cacc367ec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:11.319315 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001e572-6c03-4ccb-a503-7cacc367ec2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:11.320004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001e572-6c03-4ccb-a503-7cacc367ec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:11.320650 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001e572-6c03-4ccb-a503-7cacc367ec2c admin admin] PATH_INFO: `/v3/projects/2f4f0c1d815b49318466c7518633b159/users/b107070df5954071a3d4e6c59cf9475c/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:11.392393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001e572-6c03-4ccb-a503-7cacc367ec2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4f0c1d815b49318466c7518633b159, user_id=b107070df5954071a3d4e6c59cf9475c, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:11.408912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001e572-6c03-4ccb-a503-7cacc367ec2c admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:11.636026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 840/1674] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:30:11 2022] PUT /identity/v3/projects/2f4f0c1d815b49318466c7518633b159/users/b107070df5954071a3d4e6c59cf9475c/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:30:11.643959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba870a0-a7c1-42c4-9d0a-67f3ef5d60c4 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:11.700119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba870a0-a7c1-42c4-9d0a-67f3ef5d60c4 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:11.931157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:11.963972 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670eb496-1084-4eeb-8844-2a22506e0a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:11.965477 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670eb496-1084-4eeb-8844-2a22506e0a3b admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:11.967462 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670eb496-1084-4eeb-8844-2a22506e0a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:11.968276 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670eb496-1084-4eeb-8844-2a22506e0a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:11.977340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670eb496-1084-4eeb-8844-2a22506e0a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:11.982222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670eb496-1084-4eeb-8844-2a22506e0a3b admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:12.020171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 835/1675] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:30:12.026237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001e572-6c03-4ccb-a503-7cacc367ec2c admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:12.048306 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:12.060127 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001e572-6c03-4ccb-a503-7cacc367ec2c admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:12.087320 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a372023-96d1-4dbb-a5f7-325d07a1e1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:12.089004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a372023-96d1-4dbb-a5f7-325d07a1e1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:12.089004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a372023-96d1-4dbb-a5f7-325d07a1e1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:12.089480 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a372023-96d1-4dbb-a5f7-325d07a1e1a1 admin admin] PATH_INFO: `/v3/projects/2f4f0c1d815b49318466c7518633b159/users/b107070df5954071a3d4e6c59cf9475c/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:12.125048 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a372023-96d1-4dbb-a5f7-325d07a1e1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4f0c1d815b49318466c7518633b159, user_id=b107070df5954071a3d4e6c59cf9475c, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:12.137199 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a372023-96d1-4dbb-a5f7-325d07a1e1a1 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:12.230919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 841/1676] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:30:12 2022] PUT /identity/v3/projects/2f4f0c1d815b49318466c7518633b159/users/b107070df5954071a3d4e6c59cf9475c/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:12.244933 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fa975-91ea-4861-a291-78a9b1a0ec01 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:12.245432 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fa975-91ea-4861-a291-78a9b1a0ec01 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:12.245937 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fa975-91ea-4861-a291-78a9b1a0ec01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:12.394917 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-6d4fa975-91ea-4861-a291-78a9b1a0ec01 None None] MFA Rules not processed for user `b107070df5954071a3d4e6c59cf9475c`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:12.397135 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6d4fa975-91ea-4861-a291-78a9b1a0ec01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:12.783311 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 836/1677] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 540 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:12.808792 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a372023-96d1-4dbb-a5f7-325d07a1e1a1 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:12.812555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-5a372023-96d1-4dbb-a5f7-325d07a1e1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:12.971310 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a372023-96d1-4dbb-a5f7-325d07a1e1a1 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:12.987855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7986a-7e9a-4427-a437-3f8701184b37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:12.988701 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7986a-7e9a-4427-a437-3f8701184b37 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:12.989082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7986a-7e9a-4427-a437-3f8701184b37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:12.989365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7986a-7e9a-4427-a437-3f8701184b37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:13.017401 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7986a-7e9a-4427-a437-3f8701184b37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:13.019420 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7986a-7e9a-4427-a437-3f8701184b37 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:13.041843 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 842/1678] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:30:13.266137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad6c43-53c4-40d1-b7d7-6ef8b884bd9f None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:13.266554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad6c43-53c4-40d1-b7d7-6ef8b884bd9f None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:13.266813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad6c43-53c4-40d1-b7d7-6ef8b884bd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:13.352678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-b3ad6c43-53c4-40d1-b7d7-6ef8b884bd9f None None] MFA Rules not processed for user `1541fedac9514a2eb65e8da0cc609fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:13.357940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b3ad6c43-53c4-40d1-b7d7-6ef8b884bd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:13.720787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 837/1679] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:13.736746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebfa0a-c0bf-4647-a036-f5dad9874b63 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:13.736746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebfa0a-c0bf-4647-a036-f5dad9874b63 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:13.736746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebfa0a-c0bf-4647-a036-f5dad9874b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:13.796517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-f8ebfa0a-c0bf-4647-a036-f5dad9874b63 None None] MFA Rules not processed for user `1541fedac9514a2eb65e8da0cc609fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:13.808742 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f8ebfa0a-c0bf-4647-a036-f5dad9874b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:13.822184 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 843/1680] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:30:13.917645 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad6c43-53c4-40d1-b7d7-6ef8b884bd9f None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:13.926881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b3ad6c43-53c4-40d1-b7d7-6ef8b884bd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:14.197942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad6c43-53c4-40d1-b7d7-6ef8b884bd9f None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:14.207934 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d633388-6905-4356-a6a2-69432780988e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:14.209003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d633388-6905-4356-a6a2-69432780988e service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:14.209417 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d633388-6905-4356-a6a2-69432780988e service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:14.216147 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d633388-6905-4356-a6a2-69432780988e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:14.246267 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d633388-6905-4356-a6a2-69432780988e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:14.249560 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d633388-6905-4356-a6a2-69432780988e service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:14.271435 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 838/1681] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:30:14.709003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:14.814402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebfa0a-c0bf-4647-a036-f5dad9874b63 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:14.817043 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f8ebfa0a-c0bf-4647-a036-f5dad9874b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:15.169599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebfa0a-c0bf-4647-a036-f5dad9874b63 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:15.194202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff68d8-2074-4ed6-987c-f752d1e936ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:15.197257 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff68d8-2074-4ed6-987c-f752d1e936ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:15.197712 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff68d8-2074-4ed6-987c-f752d1e936ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:15.198629 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff68d8-2074-4ed6-987c-f752d1e936ed admin admin] PATH_INFO: `/v3/projects/dcff9fa0637f4373827830aa86d59acf` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:15.202944 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff68d8-2074-4ed6-987c-f752d1e936ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcff9fa0637f4373827830aa86d59acf)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:15.211944 dv-cinder-849143-7-smb devstack@keystone.service[81924]: WARNING py.warnings [None req-efff68d8-2074-4ed6-987c-f752d1e936ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 01:30:15.211944 dv-cinder-849143-7-smb devstack@keystone.service[81924]: warnings.warn(msg) Sep 23 01:30:15.211944 dv-cinder-849143-7-smb devstack@keystone.service[81924]: Sep 23 01:30:15.221117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff68d8-2074-4ed6-987c-f752d1e936ed admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:15.737055 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-efff68d8-2074-4ed6-987c-f752d1e936ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcff9fa0637f4373827830aa86d59acf', 'request_id': 'req-efff68d8-2074-4ed6-987c-f752d1e936ed'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:15.867856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-efff68d8-2074-4ed6-987c-f752d1e936ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcff9fa0637f4373827830aa86d59acf', 'request_id': 'req-efff68d8-2074-4ed6-987c-f752d1e936ed'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:15.902556 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-efff68d8-2074-4ed6-987c-f752d1e936ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcff9fa0637f4373827830aa86d59acf', 'request_id': 'req-efff68d8-2074-4ed6-987c-f752d1e936ed'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:16.039629 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-efff68d8-2074-4ed6-987c-f752d1e936ed admin admin] The token cache is being invalidate because project dcff9fa0637f4373827830aa86d59acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:30:16.040415 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-efff68d8-2074-4ed6-987c-f752d1e936ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:16.041765 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-efff68d8-2074-4ed6-987c-f752d1e936ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:16.052401 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 844/1682] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:30:14 2022] DELETE /identity/v3/projects/dcff9fa0637f4373827830aa86d59acf => generated 0 bytes in 1232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:16.057860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5167e30-6de0-447f-8dc8-4e900c1788b8 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:16.065477 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5167e30-6de0-447f-8dc8-4e900c1788b8 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:16.070695 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5167e30-6de0-447f-8dc8-4e900c1788b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:16.106473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-a5167e30-6de0-447f-8dc8-4e900c1788b8 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:16.108132 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a5167e30-6de0-447f-8dc8-4e900c1788b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:16.285069 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff68d8-2074-4ed6-987c-f752d1e936ed admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:16.293002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-efff68d8-2074-4ed6-987c-f752d1e936ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:16.386067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 839/1683] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:16.393483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:16.394615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a5b84-0f01-45a0-aff3-ba000e1b9b09 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:16.399334 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a5b84-0f01-45a0-aff3-ba000e1b9b09 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:16.406411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a5b84-0f01-45a0-aff3-ba000e1b9b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:16.511595 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-bc0a5b84-0f01-45a0-aff3-ba000e1b9b09 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:16.525456 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-bc0a5b84-0f01-45a0-aff3-ba000e1b9b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:16.598480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 840/1684] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:16.604015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a5b84-0f01-45a0-aff3-ba000e1b9b09 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:16.677765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a5b84-0f01-45a0-aff3-ba000e1b9b09 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:16.701351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff68d8-2074-4ed6-987c-f752d1e936ed admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:16.720304 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5f710-fa25-4c02-b60c-451c8f13d0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:16.721784 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5f710-fa25-4c02-b60c-451c8f13d0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:16.723677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5f710-fa25-4c02-b60c-451c8f13d0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:16.729835 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5f710-fa25-4c02-b60c-451c8f13d0f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:16.733217 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16552656-3ea8-473d-9ae6-b00627ca3471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:16.734353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16552656-3ea8-473d-9ae6-b00627ca3471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:16.734938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16552656-3ea8-473d-9ae6-b00627ca3471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:16.735476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16552656-3ea8-473d-9ae6-b00627ca3471 admin admin] PATH_INFO: `/v3/users/baf97a34c7834519b1e3f8e3c2d06c84` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:16.742800 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5f710-fa25-4c02-b60c-451c8f13d0f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:30:16.744025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16552656-3ea8-473d-9ae6-b00627ca3471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf97a34c7834519b1e3f8e3c2d06c84)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:16.744510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5f710-fa25-4c02-b60c-451c8f13d0f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:16.746918 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5f710-fa25-4c02-b60c-451c8f13d0f7 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:16.754493 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16552656-3ea8-473d-9ae6-b00627ca3471 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:16.904023 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 841/1685] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:30:16.909271 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5f710-fa25-4c02-b60c-451c8f13d0f7 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:17.021855 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5f710-fa25-4c02-b60c-451c8f13d0f7 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:17.079405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b9b74-7eb1-49d8-9591-82332a83a48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:17.084043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b9b74-7eb1-49d8-9591-82332a83a48a admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:17.087827 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b9b74-7eb1-49d8-9591-82332a83a48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:17.092095 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b9b74-7eb1-49d8-9591-82332a83a48a admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:17.099752 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b9b74-7eb1-49d8-9591-82332a83a48a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:17.115727 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b9b74-7eb1-49d8-9591-82332a83a48a admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:17.377306 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-16552656-3ea8-473d-9ae6-b00627ca3471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf97a34c7834519b1e3f8e3c2d06c84'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:17.419311 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 842/1686] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:30:16 2022] POST /identity/v3/projects => generated 373 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:30:17.426963 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b9b74-7eb1-49d8-9591-82332a83a48a admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:17.517721 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-16552656-3ea8-473d-9ae6-b00627ca3471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf97a34c7834519b1e3f8e3c2d06c84'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:17.520026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-16552656-3ea8-473d-9ae6-b00627ca3471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf97a34c7834519b1e3f8e3c2d06c84'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:17.538827 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-16552656-3ea8-473d-9ae6-b00627ca3471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf97a34c7834519b1e3f8e3c2d06c84'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:17.540076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-16552656-3ea8-473d-9ae6-b00627ca3471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf97a34c7834519b1e3f8e3c2d06c84'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:17.630307 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 845/1687] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:30:16 2022] DELETE /identity/v3/users/baf97a34c7834519b1e3f8e3c2d06c84 => generated 0 bytes in 1347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:17.632176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a1e10-485e-4f54-a5c1-ae582e04e7c7 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:17.632522 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a1e10-485e-4f54-a5c1-ae582e04e7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:17.632924 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a1e10-485e-4f54-a5c1-ae582e04e7c7 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:17.644803 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 846/1688] 10.222.0.83 () {54 vars in 912 bytes} [Fri Sep 23 01:30:17 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:30:17.646110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a1e10-485e-4f54-a5c1-ae582e04e7c7 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:17.649099 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-481a1e10-485e-4f54-a5c1-ae582e04e7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:17.782742 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b9b74-7eb1-49d8-9591-82332a83a48a admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:17.792190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a1e10-485e-4f54-a5c1-ae582e04e7c7 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:17.809823 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa8527-41bf-4296-bea9-d6ad6eaa4acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:17.811471 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa8527-41bf-4296-bea9-d6ad6eaa4acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:17.812204 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa8527-41bf-4296-bea9-d6ad6eaa4acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:17.812956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa8527-41bf-4296-bea9-d6ad6eaa4acf admin admin] PATH_INFO: `/v3/users/ecdc95ca148f497595ba32bccaa2b359` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:17.818109 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa8527-41bf-4296-bea9-d6ad6eaa4acf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecdc95ca148f497595ba32bccaa2b359)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:17.822210 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa8527-41bf-4296-bea9-d6ad6eaa4acf admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:17.824157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79cfb7-60fb-4be1-85bd-14ee3b805f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:17.825522 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79cfb7-60fb-4be1-85bd-14ee3b805f8a admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:17.826079 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79cfb7-60fb-4be1-85bd-14ee3b805f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:17.826618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79cfb7-60fb-4be1-85bd-14ee3b805f8a admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:17.833229 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79cfb7-60fb-4be1-85bd-14ee3b805f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:17.837657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79cfb7-60fb-4be1-85bd-14ee3b805f8a admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:18.082507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 843/1689] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:30:17 2022] POST /identity/v3/users => generated 287 bytes in 655 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:30:18.085163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f896d3-bd8a-4b4f-91f1-b9d9d96c1ac7 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:18.085509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f896d3-bd8a-4b4f-91f1-b9d9d96c1ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:18.089100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f896d3-bd8a-4b4f-91f1-b9d9d96c1ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:18.168189 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:18.181362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-32aa8527-41bf-4296-bea9-d6ad6eaa4acf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecdc95ca148f497595ba32bccaa2b359'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:18.240791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-94f896d3-bd8a-4b4f-91f1-b9d9d96c1ac7 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:18.248886 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-94f896d3-bd8a-4b4f-91f1-b9d9d96c1ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:18.307165 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 844/1690] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:18.312041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5934d-d98d-4197-90c9-5a102a55ce96 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:18.312860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5934d-d98d-4197-90c9-5a102a55ce96 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:18.316397 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5934d-d98d-4197-90c9-5a102a55ce96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:18.346638 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-32aa8527-41bf-4296-bea9-d6ad6eaa4acf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecdc95ca148f497595ba32bccaa2b359'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:18.347843 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-32aa8527-41bf-4296-bea9-d6ad6eaa4acf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecdc95ca148f497595ba32bccaa2b359'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:18.361413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-32aa8527-41bf-4296-bea9-d6ad6eaa4acf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecdc95ca148f497595ba32bccaa2b359'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:18.364944 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-32aa8527-41bf-4296-bea9-d6ad6eaa4acf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecdc95ca148f497595ba32bccaa2b359'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:18.445969 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 847/1691] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:30:17 2022] DELETE /identity/v3/users/ecdc95ca148f497595ba32bccaa2b359 => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:18.447619 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa8527-41bf-4296-bea9-d6ad6eaa4acf admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:18.450140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-32aa8527-41bf-4296-bea9-d6ad6eaa4acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:18.575297 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-f6f5934d-d98d-4197-90c9-5a102a55ce96 None None] MFA Rules not processed for user `be2b2806686c4a15b1ace8b6245c4e28`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:18.593279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f6f5934d-d98d-4197-90c9-5a102a55ce96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:18.719580 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:18.872383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa8527-41bf-4296-bea9-d6ad6eaa4acf admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:18.888926 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc672d9-1e20-43a5-a65b-daf950f07666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:18.900392 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc672d9-1e20-43a5-a65b-daf950f07666 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:18.905255 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc672d9-1e20-43a5-a65b-daf950f07666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:18.905255 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc672d9-1e20-43a5-a65b-daf950f07666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:18.905255 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc672d9-1e20-43a5-a65b-daf950f07666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:18.908407 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc672d9-1e20-43a5-a65b-daf950f07666 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:18.916335 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 845/1692] 10.222.0.83 () {58 vars in 1009 bytes} [Fri Sep 23 01:30:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 608 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:18.917593 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5934d-d98d-4197-90c9-5a102a55ce96 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:18.925109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f6f5934d-d98d-4197-90c9-5a102a55ce96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:18.969491 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5934d-d98d-4197-90c9-5a102a55ce96 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:18.969846 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 848/1693] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 523 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:30:18.976495 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b015d90-b17b-4539-a73d-8abd4d8cc2d2 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:18.979514 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b015d90-b17b-4539-a73d-8abd4d8cc2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:18.980680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b015d90-b17b-4539-a73d-8abd4d8cc2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:18.987478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef74cd3-0c3d-492b-a095-f39e416c456e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:18.995596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef74cd3-0c3d-492b-a095-f39e416c456e service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:18.995963 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef74cd3-0c3d-492b-a095-f39e416c456e service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:18.996880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef74cd3-0c3d-492b-a095-f39e416c456e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:19.008967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-3ef74cd3-0c3d-492b-a095-f39e416c456e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:19.071690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef74cd3-0c3d-492b-a095-f39e416c456e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:19.074307 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-4b015d90-b17b-4539-a73d-8abd4d8cc2d2 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:19.081004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-4b015d90-b17b-4539-a73d-8abd4d8cc2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:19.083443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef74cd3-0c3d-492b-a095-f39e416c456e service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:19.118685 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 846/1694] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:30:19.125333 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef74cd3-0c3d-492b-a095-f39e416c456e service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:19.129539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 849/1695] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:19.130884 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b015d90-b17b-4539-a73d-8abd4d8cc2d2 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:19.174012 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b015d90-b17b-4539-a73d-8abd4d8cc2d2 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:19.193216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef74cd3-0c3d-492b-a095-f39e416c456e service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:19.198182 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30948c9f-75fd-4a76-a6c1-9438fc169acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:19.198908 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30948c9f-75fd-4a76-a6c1-9438fc169acd service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:19.199352 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30948c9f-75fd-4a76-a6c1-9438fc169acd service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:19.199794 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30948c9f-75fd-4a76-a6c1-9438fc169acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:19.226084 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0087a2-4ced-4597-9688-905692a57e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:19.226755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30948c9f-75fd-4a76-a6c1-9438fc169acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:19.228490 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30948c9f-75fd-4a76-a6c1-9438fc169acd service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:19.238754 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0087a2-4ced-4597-9688-905692a57e75 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:19.240279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0087a2-4ced-4597-9688-905692a57e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:19.242234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0087a2-4ced-4597-9688-905692a57e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:19.243393 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0087a2-4ced-4597-9688-905692a57e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:19.245414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0087a2-4ced-4597-9688-905692a57e75 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:19.254637 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 850/1696] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:30:19.272019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 847/1697] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:30:19.278184 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30948c9f-75fd-4a76-a6c1-9438fc169acd service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:19.301709 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30948c9f-75fd-4a76-a6c1-9438fc169acd service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:19.314915 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b12cc-3182-408e-b9d8-68f0330ad79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:19.316005 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b12cc-3182-408e-b9d8-68f0330ad79b admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:19.316696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b12cc-3182-408e-b9d8-68f0330ad79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:19.317331 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b12cc-3182-408e-b9d8-68f0330ad79b admin admin] PATH_INFO: `/v3/projects/66cb11f81ae34332bd791aab09b3e201/users/caa5fe2a7af0436e8bae48f566ec6e3d/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:19.346766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b12cc-3182-408e-b9d8-68f0330ad79b admin admin] RBAC: Authorizing `identity:create_grant(project_id=66cb11f81ae34332bd791aab09b3e201, user_id=caa5fe2a7af0436e8bae48f566ec6e3d, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:19.350978 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b12cc-3182-408e-b9d8-68f0330ad79b admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:19.383568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0087a2-4ced-4597-9688-905692a57e75 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:19.407432 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0087a2-4ced-4597-9688-905692a57e75 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:19.439966 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9858f7-46fb-4823-9b68-b27443ca61ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:19.441647 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9858f7-46fb-4823-9b68-b27443ca61ba service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:19.443945 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9858f7-46fb-4823-9b68-b27443ca61ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:19.444374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9858f7-46fb-4823-9b68-b27443ca61ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:19.495250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9858f7-46fb-4823-9b68-b27443ca61ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:19.496817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9858f7-46fb-4823-9b68-b27443ca61ba service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:19.520231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 851/1698] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:30:19 2022] PUT /identity/v3/projects/66cb11f81ae34332bd791aab09b3e201/users/caa5fe2a7af0436e8bae48f566ec6e3d/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:19.538190 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 848/1699] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:30:19.543138 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0fa0f-b6e6-41fc-a72b-a290a53b1640 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:19.543138 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0fa0f-b6e6-41fc-a72b-a290a53b1640 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:19.543138 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0fa0f-b6e6-41fc-a72b-a290a53b1640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:19.747137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-2ac0fa0f-b6e6-41fc-a72b-a290a53b1640 None None] MFA Rules not processed for user `caa5fe2a7af0436e8bae48f566ec6e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:19.754959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-2ac0fa0f-b6e6-41fc-a72b-a290a53b1640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:20.173880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:20.226234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 852/1700] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 688 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:20.256975 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9858f7-46fb-4823-9b68-b27443ca61ba service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:20.261996 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6b9858f7-46fb-4823-9b68-b27443ca61ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:20.462904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9858f7-46fb-4823-9b68-b27443ca61ba service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:20.595687 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d2841-3d19-4a47-8fff-a8b6d9c88218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:20.596625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d2841-3d19-4a47-8fff-a8b6d9c88218 service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:20.597117 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d2841-3d19-4a47-8fff-a8b6d9c88218 service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:20.598163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d2841-3d19-4a47-8fff-a8b6d9c88218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:20.623472 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a898c5-ad6d-4002-9297-a312c2b7b48c None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:20.624568 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a898c5-ad6d-4002-9297-a312c2b7b48c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:20.626255 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a898c5-ad6d-4002-9297-a312c2b7b48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:20.651553 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d2841-3d19-4a47-8fff-a8b6d9c88218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:20.675047 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d2841-3d19-4a47-8fff-a8b6d9c88218 service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:20.696778 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 849/1701] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:30:20.718413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-53a898c5-ad6d-4002-9297-a312c2b7b48c None None] MFA Rules not processed for user `e7bd32cb680e4d9aa9bbaa32c94e68de`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:20.720031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-53a898c5-ad6d-4002-9297-a312c2b7b48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:20.994654 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 853/1702] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:21.115461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d2841-3d19-4a47-8fff-a8b6d9c88218 service nova] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:21.131697 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d2841-3d19-4a47-8fff-a8b6d9c88218 service nova] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:21.162443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912e77f-b8cd-4d7c-b03c-85258f1ce93e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:21.163126 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912e77f-b8cd-4d7c-b03c-85258f1ce93e service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:21.163433 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912e77f-b8cd-4d7c-b03c-85258f1ce93e service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:21.163770 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912e77f-b8cd-4d7c-b03c-85258f1ce93e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:21.197923 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912e77f-b8cd-4d7c-b03c-85258f1ce93e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:21.200008 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912e77f-b8cd-4d7c-b03c-85258f1ce93e service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:21.220695 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:21.259982 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 850/1703] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:30:21.677010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96365768-42ac-4f39-9d6a-02cb8457c6db None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:21.677799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96365768-42ac-4f39-9d6a-02cb8457c6db None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:21.677799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96365768-42ac-4f39-9d6a-02cb8457c6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:21.815661 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-96365768-42ac-4f39-9d6a-02cb8457c6db None None] MFA Rules not processed for user `ca2a9d6e977f4ac7abd8745d092a9472`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:21.830211 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-96365768-42ac-4f39-9d6a-02cb8457c6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:22.205144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 854/1704] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 529 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:30:22.228181 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a93743-9cab-4718-b427-56e4bd459e18 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:22.228618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a93743-9cab-4718-b427-56e4bd459e18 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:22.229301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a93743-9cab-4718-b427-56e4bd459e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:22.314903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-83a93743-9cab-4718-b427-56e4bd459e18 None None] MFA Rules not processed for user `ca2a9d6e977f4ac7abd8745d092a9472`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:22.318115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-83a93743-9cab-4718-b427-56e4bd459e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:22.391025 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 851/1705] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:22.515406 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96365768-42ac-4f39-9d6a-02cb8457c6db None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:22.516570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a93743-9cab-4718-b427-56e4bd459e18 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:22.575579 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96365768-42ac-4f39-9d6a-02cb8457c6db None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:22.628845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5e51f-f2fa-43e6-b0de-e77bd93e5aa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:22.631244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5e51f-f2fa-43e6-b0de-e77bd93e5aa3 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:22.633553 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5e51f-f2fa-43e6-b0de-e77bd93e5aa3 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:22.634422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5e51f-f2fa-43e6-b0de-e77bd93e5aa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:22.728175 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5e51f-f2fa-43e6-b0de-e77bd93e5aa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:22.741021 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5e51f-f2fa-43e6-b0de-e77bd93e5aa3 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:22.791257 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 855/1706] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:30:22.793423 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5e51f-f2fa-43e6-b0de-e77bd93e5aa3 service nova] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:22.801425 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-cdb5e51f-f2fa-43e6-b0de-e77bd93e5aa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:22.890942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a93743-9cab-4718-b427-56e4bd459e18 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:22.913441 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436b762-48e8-475a-a252-182f5567d134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:22.919270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436b762-48e8-475a-a252-182f5567d134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:22.923784 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436b762-48e8-475a-a252-182f5567d134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:22.924660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436b762-48e8-475a-a252-182f5567d134 admin admin] PATH_INFO: `/v3/users/caa5fe2a7af0436e8bae48f566ec6e3d` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:22.940021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436b762-48e8-475a-a252-182f5567d134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa5fe2a7af0436e8bae48f566ec6e3d)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:22.957308 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436b762-48e8-475a-a252-182f5567d134 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:23.217152 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5e51f-f2fa-43e6-b0de-e77bd93e5aa3 service nova] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:23.260300 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c3e7e-a354-43fd-adad-997e375fdd64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eab2cbff5984fa6a8e715ed6553db82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:23.262886 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c3e7e-a354-43fd-adad-997e375fdd64 service placement] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:23.263435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c3e7e-a354-43fd-adad-997e375fdd64 service placement] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:23.263954 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c3e7e-a354-43fd-adad-997e375fdd64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:23.275387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ef5c3e7e-a354-43fd-adad-997e375fdd64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:23.322228 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:23.333049 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c3e7e-a354-43fd-adad-997e375fdd64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:23.337772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c3e7e-a354-43fd-adad-997e375fdd64 service placement] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:23.385785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 856/1707] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:30:23.388311 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c3e7e-a354-43fd-adad-997e375fdd64 service placement] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:23.396126 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ef5c3e7e-a354-43fd-adad-997e375fdd64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:23.473404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a436b762-48e8-475a-a252-182f5567d134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa5fe2a7af0436e8bae48f566ec6e3d'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:23.485136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c3e7e-a354-43fd-adad-997e375fdd64 service placement] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:23.531137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89deb2b-5bd6-465c-a3b1-be9a557787c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:23.538102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89deb2b-5bd6-465c-a3b1-be9a557787c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:23.538948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89deb2b-5bd6-465c-a3b1-be9a557787c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:23.540243 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89deb2b-5bd6-465c-a3b1-be9a557787c7 admin admin] PATH_INFO: `/v3/projects/e935769c8b844d9f9af50e8e39e8f318` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:23.551749 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89deb2b-5bd6-465c-a3b1-be9a557787c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e935769c8b844d9f9af50e8e39e8f318)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:23.562608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89deb2b-5bd6-465c-a3b1-be9a557787c7 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:23.565816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a436b762-48e8-475a-a252-182f5567d134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa5fe2a7af0436e8bae48f566ec6e3d'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:23.813921 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a436b762-48e8-475a-a252-182f5567d134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa5fe2a7af0436e8bae48f566ec6e3d'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:23.816755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a436b762-48e8-475a-a252-182f5567d134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa5fe2a7af0436e8bae48f566ec6e3d'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:23.861645 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a436b762-48e8-475a-a252-182f5567d134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa5fe2a7af0436e8bae48f566ec6e3d'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:23.909072 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 852/1708] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:30:22 2022] DELETE /identity/v3/users/caa5fe2a7af0436e8bae48f566ec6e3d => generated 0 bytes in 1388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:23.911384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436b762-48e8-475a-a252-182f5567d134 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:23.917496 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a436b762-48e8-475a-a252-182f5567d134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:23.951417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f89deb2b-5bd6-465c-a3b1-be9a557787c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e935769c8b844d9f9af50e8e39e8f318', 'request_id': 'req-f89deb2b-5bd6-465c-a3b1-be9a557787c7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:24.074403 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f89deb2b-5bd6-465c-a3b1-be9a557787c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e935769c8b844d9f9af50e8e39e8f318', 'request_id': 'req-f89deb2b-5bd6-465c-a3b1-be9a557787c7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:24.095251 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f89deb2b-5bd6-465c-a3b1-be9a557787c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e935769c8b844d9f9af50e8e39e8f318', 'request_id': 'req-f89deb2b-5bd6-465c-a3b1-be9a557787c7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:24.096623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436b762-48e8-475a-a252-182f5567d134 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:24.116850 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cab227-8bc9-4b34-9ff8-bb9ed4feb083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:24.118245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cab227-8bc9-4b34-9ff8-bb9ed4feb083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:24.118776 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cab227-8bc9-4b34-9ff8-bb9ed4feb083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:24.119725 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cab227-8bc9-4b34-9ff8-bb9ed4feb083 admin admin] PATH_INFO: `/v3/projects/a051f313757a45b2814189721e5d846e` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:24.123045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cab227-8bc9-4b34-9ff8-bb9ed4feb083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a051f313757a45b2814189721e5d846e)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:24.130079 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cab227-8bc9-4b34-9ff8-bb9ed4feb083 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:24.136719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f89deb2b-5bd6-465c-a3b1-be9a557787c7 admin admin] The token cache is being invalidate because project e935769c8b844d9f9af50e8e39e8f318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:30:24.137605 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f89deb2b-5bd6-465c-a3b1-be9a557787c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:24.140588 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f89deb2b-5bd6-465c-a3b1-be9a557787c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:24.143971 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 857/1709] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:30:23 2022] DELETE /identity/v3/projects/e935769c8b844d9f9af50e8e39e8f318 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:24.147092 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8a1c3-3b3a-44a5-8439-ea1e98dad708 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:24.147771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8a1c3-3b3a-44a5-8439-ea1e98dad708 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:24.149348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8a1c3-3b3a-44a5-8439-ea1e98dad708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:24.189064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:24.215639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-bbd8a1c3-3b3a-44a5-8439-ea1e98dad708 None None] MFA Rules not processed for user `67b89827871f45738162611b31a23509`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:24.221628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-bbd8a1c3-3b3a-44a5-8439-ea1e98dad708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:24.407473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-62cab227-8bc9-4b34-9ff8-bb9ed4feb083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a051f313757a45b2814189721e5d846e', 'request_id': 'req-62cab227-8bc9-4b34-9ff8-bb9ed4feb083'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:24.490306 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 858/1710] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:24.493283 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61744b43-4e81-42e7-b17c-52390b909cc8 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:24.499898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61744b43-4e81-42e7-b17c-52390b909cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:24.500505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61744b43-4e81-42e7-b17c-52390b909cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:24.879329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-61744b43-4e81-42e7-b17c-52390b909cc8 None None] MFA Rules not processed for user `1541fedac9514a2eb65e8da0cc609fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:24.879329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-61744b43-4e81-42e7-b17c-52390b909cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:24.879329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 859/1711] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:24.879329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c0b45-3e2d-4426-a008-a32da811fe02 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:24.879329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c0b45-3e2d-4426-a008-a32da811fe02 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:24.879329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c0b45-3e2d-4426-a008-a32da811fe02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:24.909409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-9e1c0b45-3e2d-4426-a008-a32da811fe02 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:24.909409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-9e1c0b45-3e2d-4426-a008-a32da811fe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:24.909409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:24.974820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-62cab227-8bc9-4b34-9ff8-bb9ed4feb083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a051f313757a45b2814189721e5d846e', 'request_id': 'req-62cab227-8bc9-4b34-9ff8-bb9ed4feb083'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:24.999393 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-62cab227-8bc9-4b34-9ff8-bb9ed4feb083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a051f313757a45b2814189721e5d846e', 'request_id': 'req-62cab227-8bc9-4b34-9ff8-bb9ed4feb083'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:25.003476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 860/1712] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:25.005818 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca884343-cfb7-46be-a10d-c36c08a834db None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:25.006309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca884343-cfb7-46be-a10d-c36c08a834db None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:25.006934 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca884343-cfb7-46be-a10d-c36c08a834db None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:25.010033 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 861/1713] 10.222.0.83 () {54 vars in 912 bytes} [Fri Sep 23 01:30:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:30:25.011058 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca884343-cfb7-46be-a10d-c36c08a834db None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:25.014167 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ca884343-cfb7-46be-a10d-c36c08a834db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:25.050821 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca884343-cfb7-46be-a10d-c36c08a834db None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:25.070762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0bfc6-ef4b-47ee-a1fc-ebd2bf2e2f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:25.070762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0bfc6-ef4b-47ee-a1fc-ebd2bf2e2f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:25.070762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0bfc6-ef4b-47ee-a1fc-ebd2bf2e2f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:25.070762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0bfc6-ef4b-47ee-a1fc-ebd2bf2e2f77 admin admin] PATH_INFO: `/v3/users/5b501cbbf73b4a31bc15bbc71e171c99` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:25.071326 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0bfc6-ef4b-47ee-a1fc-ebd2bf2e2f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b501cbbf73b4a31bc15bbc71e171c99)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:25.071463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-62cab227-8bc9-4b34-9ff8-bb9ed4feb083 admin admin] The token cache is being invalidate because project a051f313757a45b2814189721e5d846e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:30:25.071463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-62cab227-8bc9-4b34-9ff8-bb9ed4feb083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:25.073331 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-62cab227-8bc9-4b34-9ff8-bb9ed4feb083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:25.073980 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0bfc6-ef4b-47ee-a1fc-ebd2bf2e2f77 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:25.090085 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 853/1714] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:30:23 2022] DELETE /identity/v3/projects/a051f313757a45b2814189721e5d846e => generated 0 bytes in 1176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:25.090085 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cab227-8bc9-4b34-9ff8-bb9ed4feb083 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:25.092596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-62cab227-8bc9-4b34-9ff8-bb9ed4feb083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:25.296577 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cab227-8bc9-4b34-9ff8-bb9ed4feb083 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:25.308803 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21965d4-d349-41b4-9842-007e7f3358cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:25.310037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21965d4-d349-41b4-9842-007e7f3358cf service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:25.310698 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21965d4-d349-41b4-9842-007e7f3358cf service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:25.311331 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21965d4-d349-41b4-9842-007e7f3358cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:25.315132 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-d21965d4-d349-41b4-9842-007e7f3358cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:25.439641 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21965d4-d349-41b4-9842-007e7f3358cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:25.442825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21965d4-d349-41b4-9842-007e7f3358cf service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:25.488501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 854/1715] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:30:25.490240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21965d4-d349-41b4-9842-007e7f3358cf service nova] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:25.493538 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-d21965d4-d349-41b4-9842-007e7f3358cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:25.531188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f9f0bfc6-ef4b-47ee-a1fc-ebd2bf2e2f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b501cbbf73b4a31bc15bbc71e171c99'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:25.627109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:25.659985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f9f0bfc6-ef4b-47ee-a1fc-ebd2bf2e2f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b501cbbf73b4a31bc15bbc71e171c99'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:25.661250 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f9f0bfc6-ef4b-47ee-a1fc-ebd2bf2e2f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b501cbbf73b4a31bc15bbc71e171c99'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:25.669138 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21965d4-d349-41b4-9842-007e7f3358cf service nova] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:25.677833 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb414ab-b6c0-48e5-9417-aaacc155c3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:25.678088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f9f0bfc6-ef4b-47ee-a1fc-ebd2bf2e2f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b501cbbf73b4a31bc15bbc71e171c99'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:25.679003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb414ab-b6c0-48e5-9417-aaacc155c3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:25.679308 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f9f0bfc6-ef4b-47ee-a1fc-ebd2bf2e2f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b501cbbf73b4a31bc15bbc71e171c99'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:25.679555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb414ab-b6c0-48e5-9417-aaacc155c3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:25.680039 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb414ab-b6c0-48e5-9417-aaacc155c3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:25.684027 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-abb414ab-b6c0-48e5-9417-aaacc155c3c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:25.736381 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb414ab-b6c0-48e5-9417-aaacc155c3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:25.739178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb414ab-b6c0-48e5-9417-aaacc155c3c6 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:25.798322 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 862/1716] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:30:25 2022] DELETE /identity/v3/users/5b501cbbf73b4a31bc15bbc71e171c99 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:25.808390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29acaf-6eea-4f9b-916d-10669b1afa9a None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:25.808913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29acaf-6eea-4f9b-916d-10669b1afa9a None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:25.812301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29acaf-6eea-4f9b-916d-10669b1afa9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:25.830480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 855/1717] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:30:25.836492 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb414ab-b6c0-48e5-9417-aaacc155c3c6 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:25.850767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-abb414ab-b6c0-48e5-9417-aaacc155c3c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:25.926694 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb414ab-b6c0-48e5-9417-aaacc155c3c6 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:25.962573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-fd29acaf-6eea-4f9b-916d-10669b1afa9a None None] MFA Rules not processed for user `be2b2806686c4a15b1ace8b6245c4e28`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:25.976328 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-fd29acaf-6eea-4f9b-916d-10669b1afa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:26.232351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3554e3d-5563-4682-bda0-8a247dc7c111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:26.236379 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3554e3d-5563-4682-bda0-8a247dc7c111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:26.238431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3554e3d-5563-4682-bda0-8a247dc7c111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:26.239833 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3554e3d-5563-4682-bda0-8a247dc7c111 admin admin] PATH_INFO: `/v3/users/b107070df5954071a3d4e6c59cf9475c` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:26.249307 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3554e3d-5563-4682-bda0-8a247dc7c111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b107070df5954071a3d4e6c59cf9475c)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:26.256671 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3554e3d-5563-4682-bda0-8a247dc7c111 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:26.291361 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 863/1718] 10.222.0.83 () {58 vars in 1009 bytes} [Fri Sep 23 01:30:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:26.318943 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29acaf-6eea-4f9b-916d-10669b1afa9a None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:26.322190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-fd29acaf-6eea-4f9b-916d-10669b1afa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:26.365222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29acaf-6eea-4f9b-916d-10669b1afa9a None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:26.375506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fbac1-c857-4d28-b512-7a022d0c5d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:26.377925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fbac1-c857-4d28-b512-7a022d0c5d12 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:26.378729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fbac1-c857-4d28-b512-7a022d0c5d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:26.379776 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fbac1-c857-4d28-b512-7a022d0c5d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:26.410094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759fbac1-c857-4d28-b512-7a022d0c5d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:26.413405 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759fbac1-c857-4d28-b512-7a022d0c5d12 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:26.429935 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 864/1719] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:30:26.817678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-e3554e3d-5563-4682-bda0-8a247dc7c111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b107070df5954071a3d4e6c59cf9475c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:26.887050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-e3554e3d-5563-4682-bda0-8a247dc7c111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b107070df5954071a3d4e6c59cf9475c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:27.090339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-e3554e3d-5563-4682-bda0-8a247dc7c111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b107070df5954071a3d4e6c59cf9475c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:27.091535 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-e3554e3d-5563-4682-bda0-8a247dc7c111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b107070df5954071a3d4e6c59cf9475c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:27.137481 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-e3554e3d-5563-4682-bda0-8a247dc7c111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b107070df5954071a3d4e6c59cf9475c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:27.180982 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 856/1720] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:30:25 2022] DELETE /identity/v3/users/b107070df5954071a3d4e6c59cf9475c => generated 0 bytes in 1351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:29.778418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fbac1-c857-4d28-b512-7a022d0c5d12 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:29.783287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-759fbac1-c857-4d28-b512-7a022d0c5d12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:29.926728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fbac1-c857-4d28-b512-7a022d0c5d12 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:30.076254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:30.266510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f443a97-0933-4a80-86ec-128563e6ff28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:30.269573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f443a97-0933-4a80-86ec-128563e6ff28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:30.269914 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f443a97-0933-4a80-86ec-128563e6ff28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:30.270396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f443a97-0933-4a80-86ec-128563e6ff28 admin admin] PATH_INFO: `/v3/projects/3338e3a1145444b48b3c81ce59a65878` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:30.277920 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f443a97-0933-4a80-86ec-128563e6ff28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3338e3a1145444b48b3c81ce59a65878)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:30.285763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f443a97-0933-4a80-86ec-128563e6ff28 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:30.324363 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3554e3d-5563-4682-bda0-8a247dc7c111 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:30.326214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e3554e3d-5563-4682-bda0-8a247dc7c111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:30.375213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3554e3d-5563-4682-bda0-8a247dc7c111 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:30.423012 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04153a5-8535-4879-9aa6-68b0116cc586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:30.423751 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04153a5-8535-4879-9aa6-68b0116cc586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:30.424035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04153a5-8535-4879-9aa6-68b0116cc586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:30.424322 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04153a5-8535-4879-9aa6-68b0116cc586 admin admin] PATH_INFO: `/v3/projects/66cb11f81ae34332bd791aab09b3e201` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:30.430206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04153a5-8535-4879-9aa6-68b0116cc586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66cb11f81ae34332bd791aab09b3e201)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:30.447110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04153a5-8535-4879-9aa6-68b0116cc586 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:31.078347 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-8f443a97-0933-4a80-86ec-128563e6ff28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3338e3a1145444b48b3c81ce59a65878', 'request_id': 'req-8f443a97-0933-4a80-86ec-128563e6ff28'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:31.176692 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f04153a5-8535-4879-9aa6-68b0116cc586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66cb11f81ae34332bd791aab09b3e201', 'request_id': 'req-f04153a5-8535-4879-9aa6-68b0116cc586'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:31.341879 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-8f443a97-0933-4a80-86ec-128563e6ff28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3338e3a1145444b48b3c81ce59a65878', 'request_id': 'req-8f443a97-0933-4a80-86ec-128563e6ff28'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:31.365961 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-8f443a97-0933-4a80-86ec-128563e6ff28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3338e3a1145444b48b3c81ce59a65878', 'request_id': 'req-8f443a97-0933-4a80-86ec-128563e6ff28'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:31.427831 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-8f443a97-0933-4a80-86ec-128563e6ff28 admin admin] The token cache is being invalidate because project 3338e3a1145444b48b3c81ce59a65878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:30:31.431157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-8f443a97-0933-4a80-86ec-128563e6ff28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:31.441118 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-8f443a97-0933-4a80-86ec-128563e6ff28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:31.453787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 865/1721] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:30:29 2022] DELETE /identity/v3/projects/3338e3a1145444b48b3c81ce59a65878 => generated 0 bytes in 1677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:31.475080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8b60e-1de9-4ff4-a25d-3e464b9a3991 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:31.478171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8b60e-1de9-4ff4-a25d-3e464b9a3991 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:31.487676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8b60e-1de9-4ff4-a25d-3e464b9a3991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:31.559153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-b3c8b60e-1de9-4ff4-a25d-3e464b9a3991 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:31.565108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f04153a5-8535-4879-9aa6-68b0116cc586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66cb11f81ae34332bd791aab09b3e201', 'request_id': 'req-f04153a5-8535-4879-9aa6-68b0116cc586'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:31.568534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:31.571037 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b3c8b60e-1de9-4ff4-a25d-3e464b9a3991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:31.584577 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f04153a5-8535-4879-9aa6-68b0116cc586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66cb11f81ae34332bd791aab09b3e201', 'request_id': 'req-f04153a5-8535-4879-9aa6-68b0116cc586'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:31.653326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f04153a5-8535-4879-9aa6-68b0116cc586 admin admin] The token cache is being invalidate because project 66cb11f81ae34332bd791aab09b3e201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:30:31.655007 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f04153a5-8535-4879-9aa6-68b0116cc586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:31.671878 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f04153a5-8535-4879-9aa6-68b0116cc586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:31.678620 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 857/1722] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:30:30 2022] DELETE /identity/v3/projects/66cb11f81ae34332bd791aab09b3e201 => generated 0 bytes in 1356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:30:31.697353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a69e0-5997-4882-99c2-b75349f33d40 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:31.698714 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a69e0-5997-4882-99c2-b75349f33d40 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:31.700676 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a69e0-5997-4882-99c2-b75349f33d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:31.857665 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-f83a69e0-5997-4882-99c2-b75349f33d40 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:31.859505 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f83a69e0-5997-4882-99c2-b75349f33d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:31.960869 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 866/1723] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:31.963699 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68b23d-81b9-4407-94e3-222d5fc5338d None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:31.967437 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68b23d-81b9-4407-94e3-222d5fc5338d None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:31.967942 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68b23d-81b9-4407-94e3-222d5fc5338d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:32.085986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-ff68b23d-81b9-4407-94e3-222d5fc5338d None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:32.117304 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ff68b23d-81b9-4407-94e3-222d5fc5338d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:32.179205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 867/1724] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:32.190080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068022e-ab98-417e-9255-b1e839df16fc None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:32.198702 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068022e-ab98-417e-9255-b1e839df16fc None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:32.199374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068022e-ab98-417e-9255-b1e839df16fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:32.270770 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 858/1725] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 573 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:32.279648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a69e0-5997-4882-99c2-b75349f33d40 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:32.372056 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a69e0-5997-4882-99c2-b75349f33d40 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:32.385719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17974d0-ba4a-479a-a722-3e40e127c1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:32.388081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17974d0-ba4a-479a-a722-3e40e127c1ad admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:32.388901 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17974d0-ba4a-479a-a722-3e40e127c1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:32.390863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17974d0-ba4a-479a-a722-3e40e127c1ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:32.395073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17974d0-ba4a-479a-a722-3e40e127c1ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:30:32.395073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17974d0-ba4a-479a-a722-3e40e127c1ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:32.395489 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-b068022e-ab98-417e-9255-b1e839df16fc None None] MFA Rules not processed for user `e7bd32cb680e4d9aa9bbaa32c94e68de`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:32.397627 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b068022e-ab98-417e-9255-b1e839df16fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:32.398255 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17974d0-ba4a-479a-a722-3e40e127c1ad admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:32.465254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 859/1726] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:30:32.476812 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2b7d1-a058-41ea-b2db-c99e4b20ac64 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:32.481044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2b7d1-a058-41ea-b2db-c99e4b20ac64 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:32.482357 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2b7d1-a058-41ea-b2db-c99e4b20ac64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:32.572353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-34b2b7d1-a058-41ea-b2db-c99e4b20ac64 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:32.581213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-34b2b7d1-a058-41ea-b2db-c99e4b20ac64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:32.687120 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 860/1727] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:32.689068 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2b7d1-a058-41ea-b2db-c99e4b20ac64 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:32.771568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2b7d1-a058-41ea-b2db-c99e4b20ac64 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:32.802626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552f7f3-35ce-4e7b-bc27-8be96fcfad53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:32.804302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552f7f3-35ce-4e7b-bc27-8be96fcfad53 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:32.809974 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552f7f3-35ce-4e7b-bc27-8be96fcfad53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:32.810548 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552f7f3-35ce-4e7b-bc27-8be96fcfad53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:32.812843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552f7f3-35ce-4e7b-bc27-8be96fcfad53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:32.833704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552f7f3-35ce-4e7b-bc27-8be96fcfad53 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:32.883568 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 868/1728] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 695 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:32.888482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068022e-ab98-417e-9255-b1e839df16fc None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:32.906090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b068022e-ab98-417e-9255-b1e839df16fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:32.978096 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068022e-ab98-417e-9255-b1e839df16fc None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:32.998354 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94010be-f950-4e81-9ae1-b865a6b1a410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:33.001716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94010be-f950-4e81-9ae1-b865a6b1a410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:33.003478 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94010be-f950-4e81-9ae1-b865a6b1a410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:33.005565 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94010be-f950-4e81-9ae1-b865a6b1a410 admin admin] PATH_INFO: `/v3/projects/2f4f0c1d815b49318466c7518633b159` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:33.010620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94010be-f950-4e81-9ae1-b865a6b1a410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f4f0c1d815b49318466c7518633b159)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:33.016726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94010be-f950-4e81-9ae1-b865a6b1a410 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:33.097111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:33.173440 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 861/1729] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:30:32 2022] POST /identity/v3/projects => generated 379 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:30:33.175143 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552f7f3-35ce-4e7b-bc27-8be96fcfad53 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:33.432810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-b94010be-f950-4e81-9ae1-b865a6b1a410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f4f0c1d815b49318466c7518633b159', 'request_id': 'req-b94010be-f950-4e81-9ae1-b865a6b1a410'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:33.649684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552f7f3-35ce-4e7b-bc27-8be96fcfad53 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:33.713075 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-b94010be-f950-4e81-9ae1-b865a6b1a410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f4f0c1d815b49318466c7518633b159', 'request_id': 'req-b94010be-f950-4e81-9ae1-b865a6b1a410'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:33.746642 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-b94010be-f950-4e81-9ae1-b865a6b1a410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f4f0c1d815b49318466c7518633b159', 'request_id': 'req-b94010be-f950-4e81-9ae1-b865a6b1a410'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:33.812890 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-b94010be-f950-4e81-9ae1-b865a6b1a410 admin admin] The token cache is being invalidate because project 2f4f0c1d815b49318466c7518633b159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:30:33.832718 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-b94010be-f950-4e81-9ae1-b865a6b1a410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:33.839126 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-b94010be-f950-4e81-9ae1-b865a6b1a410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:30:33.854211 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 869/1730] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:30:32 2022] DELETE /identity/v3/projects/2f4f0c1d815b49318466c7518633b159 => generated 0 bytes in 970 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:33.856165 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94010be-f950-4e81-9ae1-b865a6b1a410 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:33.864429 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b94010be-f950-4e81-9ae1-b865a6b1a410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:34.110999 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e9a3f-31a4-4ca4-8dbe-d20b1bcddcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:34.113941 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e9a3f-31a4-4ca4-8dbe-d20b1bcddcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:34.114471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e9a3f-31a4-4ca4-8dbe-d20b1bcddcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:34.115241 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e9a3f-31a4-4ca4-8dbe-d20b1bcddcd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:34.116767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e9a3f-31a4-4ca4-8dbe-d20b1bcddcd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:30:34.122539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e9a3f-31a4-4ca4-8dbe-d20b1bcddcd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:34.133825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e9a3f-31a4-4ca4-8dbe-d20b1bcddcd8 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:34.227472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 862/1731] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 1053 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:30:34.230376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89727eca-7b50-4ccf-92e1-0581e68a3914 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:34.231455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89727eca-7b50-4ccf-92e1-0581e68a3914 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:34.232348 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89727eca-7b50-4ccf-92e1-0581e68a3914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:34.277213 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94010be-f950-4e81-9ae1-b865a6b1a410 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:34.318543 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22559f75-da8c-429f-9132-a1e163eb3ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:34.322292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22559f75-da8c-429f-9132-a1e163eb3ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:34.324519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22559f75-da8c-429f-9132-a1e163eb3ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:34.325502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22559f75-da8c-429f-9132-a1e163eb3ec2 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:34.330746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22559f75-da8c-429f-9132-a1e163eb3ec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:34.345679 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22559f75-da8c-429f-9132-a1e163eb3ec2 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:34.489531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-89727eca-7b50-4ccf-92e1-0581e68a3914 None None] MFA Rules not processed for user `f2cea4c08f324769bf6dcea58c9394b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:34.494400 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-89727eca-7b50-4ccf-92e1-0581e68a3914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:34.605322 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 870/1732] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:30:33 2022] POST /identity/v3/users => generated 290 bytes in 751 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:30:34.613876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c4ba9-2106-4e6e-8676-c19194e7ef60 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:34.615707 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c4ba9-2106-4e6e-8676-c19194e7ef60 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:34.616244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c4ba9-2106-4e6e-8676-c19194e7ef60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:34.777756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-712c4ba9-2106-4e6e-8676-c19194e7ef60 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:34.787867 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-712c4ba9-2106-4e6e-8676-c19194e7ef60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:34.800215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:34.824231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 871/1733] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:34.825414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c4ba9-2106-4e6e-8676-c19194e7ef60 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:34.837691 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-712c4ba9-2106-4e6e-8676-c19194e7ef60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:34.894714 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c4ba9-2106-4e6e-8676-c19194e7ef60 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:34.917214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb9ddf-9b28-42d3-813a-65bc8a4afb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:34.917982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb9ddf-9b28-42d3-813a-65bc8a4afb1b admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:34.921028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb9ddf-9b28-42d3-813a-65bc8a4afb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:34.921028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb9ddf-9b28-42d3-813a-65bc8a4afb1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:34.921028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb9ddf-9b28-42d3-813a-65bc8a4afb1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:34.926206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 863/1734] 10.222.0.83 () {58 vars in 1009 bytes} [Fri Sep 23 01:30:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 698 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:34.932460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89727eca-7b50-4ccf-92e1-0581e68a3914 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:34.943340 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb9ddf-9b28-42d3-813a-65bc8a4afb1b admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:35.005517 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89727eca-7b50-4ccf-92e1-0581e68a3914 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:35.037916 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa5748-ca99-402a-8587-9fe7fc17dca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:35.039016 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa5748-ca99-402a-8587-9fe7fc17dca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:35.039503 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa5748-ca99-402a-8587-9fe7fc17dca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:35.040101 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa5748-ca99-402a-8587-9fe7fc17dca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:35.041146 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa5748-ca99-402a-8587-9fe7fc17dca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:35.044370 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa5748-ca99-402a-8587-9fe7fc17dca8 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:35.136703 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 864/1735] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:30:35.148189 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc69038-45e3-470d-9185-e2ccbb624eea None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:35.148762 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc69038-45e3-470d-9185-e2ccbb624eea None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:35.149309 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc69038-45e3-470d-9185-e2ccbb624eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:35.266514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-6fc69038-45e3-470d-9185-e2ccbb624eea None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:35.288325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6fc69038-45e3-470d-9185-e2ccbb624eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:35.350553 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 865/1736] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:35.352335 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc69038-45e3-470d-9185-e2ccbb624eea None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:35.378677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc69038-45e3-470d-9185-e2ccbb624eea None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:35.400489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaed1f-6b8d-4ac8-94c2-558ceaf5130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:35.404612 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaed1f-6b8d-4ac8-94c2-558ceaf5130a admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:35.405681 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaed1f-6b8d-4ac8-94c2-558ceaf5130a admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:35.407964 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaed1f-6b8d-4ac8-94c2-558ceaf5130a admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:35.411064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbaed1f-6b8d-4ac8-94c2-558ceaf5130a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:35.416273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbaed1f-6b8d-4ac8-94c2-558ceaf5130a admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:35.480042 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 866/1737] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:30:35.489331 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaed1f-6b8d-4ac8-94c2-558ceaf5130a admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:35.530937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 872/1738] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:30:34 2022] POST /identity/v3/projects => generated 363 bytes in 706 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:30:35.532668 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb9ddf-9b28-42d3-813a-65bc8a4afb1b admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:35.587282 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaed1f-6b8d-4ac8-94c2-558ceaf5130a admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:35.814966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb9ddf-9b28-42d3-813a-65bc8a4afb1b admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:35.849316 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8e87b-48c5-4c5a-9f04-d5378977c08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:35.852165 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8e87b-48c5-4c5a-9f04-d5378977c08b admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:35.857709 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8e87b-48c5-4c5a-9f04-d5378977c08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:35.858959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8e87b-48c5-4c5a-9f04-d5378977c08b admin admin] PATH_INFO: `/v3/projects/da8196d722eb4dbd8263115de912976b/users/b2e721808b2745bf943c3b21f517d09d/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:35.906085 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e546ed-44f0-4130-b13b-97e987f7dd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:35.908941 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e546ed-44f0-4130-b13b-97e987f7dd85 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:35.909463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e546ed-44f0-4130-b13b-97e987f7dd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:35.915419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e546ed-44f0-4130-b13b-97e987f7dd85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:35.916875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e546ed-44f0-4130-b13b-97e987f7dd85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:30:35.917738 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e546ed-44f0-4130-b13b-97e987f7dd85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:35.922355 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e546ed-44f0-4130-b13b-97e987f7dd85 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:35.937718 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8e87b-48c5-4c5a-9f04-d5378977c08b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da8196d722eb4dbd8263115de912976b, user_id=b2e721808b2745bf943c3b21f517d09d, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:35.958688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8e87b-48c5-4c5a-9f04-d5378977c08b admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:35.969498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 867/1739] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:30:35.974618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e546ed-44f0-4130-b13b-97e987f7dd85 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:36.045146 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e546ed-44f0-4130-b13b-97e987f7dd85 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:36.058812 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96305e3f-00ba-4ac0-ad4e-d55ae7f80f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:36.062702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96305e3f-00ba-4ac0-ad4e-d55ae7f80f09 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:36.063353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96305e3f-00ba-4ac0-ad4e-d55ae7f80f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:36.074198 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96305e3f-00ba-4ac0-ad4e-d55ae7f80f09 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:36.074198 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96305e3f-00ba-4ac0-ad4e-d55ae7f80f09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:36.074198 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96305e3f-00ba-4ac0-ad4e-d55ae7f80f09 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:36.213040 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 873/1740] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:30:35 2022] PUT /identity/v3/projects/da8196d722eb4dbd8263115de912976b/users/b2e721808b2745bf943c3b21f517d09d/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:36.215879 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8e87b-48c5-4c5a-9f04-d5378977c08b admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:36.219848 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f8d8e87b-48c5-4c5a-9f04-d5378977c08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:36.280117 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 868/1741] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:30:35 2022] POST /identity/v3/users => generated 282 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:30:36.285438 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96305e3f-00ba-4ac0-ad4e-d55ae7f80f09 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:36.378631 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96305e3f-00ba-4ac0-ad4e-d55ae7f80f09 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:36.676948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a57a34-b4b1-4c3f-a344-d179b303069d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:36.688957 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a57a34-b4b1-4c3f-a344-d179b303069d admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:36.688957 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a57a34-b4b1-4c3f-a344-d179b303069d admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:36.689382 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a57a34-b4b1-4c3f-a344-d179b303069d admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:36.690782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a57a34-b4b1-4c3f-a344-d179b303069d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:36.695122 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a57a34-b4b1-4c3f-a344-d179b303069d admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:36.832456 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8e87b-48c5-4c5a-9f04-d5378977c08b admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:36.863139 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263e961-dcd6-4866-8193-ab7628148dc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526c7ad227943d1a2bba7b5e2e039e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:36.863139 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263e961-dcd6-4866-8193-ab7628148dc4 service swift] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:36.863139 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263e961-dcd6-4866-8193-ab7628148dc4 service swift] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:36.863139 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263e961-dcd6-4866-8193-ab7628148dc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:36.908656 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 869/1742] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:30:36 2022] POST /identity/v3/projects => generated 383 bytes in 628 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:30:36.915994 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a79f68-e5a4-4bb9-a18b-cb60d1b89ecc None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:36.922402 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a79f68-e5a4-4bb9-a18b-cb60d1b89ecc None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:36.929062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a79f68-e5a4-4bb9-a18b-cb60d1b89ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:37.155042 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-b9a79f68-e5a4-4bb9-a18b-cb60d1b89ecc None None] MFA Rules not processed for user `b2e721808b2745bf943c3b21f517d09d`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:37.174109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b9a79f68-e5a4-4bb9-a18b-cb60d1b89ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:37.230849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263e961-dcd6-4866-8193-ab7628148dc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:37.233716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263e961-dcd6-4866-8193-ab7628148dc4 service swift] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:37.300601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 874/1743] 10.222.0.83 () {60 vars in 1384 bytes} [Fri Sep 23 01:30:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1083 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 01:30:37.304297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263e961-dcd6-4866-8193-ab7628148dc4 service swift] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:37.375978 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263e961-dcd6-4866-8193-ab7628148dc4 service swift] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:37.653336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 870/1744] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 733 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:37.653336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a79f68-e5a4-4bb9-a18b-cb60d1b89ecc None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:37.663325 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:37.780375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f92e5-8645-452e-8dd7-5993df95b5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:37.781768 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f92e5-8645-452e-8dd7-5993df95b5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:37.782003 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f92e5-8645-452e-8dd7-5993df95b5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:37.782404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f92e5-8645-452e-8dd7-5993df95b5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:37.800651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f92e5-8645-452e-8dd7-5993df95b5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:37.813912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f92e5-8645-452e-8dd7-5993df95b5c6 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:37.957276 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 875/1745] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 657 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:30:37.967262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a79f68-e5a4-4bb9-a18b-cb60d1b89ecc None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:37.973299 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f92e5-8645-452e-8dd7-5993df95b5c6 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:37.991873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bfba3-e3ab-46bf-82a7-340922476c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:37.991873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bfba3-e3ab-46bf-82a7-340922476c28 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:37.992784 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bfba3-e3ab-46bf-82a7-340922476c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:37.992784 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bfba3-e3ab-46bf-82a7-340922476c28 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:37.995747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bfba3-e3ab-46bf-82a7-340922476c28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:38.004566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bfba3-e3ab-46bf-82a7-340922476c28 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:38.085649 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f92e5-8645-452e-8dd7-5993df95b5c6 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:38.115215 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6dc82-ff63-4705-a13c-dd8e494b9e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:38.121189 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6dc82-ff63-4705-a13c-dd8e494b9e9d admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:38.121743 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6dc82-ff63-4705-a13c-dd8e494b9e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:38.125867 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6dc82-ff63-4705-a13c-dd8e494b9e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:38.127600 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6dc82-ff63-4705-a13c-dd8e494b9e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:38.154652 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6dc82-ff63-4705-a13c-dd8e494b9e9d admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:38.221049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 871/1746] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:30:37 2022] POST /identity/v3/users => generated 292 bytes in 572 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:30:38.223385 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bfba3-e3ab-46bf-82a7-340922476c28 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:38.292512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bfba3-e3ab-46bf-82a7-340922476c28 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:38.399851 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd1544-55d1-43cc-b24b-c45b13d223bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:38.413116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd1544-55d1-43cc-b24b-c45b13d223bb admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:38.415209 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd1544-55d1-43cc-b24b-c45b13d223bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:38.418645 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd1544-55d1-43cc-b24b-c45b13d223bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:38.424169 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd1544-55d1-43cc-b24b-c45b13d223bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:38.428583 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd1544-55d1-43cc-b24b-c45b13d223bb admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:38.536835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 876/1747] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:30:37 2022] POST /identity/v3/projects => generated 379 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:30:38.536835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6dc82-ff63-4705-a13c-dd8e494b9e9d admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:38.636456 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 872/1748] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:30:38.636456 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb6a90-809d-4568-a44a-b1d5fd1995b1 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:38.636456 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb6a90-809d-4568-a44a-b1d5fd1995b1 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:38.636456 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb6a90-809d-4568-a44a-b1d5fd1995b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:38.701206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-51fb6a90-809d-4568-a44a-b1d5fd1995b1 None None] MFA Rules not processed for user `67b89827871f45738162611b31a23509`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:38.710119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-51fb6a90-809d-4568-a44a-b1d5fd1995b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:39.011680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6dc82-ff63-4705-a13c-dd8e494b9e9d admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:39.033311 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:39.047617 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd01c8f-54e0-444d-add6-6c6ea64bf2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:39.047617 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd01c8f-54e0-444d-add6-6c6ea64bf2ac admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:39.048054 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd01c8f-54e0-444d-add6-6c6ea64bf2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:39.048506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd01c8f-54e0-444d-add6-6c6ea64bf2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:39.051949 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd01c8f-54e0-444d-add6-6c6ea64bf2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:39.071442 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd01c8f-54e0-444d-add6-6c6ea64bf2ac admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:39.144625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 877/1749] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 626 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:30:39.146292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd01c8f-54e0-444d-add6-6c6ea64bf2ac admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:39.181396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd01c8f-54e0-444d-add6-6c6ea64bf2ac admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:39.210184 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6078b9-2f8d-4a3d-ace7-9fd843ea5fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:39.212150 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6078b9-2f8d-4a3d-ace7-9fd843ea5fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:39.213729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6078b9-2f8d-4a3d-ace7-9fd843ea5fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:39.216713 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6078b9-2f8d-4a3d-ace7-9fd843ea5fa1 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:39.221645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6078b9-2f8d-4a3d-ace7-9fd843ea5fa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:39.239033 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6078b9-2f8d-4a3d-ace7-9fd843ea5fa1 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:39.259007 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 873/1750] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 667 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:39.264442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb6a90-809d-4568-a44a-b1d5fd1995b1 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:39.370848 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb6a90-809d-4568-a44a-b1d5fd1995b1 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:39.411705 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950549a-0a30-4cb6-b5f3-9920a1d98554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:39.424075 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950549a-0a30-4cb6-b5f3-9920a1d98554 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:39.424989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950549a-0a30-4cb6-b5f3-9920a1d98554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:39.426746 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950549a-0a30-4cb6-b5f3-9920a1d98554 admin admin] PATH_INFO: `/v3/projects/ef90be6b0d5144d0ab398226290e4bd7/users/1133018a9f484e3c88003c3c3454398d/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:39.499097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950549a-0a30-4cb6-b5f3-9920a1d98554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef90be6b0d5144d0ab398226290e4bd7, user_id=1133018a9f484e3c88003c3c3454398d, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:39.532939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950549a-0a30-4cb6-b5f3-9920a1d98554 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:39.543825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 878/1751] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:30:39 2022] POST /identity/v3/users => generated 296 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:30:39.546656 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb493e5-02e0-42ad-b5d5-ed6f3bad0bca None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:39.550826 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb493e5-02e0-42ad-b5d5-ed6f3bad0bca None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:39.552468 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb493e5-02e0-42ad-b5d5-ed6f3bad0bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:39.591316 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-abb493e5-02e0-42ad-b5d5-ed6f3bad0bca None None] MFA Rules not processed for user `be2b2806686c4a15b1ace8b6245c4e28`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:39.602969 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-abb493e5-02e0-42ad-b5d5-ed6f3bad0bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:39.832451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 879/1752] 10.222.0.88 () {58 vars in 1015 bytes} [Fri Sep 23 01:30:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:39.833787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb493e5-02e0-42ad-b5d5-ed6f3bad0bca None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:39.856247 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb493e5-02e0-42ad-b5d5-ed6f3bad0bca None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:39.896837 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d94374-9f56-4f3d-bb79-ee76fa7d55a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:39.900525 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d94374-9f56-4f3d-bb79-ee76fa7d55a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:39.900525 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d94374-9f56-4f3d-bb79-ee76fa7d55a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:39.900916 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d94374-9f56-4f3d-bb79-ee76fa7d55a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:39.901688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d94374-9f56-4f3d-bb79-ee76fa7d55a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:39.913459 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d94374-9f56-4f3d-bb79-ee76fa7d55a3 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:39.960608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 880/1753] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:30:39.962572 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d94374-9f56-4f3d-bb79-ee76fa7d55a3 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:39.995478 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d94374-9f56-4f3d-bb79-ee76fa7d55a3 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:40.016612 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ad5db-b51c-4184-841a-78945d699500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:40.019487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ad5db-b51c-4184-841a-78945d699500 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:40.019487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ad5db-b51c-4184-841a-78945d699500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:40.019487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ad5db-b51c-4184-841a-78945d699500 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:40.021361 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ad5db-b51c-4184-841a-78945d699500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:40.050480 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ad5db-b51c-4184-841a-78945d699500 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:40.138242 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 881/1754] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:30:40.141090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ad5db-b51c-4184-841a-78945d699500 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:40.144624 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-697ad5db-b51c-4184-841a-78945d699500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:40.189980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 874/1755] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:30:39 2022] PUT /identity/v3/projects/ef90be6b0d5144d0ab398226290e4bd7/users/1133018a9f484e3c88003c3c3454398d/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 919 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:40.189980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950549a-0a30-4cb6-b5f3-9920a1d98554 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:40.191920 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ad5db-b51c-4184-841a-78945d699500 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:40.531180 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdba43-db9b-4d68-8128-c7988388b6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:40.544625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdba43-db9b-4d68-8128-c7988388b6af service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:40.545882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdba43-db9b-4d68-8128-c7988388b6af service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:40.548506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdba43-db9b-4d68-8128-c7988388b6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:40.627651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdba43-db9b-4d68-8128-c7988388b6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:40.630861 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdba43-db9b-4d68-8128-c7988388b6af service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:40.716181 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 882/1756] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:30:40.717798 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdba43-db9b-4d68-8128-c7988388b6af service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:40.874252 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950549a-0a30-4cb6-b5f3-9920a1d98554 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:40.896167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa286112-cd57-4bd5-8a34-14d2919eddb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:40.898374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa286112-cd57-4bd5-8a34-14d2919eddb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:40.899093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa286112-cd57-4bd5-8a34-14d2919eddb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:40.932488 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa286112-cd57-4bd5-8a34-14d2919eddb8 admin admin] PATH_INFO: `/v3/projects/78c57e41f4924046a74d3d7a1bd93a42/users/3be57390110b4a108f6429dd921b3384/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:40.980169 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa286112-cd57-4bd5-8a34-14d2919eddb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c57e41f4924046a74d3d7a1bd93a42, user_id=3be57390110b4a108f6429dd921b3384, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:40.986070 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa286112-cd57-4bd5-8a34-14d2919eddb8 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:41.073786 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdba43-db9b-4d68-8128-c7988388b6af service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:41.089814 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbbf26-f554-4dbc-a785-3eae101705f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:41.090532 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbbf26-f554-4dbc-a785-3eae101705f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:41.090872 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbbf26-f554-4dbc-a785-3eae101705f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:41.091172 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbbf26-f554-4dbc-a785-3eae101705f6 admin admin] PATH_INFO: `/v3/projects/a8d62052a86346d1897501b92dede736/users/d2f2399a5af84edc8a6a08bcc529b471/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:41.143372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbbf26-f554-4dbc-a785-3eae101705f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d62052a86346d1897501b92dede736, user_id=d2f2399a5af84edc8a6a08bcc529b471, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:41.145785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbbf26-f554-4dbc-a785-3eae101705f6 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:41.198537 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 875/1757] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:30:40 2022] PUT /identity/v3/projects/78c57e41f4924046a74d3d7a1bd93a42/users/3be57390110b4a108f6429dd921b3384/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 1018 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:41.200473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7afae5-d947-4bdd-8b43-17c502f04502 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:41.200981 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7afae5-d947-4bdd-8b43-17c502f04502 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:41.201424 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7afae5-d947-4bdd-8b43-17c502f04502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:41.300867 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 883/1758] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:30:40 2022] PUT /identity/v3/projects/a8d62052a86346d1897501b92dede736/users/d2f2399a5af84edc8a6a08bcc529b471/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:41.303080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a7254-2637-4c04-8353-f15121bd24bd None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:41.303787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a7254-2637-4c04-8353-f15121bd24bd None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:41.304349 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a7254-2637-4c04-8353-f15121bd24bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:41.336404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-ad7afae5-d947-4bdd-8b43-17c502f04502 None None] MFA Rules not processed for user `1133018a9f484e3c88003c3c3454398d`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:41.340467 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ad7afae5-d947-4bdd-8b43-17c502f04502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:41.397525 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-cb4a7254-2637-4c04-8353-f15121bd24bd None None] MFA Rules not processed for user `3be57390110b4a108f6429dd921b3384`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:41.402325 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-cb4a7254-2637-4c04-8353-f15121bd24bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:41.656035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 884/1759] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:41.659784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a7254-2637-4c04-8353-f15121bd24bd None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:41.700052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 876/1760] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:41.703866 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7afae5-d947-4bdd-8b43-17c502f04502 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:41.880078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:42.086628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a7254-2637-4c04-8353-f15121bd24bd None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:42.101566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7afae5-d947-4bdd-8b43-17c502f04502 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:42.113269 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d171ee-0c0b-4781-9009-250754d18fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:42.114991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d171ee-0c0b-4781-9009-250754d18fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:42.118078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d171ee-0c0b-4781-9009-250754d18fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:42.119681 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d171ee-0c0b-4781-9009-250754d18fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:42.121077 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d171ee-0c0b-4781-9009-250754d18fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:42.123917 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d171ee-0c0b-4781-9009-250754d18fa7 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:42.125196 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ecbfd-69c2-48ee-8825-983ebc827c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:42.125925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ecbfd-69c2-48ee-8825-983ebc827c2c admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:42.126347 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ecbfd-69c2-48ee-8825-983ebc827c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:42.126925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ecbfd-69c2-48ee-8825-983ebc827c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:42.127894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ecbfd-69c2-48ee-8825-983ebc827c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:42.131638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ecbfd-69c2-48ee-8825-983ebc827c2c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:42.156880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 885/1761] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 500 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:30:42.159044 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d171ee-0c0b-4781-9009-250754d18fa7 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:42.215492 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d171ee-0c0b-4781-9009-250754d18fa7 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:42.226409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594347f8-6871-4c90-8578-890b91cbeb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:42.226409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594347f8-6871-4c90-8578-890b91cbeb3d admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:42.226409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594347f8-6871-4c90-8578-890b91cbeb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:42.226409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594347f8-6871-4c90-8578-890b91cbeb3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:42.227456 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594347f8-6871-4c90-8578-890b91cbeb3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:42.234672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594347f8-6871-4c90-8578-890b91cbeb3d admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:42.375633 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 877/1762] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:30:41 2022] POST /identity/v3/projects => generated 385 bytes in 674 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:30:42.379686 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ecbfd-69c2-48ee-8825-983ebc827c2c admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:42.402548 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:42.438710 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 886/1763] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:30:42 2022] POST /identity/v3/projects => generated 363 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:30:42.439254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594347f8-6871-4c90-8578-890b91cbeb3d admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:42.781825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ecbfd-69c2-48ee-8825-983ebc827c2c admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:42.978865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594347f8-6871-4c90-8578-890b91cbeb3d admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:43.015881 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0be544-a488-4a35-b541-742c781d9c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:43.016966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0be544-a488-4a35-b541-742c781d9c04 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:43.021894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0be544-a488-4a35-b541-742c781d9c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:43.022405 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0be544-a488-4a35-b541-742c781d9c04 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:43.023817 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0be544-a488-4a35-b541-742c781d9c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:43.040913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0be544-a488-4a35-b541-742c781d9c04 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:43.107375 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae1dc0-e2e8-42ec-ba5e-b552dd2d6a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:43.109220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae1dc0-e2e8-42ec-ba5e-b552dd2d6a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:43.109745 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae1dc0-e2e8-42ec-ba5e-b552dd2d6a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:43.110481 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae1dc0-e2e8-42ec-ba5e-b552dd2d6a01 admin admin] PATH_INFO: `/v3/projects/a8d62052a86346d1897501b92dede736/users/d2f2399a5af84edc8a6a08bcc529b471/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:43.141290 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae1dc0-e2e8-42ec-ba5e-b552dd2d6a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d62052a86346d1897501b92dede736, user_id=d2f2399a5af84edc8a6a08bcc529b471, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:43.147040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae1dc0-e2e8-42ec-ba5e-b552dd2d6a01 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:43.215292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 878/1764] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:30:42 2022] PUT /identity/v3/projects/a8d62052a86346d1897501b92dede736/users/d2f2399a5af84edc8a6a08bcc529b471/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:43.216965 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae1dc0-e2e8-42ec-ba5e-b552dd2d6a01 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:43.501753 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 887/1765] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:30:42 2022] POST /identity/v3/users => generated 299 bytes in 1058 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:30:43.510768 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9b45d-ae71-488f-99bb-4d135d948708 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:43.516913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9b45d-ae71-488f-99bb-4d135d948708 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:43.516913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9b45d-ae71-488f-99bb-4d135d948708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:43.608031 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae1dc0-e2e8-42ec-ba5e-b552dd2d6a01 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:43.650968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f194540-359b-468d-902e-2c862a6272b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:43.654359 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194540-359b-468d-902e-2c862a6272b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:43.656297 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194540-359b-468d-902e-2c862a6272b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:43.657448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194540-359b-468d-902e-2c862a6272b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:43.659538 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f194540-359b-468d-902e-2c862a6272b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:43.671976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-61d9b45d-ae71-488f-99bb-4d135d948708 None None] MFA Rules not processed for user `d2f2399a5af84edc8a6a08bcc529b471`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:43.682351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f194540-359b-468d-902e-2c862a6272b2 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:43.697155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-61d9b45d-ae71-488f-99bb-4d135d948708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:43.982545 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 879/1766] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:30:43 2022] POST /identity/v3/users => generated 288 bytes in 766 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:30:43.984564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f194540-359b-468d-902e-2c862a6272b2 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:44.083285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f194540-359b-468d-902e-2c862a6272b2 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:44.112292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83847611-daa8-40cc-9396-4278fd1010df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:44.113191 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83847611-daa8-40cc-9396-4278fd1010df admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:44.113679 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83847611-daa8-40cc-9396-4278fd1010df admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:44.114156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83847611-daa8-40cc-9396-4278fd1010df admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:44.118657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83847611-daa8-40cc-9396-4278fd1010df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:44.121916 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83847611-daa8-40cc-9396-4278fd1010df admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:44.206298 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 888/1767] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 697 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:44.206298 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9b45d-ae71-488f-99bb-4d135d948708 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:44.220413 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 880/1768] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:30:44.222942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83847611-daa8-40cc-9396-4278fd1010df admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:44.250236 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9b45d-ae71-488f-99bb-4d135d948708 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:44.277875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85572947-f5df-4596-9555-a54258b9b6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:44.282820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85572947-f5df-4596-9555-a54258b9b6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:44.283631 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85572947-f5df-4596-9555-a54258b9b6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:44.283790 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85572947-f5df-4596-9555-a54258b9b6c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:44.284676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85572947-f5df-4596-9555-a54258b9b6c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:44.289181 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85572947-f5df-4596-9555-a54258b9b6c1 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:44.297968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83847611-daa8-40cc-9396-4278fd1010df admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:44.361651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e7898-66aa-45c9-b08f-07fbfe481bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:44.361651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e7898-66aa-45c9-b08f-07fbfe481bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:44.361651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e7898-66aa-45c9-b08f-07fbfe481bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:44.361651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e7898-66aa-45c9-b08f-07fbfe481bd6 admin admin] PATH_INFO: `/v3/projects/64f0205f28e9443b8975b28be5711a84/users/491a162232bc4fce9f3d8987bb46af4e/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:44.396700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 889/1769] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:30:44.397700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85572947-f5df-4596-9555-a54258b9b6c1 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:44.399914 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-85572947-f5df-4596-9555-a54258b9b6c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:44.469289 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e7898-66aa-45c9-b08f-07fbfe481bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f0205f28e9443b8975b28be5711a84, user_id=491a162232bc4fce9f3d8987bb46af4e, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:44.469289 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e7898-66aa-45c9-b08f-07fbfe481bd6 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:44.614071 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 881/1770] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:30:44 2022] PUT /identity/v3/projects/64f0205f28e9443b8975b28be5711a84/users/491a162232bc4fce9f3d8987bb46af4e/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:44.615045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e7898-66aa-45c9-b08f-07fbfe481bd6 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:44.793004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:44.815354 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:44.830984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85572947-f5df-4596-9555-a54258b9b6c1 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:44.907460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e7898-66aa-45c9-b08f-07fbfe481bd6 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:44.925277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83406ced-73f1-4c5d-93b1-9bbecfd1b4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:44.927414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83406ced-73f1-4c5d-93b1-9bbecfd1b4e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:44.928074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83406ced-73f1-4c5d-93b1-9bbecfd1b4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:44.929006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83406ced-73f1-4c5d-93b1-9bbecfd1b4e0 admin admin] PATH_INFO: `/v3/projects/3ffbadd7318946f98b06ba9d133b0211/users/3ba2acad97014f949a726abe6b53a3e4/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:44.985371 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83406ced-73f1-4c5d-93b1-9bbecfd1b4e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ffbadd7318946f98b06ba9d133b0211, user_id=3ba2acad97014f949a726abe6b53a3e4, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:44.994942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83406ced-73f1-4c5d-93b1-9bbecfd1b4e0 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:45.191903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 882/1771] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:30:44 2022] PUT /identity/v3/projects/3ffbadd7318946f98b06ba9d133b0211/users/3ba2acad97014f949a726abe6b53a3e4/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:45.196466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83406ced-73f1-4c5d-93b1-9bbecfd1b4e0 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:45.299783 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c995d99-763e-4dbb-bb12-f249d7a802db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:45.303456 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c995d99-763e-4dbb-bb12-f249d7a802db service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:45.303926 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c995d99-763e-4dbb-bb12-f249d7a802db service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:45.306303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c995d99-763e-4dbb-bb12-f249d7a802db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:45.631757 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83406ced-73f1-4c5d-93b1-9bbecfd1b4e0 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:45.663790 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c995d99-763e-4dbb-bb12-f249d7a802db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:45.673660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c995d99-763e-4dbb-bb12-f249d7a802db service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:45.679102 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e69c97-8d22-48c4-a93b-14851f702750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:45.680815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e69c97-8d22-48c4-a93b-14851f702750 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:45.682115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e69c97-8d22-48c4-a93b-14851f702750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:45.683239 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e69c97-8d22-48c4-a93b-14851f702750 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:45.685176 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e69c97-8d22-48c4-a93b-14851f702750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:45.690424 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e69c97-8d22-48c4-a93b-14851f702750 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:45.728359 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 890/1772] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 1331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:30:45.729165 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c995d99-763e-4dbb-bb12-f249d7a802db service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:45.764596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 883/1773] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 570 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:30:45.767553 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e69c97-8d22-48c4-a93b-14851f702750 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:45.798149 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c995d99-763e-4dbb-bb12-f249d7a802db service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:45.851360 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e69c97-8d22-48c4-a93b-14851f702750 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:45.862542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f59d9-283e-4761-b6d6-787a518792a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:45.870161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f59d9-283e-4761-b6d6-787a518792a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:45.870526 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f59d9-283e-4761-b6d6-787a518792a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:45.870832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f59d9-283e-4761-b6d6-787a518792a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:45.871563 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f59d9-283e-4761-b6d6-787a518792a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:45.873337 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f59d9-283e-4761-b6d6-787a518792a5 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:45.897669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef8e87-d127-4e37-ab62-f4de16e2a04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:45.897669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef8e87-d127-4e37-ab62-f4de16e2a04f admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:45.897669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef8e87-d127-4e37-ab62-f4de16e2a04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:45.897669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef8e87-d127-4e37-ab62-f4de16e2a04f admin admin] PATH_INFO: `/v3/projects/64f0205f28e9443b8975b28be5711a84/users/491a162232bc4fce9f3d8987bb46af4e/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:45.898131 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef8e87-d127-4e37-ab62-f4de16e2a04f admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f0205f28e9443b8975b28be5711a84, user_id=491a162232bc4fce9f3d8987bb46af4e, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:45.902377 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef8e87-d127-4e37-ab62-f4de16e2a04f admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:45.932743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 884/1774] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:30:45 2022] PUT /identity/v3/projects/64f0205f28e9443b8975b28be5711a84/users/491a162232bc4fce9f3d8987bb46af4e/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:45.935494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5c28c-275c-4555-88fd-5c362aeded48 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:45.935901 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5c28c-275c-4555-88fd-5c362aeded48 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:45.936256 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5c28c-275c-4555-88fd-5c362aeded48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:46.023668 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-d3a5c28c-275c-4555-88fd-5c362aeded48 None None] MFA Rules not processed for user `491a162232bc4fce9f3d8987bb46af4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:46.026982 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-d3a5c28c-275c-4555-88fd-5c362aeded48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:46.042574 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 891/1775] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:30:46.043207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f59d9-283e-4761-b6d6-787a518792a5 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:46.130793 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f59d9-283e-4761-b6d6-787a518792a5 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:46.430125 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d4565-5b59-4d2b-94d1-620db33405b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:46.432605 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d4565-5b59-4d2b-94d1-620db33405b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:46.434830 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d4565-5b59-4d2b-94d1-620db33405b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:46.445550 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d4565-5b59-4d2b-94d1-620db33405b4 admin admin] PATH_INFO: `/v3/projects/3ffbadd7318946f98b06ba9d133b0211/users/3ba2acad97014f949a726abe6b53a3e4/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:46.447053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d4565-5b59-4d2b-94d1-620db33405b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ffbadd7318946f98b06ba9d133b0211, user_id=3ba2acad97014f949a726abe6b53a3e4, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:46.452611 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d4565-5b59-4d2b-94d1-620db33405b4 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:46.455897 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 885/1776] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 522 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:46.475437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5c28c-275c-4555-88fd-5c362aeded48 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:46.478349 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-d3a5c28c-275c-4555-88fd-5c362aeded48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:46.569365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 892/1777] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:30:46 2022] PUT /identity/v3/projects/3ffbadd7318946f98b06ba9d133b0211/users/3ba2acad97014f949a726abe6b53a3e4/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:30:46.587000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f07634-e3b4-40d7-9a8e-8ae1b0412ef5 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:46.587408 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f07634-e3b4-40d7-9a8e-8ae1b0412ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:46.588097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f07634-e3b4-40d7-9a8e-8ae1b0412ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:46.701174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-85f07634-e3b4-40d7-9a8e-8ae1b0412ef5 None None] MFA Rules not processed for user `3ba2acad97014f949a726abe6b53a3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:46.704526 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-85f07634-e3b4-40d7-9a8e-8ae1b0412ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:47.106938 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5c28c-275c-4555-88fd-5c362aeded48 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:47.288366 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 893/1778] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:30:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 697 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:30:47.562935 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2bcc3-825a-4a25-b2bb-ca6738e42df4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:47.571521 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2bcc3-825a-4a25-b2bb-ca6738e42df4 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:47.571521 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2bcc3-825a-4a25-b2bb-ca6738e42df4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:47.571521 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2bcc3-825a-4a25-b2bb-ca6738e42df4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:47.946683 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2bcc3-825a-4a25-b2bb-ca6738e42df4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:47.950003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2bcc3-825a-4a25-b2bb-ca6738e42df4 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:48.061739 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 886/1779] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 1557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:30:48.385582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f07634-e3b4-40d7-9a8e-8ae1b0412ef5 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:48.419792 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f07634-e3b4-40d7-9a8e-8ae1b0412ef5 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:48.432922 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44d21d-aad7-42dc-a3cf-37794f7250e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:48.435485 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44d21d-aad7-42dc-a3cf-37794f7250e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:48.437274 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44d21d-aad7-42dc-a3cf-37794f7250e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:48.438367 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44d21d-aad7-42dc-a3cf-37794f7250e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:48.473698 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44d21d-aad7-42dc-a3cf-37794f7250e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:48.490285 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44d21d-aad7-42dc-a3cf-37794f7250e4 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:48.538467 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 894/1780] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:30:48.913531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:49.225912 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:49.256768 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2bcc3-825a-4a25-b2bb-ca6738e42df4 service cinder] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:49.349228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2bcc3-825a-4a25-b2bb-ca6738e42df4 service cinder] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:49.385587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50eb28-e348-4679-8592-09034d36ef6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:49.393649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50eb28-e348-4679-8592-09034d36ef6c service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:49.394786 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50eb28-e348-4679-8592-09034d36ef6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:49.405194 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50eb28-e348-4679-8592-09034d36ef6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:49.788415 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50eb28-e348-4679-8592-09034d36ef6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:49.797970 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50eb28-e348-4679-8592-09034d36ef6c service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:49.914463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 887/1781] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:30:52.010400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44d21d-aad7-42dc-a3cf-37794f7250e4 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:52.043618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44d21d-aad7-42dc-a3cf-37794f7250e4 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:52.060422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7934705-11d7-41aa-af68-ded1c9608aa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:52.062064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7934705-11d7-41aa-af68-ded1c9608aa1 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:52.062539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7934705-11d7-41aa-af68-ded1c9608aa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:52.063054 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7934705-11d7-41aa-af68-ded1c9608aa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:52.105048 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98988811-3064-453e-86a2-d38b77d6cecf None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:52.108807 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98988811-3064-453e-86a2-d38b77d6cecf None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:52.110550 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98988811-3064-453e-86a2-d38b77d6cecf None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:52.114096 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 888/1782] 10.222.0.83 () {54 vars in 921 bytes} [Fri Sep 23 01:30:52 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:30:52.188583 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:52.371442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:52.375939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6a278-3ba5-44dd-9ca5-8eb684582c6b None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:52.376792 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6a278-3ba5-44dd-9ca5-8eb684582c6b None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:52.377492 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6a278-3ba5-44dd-9ca5-8eb684582c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:52.453572 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7934705-11d7-41aa-af68-ded1c9608aa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:52.468641 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7934705-11d7-41aa-af68-ded1c9608aa1 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:52.494964 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-7ec6a278-3ba5-44dd-9ca5-8eb684582c6b None None] MFA Rules not processed for user `824648d693af4b44ae5df853a3d258f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:52.506147 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-7ec6a278-3ba5-44dd-9ca5-8eb684582c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:52.535431 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 895/1783] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:30:52.876728 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 889/1784] 10.222.0.83 () {58 vars in 1018 bytes} [Fri Sep 23 01:30:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:54.001517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b860b-adf7-443d-b1c0-5f697af61671 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:54.003365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b860b-adf7-443d-b1c0-5f697af61671 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:54.003514 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b860b-adf7-443d-b1c0-5f697af61671 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:54.007200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 896/1785] 10.222.0.83 () {54 vars in 921 bytes} [Fri Sep 23 01:30:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:30:54.329041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c43ac0-7f38-42d3-bdbd-c5e1576dd4a1 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:54.329041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c43ac0-7f38-42d3-bdbd-c5e1576dd4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:54.329041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c43ac0-7f38-42d3-bdbd-c5e1576dd4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:54.445965 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b860b-adf7-443d-b1c0-5f697af61671 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:54.449919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-309b860b-adf7-443d-b1c0-5f697af61671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:54.468814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-f0c43ac0-7f38-42d3-bdbd-c5e1576dd4a1 None None] MFA Rules not processed for user `824648d693af4b44ae5df853a3d258f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:30:54.473387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f0c43ac0-7f38-42d3-bdbd-c5e1576dd4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:30:54.528939 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 890/1786] 10.222.0.83 () {58 vars in 1018 bytes} [Fri Sep 23 01:30:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:30:54.550799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b860b-adf7-443d-b1c0-5f697af61671 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:54.582296 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206a350-997f-4a7a-af24-56ef8a6e37a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:54.583252 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206a350-997f-4a7a-af24-56ef8a6e37a9 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:54.583777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206a350-997f-4a7a-af24-56ef8a6e37a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:54.584181 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206a350-997f-4a7a-af24-56ef8a6e37a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:54.614647 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206a350-997f-4a7a-af24-56ef8a6e37a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:54.623715 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206a350-997f-4a7a-af24-56ef8a6e37a9 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:54.702903 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 897/1787] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:30:54.822818 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:55.040949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c43ac0-7f38-42d3-bdbd-c5e1576dd4a1 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:30:55.074888 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c43ac0-7f38-42d3-bdbd-c5e1576dd4a1 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:30:55.092648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:55.117689 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4c97f-dce7-4bb8-8307-2b977ea41bc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:30:55.119184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4c97f-dce7-4bb8-8307-2b977ea41bc5 service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:30:55.121156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4c97f-dce7-4bb8-8307-2b977ea41bc5 service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:30:55.121898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4c97f-dce7-4bb8-8307-2b977ea41bc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:30:55.168780 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4c97f-dce7-4bb8-8307-2b977ea41bc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:30:55.178250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4c97f-dce7-4bb8-8307-2b977ea41bc5 service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:30:55.237979 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 891/1788] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:30:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:03.064456 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206a350-997f-4a7a-af24-56ef8a6e37a9 service nova] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:03.080515 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206a350-997f-4a7a-af24-56ef8a6e37a9 service nova] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:03.085647 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3ab5f-62f0-4d9c-9cd1-f16af87a1784 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:03.086481 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3ab5f-62f0-4d9c-9cd1-f16af87a1784 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:03.086938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3ab5f-62f0-4d9c-9cd1-f16af87a1784 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:03.087291 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3ab5f-62f0-4d9c-9cd1-f16af87a1784 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:03.174484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:03.199678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3ab5f-62f0-4d9c-9cd1-f16af87a1784 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:03.201662 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3ab5f-62f0-4d9c-9cd1-f16af87a1784 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:03.221297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 898/1789] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:03.319660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4c97f-dce7-4bb8-8307-2b977ea41bc5 service nova] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:03.407979 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:03.441282 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4c97f-dce7-4bb8-8307-2b977ea41bc5 service nova] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:03.450889 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf60da-9a78-4f42-a90c-7fd7ce2c97b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:03.451328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf60da-9a78-4f42-a90c-7fd7ce2c97b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:03.451665 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf60da-9a78-4f42-a90c-7fd7ce2c97b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:03.452065 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf60da-9a78-4f42-a90c-7fd7ce2c97b0 admin admin] PATH_INFO: `/v3/users/b2e721808b2745bf943c3b21f517d09d` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:03.453777 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf60da-9a78-4f42-a90c-7fd7ce2c97b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2e721808b2745bf943c3b21f517d09d)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:03.456070 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf60da-9a78-4f42-a90c-7fd7ce2c97b0 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:03.752635 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-2abf60da-9a78-4f42-a90c-7fd7ce2c97b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2e721808b2745bf943c3b21f517d09d'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:03.782964 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-2abf60da-9a78-4f42-a90c-7fd7ce2c97b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2e721808b2745bf943c3b21f517d09d'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:03.934703 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-2abf60da-9a78-4f42-a90c-7fd7ce2c97b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2e721808b2745bf943c3b21f517d09d'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:03.935808 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-2abf60da-9a78-4f42-a90c-7fd7ce2c97b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2e721808b2745bf943c3b21f517d09d'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:03.945376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-2abf60da-9a78-4f42-a90c-7fd7ce2c97b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2e721808b2745bf943c3b21f517d09d'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:03.953923 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 892/1790] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:03 2022] DELETE /identity/v3/users/b2e721808b2745bf943c3b21f517d09d => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:03.959521 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f7fed-d4ce-49b4-8069-8a923a7723ab None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:03.959926 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f7fed-d4ce-49b4-8069-8a923a7723ab None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:03.960317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f7fed-d4ce-49b4-8069-8a923a7723ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:03.995615 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-226f7fed-d4ce-49b4-8069-8a923a7723ab None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:03.997187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-226f7fed-d4ce-49b4-8069-8a923a7723ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:04.139305 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 899/1791] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:31:04.151813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf60da-9a78-4f42-a90c-7fd7ce2c97b0 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:04.154801 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-2abf60da-9a78-4f42-a90c-7fd7ce2c97b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:04.298540 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf60da-9a78-4f42-a90c-7fd7ce2c97b0 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:04.306067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44e8d1-5f4b-418d-b0a6-06bbff2f4b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:04.307185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44e8d1-5f4b-418d-b0a6-06bbff2f4b95 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:04.307677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44e8d1-5f4b-418d-b0a6-06bbff2f4b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:04.308149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44e8d1-5f4b-418d-b0a6-06bbff2f4b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:04.384767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44e8d1-5f4b-418d-b0a6-06bbff2f4b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:04.391732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44e8d1-5f4b-418d-b0a6-06bbff2f4b95 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:04.436355 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 893/1792] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:05.421886 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f7fed-d4ce-49b4-8069-8a923a7723ab None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:05.425636 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-226f7fed-d4ce-49b4-8069-8a923a7723ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:05.450006 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f7fed-d4ce-49b4-8069-8a923a7723ab None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:05.487437 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577483a8-6ca1-4aaf-ad20-13ffc1cd37c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:05.489632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577483a8-6ca1-4aaf-ad20-13ffc1cd37c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:05.493468 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577483a8-6ca1-4aaf-ad20-13ffc1cd37c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:05.495141 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577483a8-6ca1-4aaf-ad20-13ffc1cd37c9 admin admin] PATH_INFO: `/v3/projects/da8196d722eb4dbd8263115de912976b` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:05.499798 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577483a8-6ca1-4aaf-ad20-13ffc1cd37c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da8196d722eb4dbd8263115de912976b)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:05.502042 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577483a8-6ca1-4aaf-ad20-13ffc1cd37c9 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:05.804388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-577483a8-6ca1-4aaf-ad20-13ffc1cd37c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da8196d722eb4dbd8263115de912976b', 'request_id': 'req-577483a8-6ca1-4aaf-ad20-13ffc1cd37c9'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:06.000900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-577483a8-6ca1-4aaf-ad20-13ffc1cd37c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da8196d722eb4dbd8263115de912976b', 'request_id': 'req-577483a8-6ca1-4aaf-ad20-13ffc1cd37c9'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:06.021332 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-577483a8-6ca1-4aaf-ad20-13ffc1cd37c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da8196d722eb4dbd8263115de912976b', 'request_id': 'req-577483a8-6ca1-4aaf-ad20-13ffc1cd37c9'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:06.067711 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-577483a8-6ca1-4aaf-ad20-13ffc1cd37c9 admin admin] The token cache is being invalidate because project da8196d722eb4dbd8263115de912976b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:06.068811 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-577483a8-6ca1-4aaf-ad20-13ffc1cd37c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:06.070451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-577483a8-6ca1-4aaf-ad20-13ffc1cd37c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:06.085029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 900/1793] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:05 2022] DELETE /identity/v3/projects/da8196d722eb4dbd8263115de912976b => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:06.093476 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44e8d1-5f4b-418d-b0a6-06bbff2f4b95 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:06.131354 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44e8d1-5f4b-418d-b0a6-06bbff2f4b95 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:06.388132 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688c747-286b-4667-ba58-11f807ba7e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:06.390136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688c747-286b-4667-ba58-11f807ba7e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:06.391035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688c747-286b-4667-ba58-11f807ba7e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:06.406329 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688c747-286b-4667-ba58-11f807ba7e2f admin admin] PATH_INFO: `/v3/users/d2f2399a5af84edc8a6a08bcc529b471` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:06.410369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688c747-286b-4667-ba58-11f807ba7e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2f2399a5af84edc8a6a08bcc529b471)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:06.433777 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688c747-286b-4667-ba58-11f807ba7e2f admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:06.456268 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:06.825704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-b688c747-286b-4667-ba58-11f807ba7e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2f2399a5af84edc8a6a08bcc529b471'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:06.862866 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-b688c747-286b-4667-ba58-11f807ba7e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2f2399a5af84edc8a6a08bcc529b471'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:07.015047 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-b688c747-286b-4667-ba58-11f807ba7e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2f2399a5af84edc8a6a08bcc529b471'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:07.023904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-b688c747-286b-4667-ba58-11f807ba7e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2f2399a5af84edc8a6a08bcc529b471'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:07.032515 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-b688c747-286b-4667-ba58-11f807ba7e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2f2399a5af84edc8a6a08bcc529b471'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:07.044735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 894/1794] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:06 2022] DELETE /identity/v3/users/d2f2399a5af84edc8a6a08bcc529b471 => generated 0 bytes in 955 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:08.199762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577483a8-6ca1-4aaf-ad20-13ffc1cd37c9 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:08.213167 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-577483a8-6ca1-4aaf-ad20-13ffc1cd37c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:08.235262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577483a8-6ca1-4aaf-ad20-13ffc1cd37c9 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:08.331263 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fed590-5e67-45d4-82d4-4d997a3b69ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:08.331925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fed590-5e67-45d4-82d4-4d997a3b69ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:08.332201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fed590-5e67-45d4-82d4-4d997a3b69ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:08.333270 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fed590-5e67-45d4-82d4-4d997a3b69ef admin admin] PATH_INFO: `/v3/projects/a8d62052a86346d1897501b92dede736` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:08.334627 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fed590-5e67-45d4-82d4-4d997a3b69ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8d62052a86346d1897501b92dede736)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:08.337314 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fed590-5e67-45d4-82d4-4d997a3b69ef admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:08.362879 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:08.490981 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-45fed590-5e67-45d4-82d4-4d997a3b69ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8d62052a86346d1897501b92dede736', 'request_id': 'req-45fed590-5e67-45d4-82d4-4d997a3b69ef'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:08.585152 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-45fed590-5e67-45d4-82d4-4d997a3b69ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8d62052a86346d1897501b92dede736', 'request_id': 'req-45fed590-5e67-45d4-82d4-4d997a3b69ef'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:08.591718 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-45fed590-5e67-45d4-82d4-4d997a3b69ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8d62052a86346d1897501b92dede736', 'request_id': 'req-45fed590-5e67-45d4-82d4-4d997a3b69ef'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:08.613834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-45fed590-5e67-45d4-82d4-4d997a3b69ef admin admin] The token cache is being invalidate because project a8d62052a86346d1897501b92dede736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:08.614149 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-45fed590-5e67-45d4-82d4-4d997a3b69ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:08.614886 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-45fed590-5e67-45d4-82d4-4d997a3b69ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:08.616901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 901/1795] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:08 2022] DELETE /identity/v3/projects/a8d62052a86346d1897501b92dede736 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:08.621780 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a6aac-5566-4481-a3b9-3809e13ef443 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:08.622780 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a6aac-5566-4481-a3b9-3809e13ef443 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:08.623128 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a6aac-5566-4481-a3b9-3809e13ef443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:08.650031 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-2a2a6aac-5566-4481-a3b9-3809e13ef443 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:08.651543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-2a2a6aac-5566-4481-a3b9-3809e13ef443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:08.769114 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 895/1796] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:08.782118 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e9d04-9287-4132-a4fb-8ca60732eda9 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:08.782956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e9d04-9287-4132-a4fb-8ca60732eda9 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:08.783642 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e9d04-9287-4132-a4fb-8ca60732eda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:08.830785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-a90e9d04-9287-4132-a4fb-8ca60732eda9 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:08.833159 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a90e9d04-9287-4132-a4fb-8ca60732eda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:08.854807 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 902/1797] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:08.855706 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a6aac-5566-4481-a3b9-3809e13ef443 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:08.903365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a6aac-5566-4481-a3b9-3809e13ef443 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:08.923360 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1974fc5-02fc-4b02-a7c2-8a4a6b21fc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:08.926081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1974fc5-02fc-4b02-a7c2-8a4a6b21fc78 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:08.929172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1974fc5-02fc-4b02-a7c2-8a4a6b21fc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:08.931090 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1974fc5-02fc-4b02-a7c2-8a4a6b21fc78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:08.932722 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1974fc5-02fc-4b02-a7c2-8a4a6b21fc78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:31:08.933236 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1974fc5-02fc-4b02-a7c2-8a4a6b21fc78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:08.942606 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1974fc5-02fc-4b02-a7c2-8a4a6b21fc78 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:09.000869 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 896/1798] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:31:09.005163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e9d04-9287-4132-a4fb-8ca60732eda9 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:09.017641 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e9d04-9287-4132-a4fb-8ca60732eda9 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:09.030317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db9997-b508-4704-99df-76d887903aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:09.039058 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db9997-b508-4704-99df-76d887903aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:09.039058 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db9997-b508-4704-99df-76d887903aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:09.039058 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db9997-b508-4704-99df-76d887903aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:09.039455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db9997-b508-4704-99df-76d887903aa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:09.042620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db9997-b508-4704-99df-76d887903aa4 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:09.192405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1974fc5-02fc-4b02-a7c2-8a4a6b21fc78 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:09.197048 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 903/1799] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:09 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:09.208586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1974fc5-02fc-4b02-a7c2-8a4a6b21fc78 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:09.339628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497a105-e31c-4248-b492-de181ad043ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:09.340283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497a105-e31c-4248-b492-de181ad043ea admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:09.340579 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497a105-e31c-4248-b492-de181ad043ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:09.340862 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497a105-e31c-4248-b492-de181ad043ea admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:09.341619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497a105-e31c-4248-b492-de181ad043ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:09.352537 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497a105-e31c-4248-b492-de181ad043ea admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:09.356404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db9997-b508-4704-99df-76d887903aa4 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:09.360995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b3db9997-b508-4704-99df-76d887903aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:09.395333 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db9997-b508-4704-99df-76d887903aa4 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:09.409262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d7cef-2474-4805-8841-0f2517983a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:09.409843 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d7cef-2474-4805-8841-0f2517983a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:09.410267 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d7cef-2474-4805-8841-0f2517983a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:09.410726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d7cef-2474-4805-8841-0f2517983a24 admin admin] PATH_INFO: `/v3/users/1133018a9f484e3c88003c3c3454398d` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:09.413187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d7cef-2474-4805-8841-0f2517983a24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1133018a9f484e3c88003c3c3454398d)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:09.416314 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d7cef-2474-4805-8841-0f2517983a24 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:09.549512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 897/1800] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:09 2022] POST /identity/v3/users => generated 291 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:09.554170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497a105-e31c-4248-b492-de181ad043ea admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:09.562218 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:09.567379 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497a105-e31c-4248-b492-de181ad043ea admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:09.573680 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4257ee-959f-4f69-99b0-e8c931f5955d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:09.574775 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4257ee-959f-4f69-99b0-e8c931f5955d admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:09.575292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4257ee-959f-4f69-99b0-e8c931f5955d admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:09.575570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4257ee-959f-4f69-99b0-e8c931f5955d admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:09.576838 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4257ee-959f-4f69-99b0-e8c931f5955d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:09.578357 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4257ee-959f-4f69-99b0-e8c931f5955d admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:09.593351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 898/1801] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:31:09.597803 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4257ee-959f-4f69-99b0-e8c931f5955d admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:09.610987 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4257ee-959f-4f69-99b0-e8c931f5955d admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:09.617437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a782c0c-0ca3-4c12-a9c3-82434183f6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:09.618288 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a782c0c-0ca3-4c12-a9c3-82434183f6bc admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:09.618288 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a782c0c-0ca3-4c12-a9c3-82434183f6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:09.618514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a782c0c-0ca3-4c12-a9c3-82434183f6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:09.619202 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a782c0c-0ca3-4c12-a9c3-82434183f6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:09.620831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a782c0c-0ca3-4c12-a9c3-82434183f6bc admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:09.637036 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 899/1802] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:31:09.648035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a782c0c-0ca3-4c12-a9c3-82434183f6bc admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:09.674702 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-dd4d7cef-2474-4805-8841-0f2517983a24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1133018a9f484e3c88003c3c3454398d'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:09.678960 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a782c0c-0ca3-4c12-a9c3-82434183f6bc admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:09.689029 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa32365-1742-46d3-a3c5-85f150bd81ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:09.689029 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa32365-1742-46d3-a3c5-85f150bd81ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:09.689029 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa32365-1742-46d3-a3c5-85f150bd81ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:09.689029 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa32365-1742-46d3-a3c5-85f150bd81ee admin admin] PATH_INFO: `/v3/projects/266c47fe56784d7fa31e0cca1ec258b0/users/5466fdca47aa42f5aa18945ef9552f12/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:09.710891 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa32365-1742-46d3-a3c5-85f150bd81ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=266c47fe56784d7fa31e0cca1ec258b0, user_id=5466fdca47aa42f5aa18945ef9552f12, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:09.715485 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa32365-1742-46d3-a3c5-85f150bd81ee admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:09.774463 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-dd4d7cef-2474-4805-8841-0f2517983a24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1133018a9f484e3c88003c3c3454398d'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:09.776211 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-dd4d7cef-2474-4805-8841-0f2517983a24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1133018a9f484e3c88003c3c3454398d'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:09.793031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-dd4d7cef-2474-4805-8841-0f2517983a24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1133018a9f484e3c88003c3c3454398d'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:09.793914 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-dd4d7cef-2474-4805-8841-0f2517983a24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1133018a9f484e3c88003c3c3454398d'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:09.827004 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 900/1803] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:09 2022] PUT /identity/v3/projects/266c47fe56784d7fa31e0cca1ec258b0/users/5466fdca47aa42f5aa18945ef9552f12/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:09.828883 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 904/1804] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:09 2022] DELETE /identity/v3/users/1133018a9f484e3c88003c3c3454398d => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:09.834781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f617bbe-b303-4097-b9c9-7300968f247f None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:09.838086 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a3b5f-d43e-416a-ad11-ac126ed815e8 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:09.838235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f617bbe-b303-4097-b9c9-7300968f247f None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:09.838235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f617bbe-b303-4097-b9c9-7300968f247f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:09.838519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a3b5f-d43e-416a-ad11-ac126ed815e8 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:09.838519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a3b5f-d43e-416a-ad11-ac126ed815e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:09.859548 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-3f617bbe-b303-4097-b9c9-7300968f247f None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:09.860812 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-3f617bbe-b303-4097-b9c9-7300968f247f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:09.893577 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-516a3b5f-d43e-416a-ad11-ac126ed815e8 None None] MFA Rules not processed for user `5466fdca47aa42f5aa18945ef9552f12`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:09.895869 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-516a3b5f-d43e-416a-ad11-ac126ed815e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:09.959557 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 901/1805] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:09.971237 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f617bbe-b303-4097-b9c9-7300968f247f None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:09.972932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-3f617bbe-b303-4097-b9c9-7300968f247f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:10.036723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 905/1806] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:10.043404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a3b5f-d43e-416a-ad11-ac126ed815e8 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:10.044975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-516a3b5f-d43e-416a-ad11-ac126ed815e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:10.066995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a3b5f-d43e-416a-ad11-ac126ed815e8 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:10.070273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f617bbe-b303-4097-b9c9-7300968f247f None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:10.073863 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadbfaf-d819-494f-b088-924f641620b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:10.078762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadbfaf-d819-494f-b088-924f641620b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:10.078762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadbfaf-d819-494f-b088-924f641620b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:10.078762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadbfaf-d819-494f-b088-924f641620b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:10.078762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadbfaf-d819-494f-b088-924f641620b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:10.080218 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadbfaf-d819-494f-b088-924f641620b0 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:10.090151 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc90c2-490b-4087-a6ac-a03f5aba15d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:10.090827 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc90c2-490b-4087-a6ac-a03f5aba15d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:10.091103 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc90c2-490b-4087-a6ac-a03f5aba15d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:10.092869 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc90c2-490b-4087-a6ac-a03f5aba15d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:10.112033 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc90c2-490b-4087-a6ac-a03f5aba15d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:10.113565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc90c2-490b-4087-a6ac-a03f5aba15d9 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:10.137782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 902/1807] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:10.140395 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a59bc0-3678-4576-ae55-11721d0dd99d None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:10.140883 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a59bc0-3678-4576-ae55-11721d0dd99d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:10.141385 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a59bc0-3678-4576-ae55-11721d0dd99d None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:10.144237 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 903/1808] 10.222.0.83 () {54 vars in 921 bytes} [Fri Sep 23 01:31:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:31:10.156496 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2a921-1f80-4d03-890f-afd3373c3789 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:10.156868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2a921-1f80-4d03-890f-afd3373c3789 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:10.159235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2a921-1f80-4d03-890f-afd3373c3789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:10.192756 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-c6c2a921-1f80-4d03-890f-afd3373c3789 None None] MFA Rules not processed for user `824648d693af4b44ae5df853a3d258f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:10.196449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-c6c2a921-1f80-4d03-890f-afd3373c3789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:10.199213 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 906/1809] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:10 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:31:10.207112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadbfaf-d819-494f-b088-924f641620b0 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:10.399019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 904/1810] 10.222.0.83 () {58 vars in 1018 bytes} [Fri Sep 23 01:31:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:31:10.431538 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadbfaf-d819-494f-b088-924f641620b0 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:10.440279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2a921-1f80-4d03-890f-afd3373c3789 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:10.449528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-c6c2a921-1f80-4d03-890f-afd3373c3789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:10.452329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f53b7-9ab5-4f03-bae6-efe13a93e4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:10.458789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f53b7-9ab5-4f03-bae6-efe13a93e4cc admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:10.458789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f53b7-9ab5-4f03-bae6-efe13a93e4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:10.458789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f53b7-9ab5-4f03-bae6-efe13a93e4cc admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:10.458789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f53b7-9ab5-4f03-bae6-efe13a93e4cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:10.458789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f53b7-9ab5-4f03-bae6-efe13a93e4cc admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:10.479859 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2a921-1f80-4d03-890f-afd3373c3789 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:10.491933 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e37b50-173b-4b66-89e5-f7ce8abb5ab1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:10.495570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e37b50-173b-4b66-89e5-f7ce8abb5ab1 service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:10.495865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e37b50-173b-4b66-89e5-f7ce8abb5ab1 service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:10.496116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e37b50-173b-4b66-89e5-f7ce8abb5ab1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:10.522421 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e37b50-173b-4b66-89e5-f7ce8abb5ab1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:10.524252 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e37b50-173b-4b66-89e5-f7ce8abb5ab1 service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:10.550968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 905/1811] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:10.669089 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 907/1812] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:10 2022] POST /identity/v3/users => generated 296 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:10.675127 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e37b50-173b-4b66-89e5-f7ce8abb5ab1 service nova] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:10.705465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e37b50-173b-4b66-89e5-f7ce8abb5ab1 service nova] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:10.719030 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef0d2d-15fd-40d5-ac9d-5782b611320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:10.719358 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef0d2d-15fd-40d5-ac9d-5782b611320e admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:10.719953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef0d2d-15fd-40d5-ac9d-5782b611320e admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:10.719953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef0d2d-15fd-40d5-ac9d-5782b611320e admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:10.720580 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef0d2d-15fd-40d5-ac9d-5782b611320e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:10.722293 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef0d2d-15fd-40d5-ac9d-5782b611320e admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:10.739642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 906/1813] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:10.746809 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f53b7-9ab5-4f03-bae6-efe13a93e4cc admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:10.767070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f53b7-9ab5-4f03-bae6-efe13a93e4cc admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:10.781216 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da25011-dbf7-4840-8118-29ddbba90567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:10.782161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da25011-dbf7-4840-8118-29ddbba90567 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:10.782553 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da25011-dbf7-4840-8118-29ddbba90567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:10.782769 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da25011-dbf7-4840-8118-29ddbba90567 admin admin] PATH_INFO: `/v3/projects/8c9a736e936d4a14aff66477039bc17a/users/96a12ee56c184380b7db40434f1af4c0/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:10.791855 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef0d2d-15fd-40d5-ac9d-5782b611320e admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:10.793594 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-99ef0d2d-15fd-40d5-ac9d-5782b611320e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:10.817323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef0d2d-15fd-40d5-ac9d-5782b611320e admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:10.829343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ac6db-6c8b-4db7-bd9b-41a81ce684fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:10.831020 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ac6db-6c8b-4db7-bd9b-41a81ce684fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:10.831911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ac6db-6c8b-4db7-bd9b-41a81ce684fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:10.832883 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ac6db-6c8b-4db7-bd9b-41a81ce684fb admin admin] PATH_INFO: `/v3/users/3be57390110b4a108f6429dd921b3384` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:10.836193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ac6db-6c8b-4db7-bd9b-41a81ce684fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3be57390110b4a108f6429dd921b3384)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:10.841260 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ac6db-6c8b-4db7-bd9b-41a81ce684fb admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:10.846149 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da25011-dbf7-4840-8118-29ddbba90567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9a736e936d4a14aff66477039bc17a, user_id=96a12ee56c184380b7db40434f1af4c0, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:10.851650 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da25011-dbf7-4840-8118-29ddbba90567 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:10.973211 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:11.081446 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 908/1814] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:10 2022] PUT /identity/v3/projects/8c9a736e936d4a14aff66477039bc17a/users/96a12ee56c184380b7db40434f1af4c0/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:11.086161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da25011-dbf7-4840-8118-29ddbba90567 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:11.155586 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da25011-dbf7-4840-8118-29ddbba90567 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:11.161225 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e03966-e0f6-4a70-936c-2368ee44c5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:11.161941 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e03966-e0f6-4a70-936c-2368ee44c5fa admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:11.162224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e03966-e0f6-4a70-936c-2368ee44c5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:11.162502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e03966-e0f6-4a70-936c-2368ee44c5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:11.163324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e03966-e0f6-4a70-936c-2368ee44c5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:11.165079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e03966-e0f6-4a70-936c-2368ee44c5fa admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:11.183153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 909/1815] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:31:11.183153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e03966-e0f6-4a70-936c-2368ee44c5fa admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:11.183153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b5e03966-e0f6-4a70-936c-2368ee44c5fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:11.204875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e03966-e0f6-4a70-936c-2368ee44c5fa admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:11.219684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ccede-f096-44ee-9688-178a51a909f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:11.219684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ccede-f096-44ee-9688-178a51a909f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:11.219684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ccede-f096-44ee-9688-178a51a909f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:11.220461 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ccede-f096-44ee-9688-178a51a909f1 admin admin] PATH_INFO: `/v3/projects/ef90be6b0d5144d0ab398226290e4bd7` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:11.223802 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ccede-f096-44ee-9688-178a51a909f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef90be6b0d5144d0ab398226290e4bd7)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:11.227109 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ccede-f096-44ee-9688-178a51a909f1 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:11.355165 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d28ac6db-6c8b-4db7-bd9b-41a81ce684fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3be57390110b4a108f6429dd921b3384'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:11.375879 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d28ac6db-6c8b-4db7-bd9b-41a81ce684fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3be57390110b4a108f6429dd921b3384'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:11.400382 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1b3ccede-f096-44ee-9688-178a51a909f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef90be6b0d5144d0ab398226290e4bd7', 'request_id': 'req-1b3ccede-f096-44ee-9688-178a51a909f1'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:11.575879 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d28ac6db-6c8b-4db7-bd9b-41a81ce684fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3be57390110b4a108f6429dd921b3384'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:11.577644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d28ac6db-6c8b-4db7-bd9b-41a81ce684fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3be57390110b4a108f6429dd921b3384'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:11.603411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d28ac6db-6c8b-4db7-bd9b-41a81ce684fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3be57390110b4a108f6429dd921b3384'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:11.628508 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 907/1816] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:10 2022] DELETE /identity/v3/users/3be57390110b4a108f6429dd921b3384 => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:11.630148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ac6db-6c8b-4db7-bd9b-41a81ce684fb admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:11.633229 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-d28ac6db-6c8b-4db7-bd9b-41a81ce684fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:11.666478 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1b3ccede-f096-44ee-9688-178a51a909f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef90be6b0d5144d0ab398226290e4bd7', 'request_id': 'req-1b3ccede-f096-44ee-9688-178a51a909f1'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:11.674391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1b3ccede-f096-44ee-9688-178a51a909f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef90be6b0d5144d0ab398226290e4bd7', 'request_id': 'req-1b3ccede-f096-44ee-9688-178a51a909f1'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:11.700137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1b3ccede-f096-44ee-9688-178a51a909f1 admin admin] The token cache is being invalidate because project ef90be6b0d5144d0ab398226290e4bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:11.700432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1b3ccede-f096-44ee-9688-178a51a909f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:11.703680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1b3ccede-f096-44ee-9688-178a51a909f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:11.705376 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 910/1817] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:11 2022] DELETE /identity/v3/projects/ef90be6b0d5144d0ab398226290e4bd7 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:11.706903 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692561c-548a-449d-bff4-9e6403fa2e55 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:11.707346 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692561c-548a-449d-bff4-9e6403fa2e55 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:11.707752 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692561c-548a-449d-bff4-9e6403fa2e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:11.734473 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-c692561c-548a-449d-bff4-9e6403fa2e55 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:11.736041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-c692561c-548a-449d-bff4-9e6403fa2e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:11.762477 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ac6db-6c8b-4db7-bd9b-41a81ce684fb admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:11.771840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df0180-b79b-47e0-8784-7ed7642e17f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:11.773163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df0180-b79b-47e0-8784-7ed7642e17f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:11.773595 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df0180-b79b-47e0-8784-7ed7642e17f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:11.774072 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df0180-b79b-47e0-8784-7ed7642e17f4 admin admin] PATH_INFO: `/v3/projects/8c9a736e936d4a14aff66477039bc17a/users/96a12ee56c184380b7db40434f1af4c0/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:11.778387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df0180-b79b-47e0-8784-7ed7642e17f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9a736e936d4a14aff66477039bc17a, user_id=96a12ee56c184380b7db40434f1af4c0, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:11.790647 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df0180-b79b-47e0-8784-7ed7642e17f4 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:11.804448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 908/1818] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:11 2022] PUT /identity/v3/projects/8c9a736e936d4a14aff66477039bc17a/users/96a12ee56c184380b7db40434f1af4c0/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:11.806158 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df0180-b79b-47e0-8784-7ed7642e17f4 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:11.809524 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-00df0180-b79b-47e0-8784-7ed7642e17f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:11.875744 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 911/1819] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:11.878232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cf068-0f1d-4d41-8d11-d9dca8370c6f None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:11.878776 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cf068-0f1d-4d41-8d11-d9dca8370c6f None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:11.879278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cf068-0f1d-4d41-8d11-d9dca8370c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:11.949169 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-810cf068-0f1d-4d41-8d11-d9dca8370c6f None None] MFA Rules not processed for user `96a12ee56c184380b7db40434f1af4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:11.957431 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-810cf068-0f1d-4d41-8d11-d9dca8370c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:11.980928 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df0180-b79b-47e0-8784-7ed7642e17f4 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:11.989470 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc391c8-14fa-4ba4-b319-d6b39633cfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:11.990143 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc391c8-14fa-4ba4-b319-d6b39633cfbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:11.990423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc391c8-14fa-4ba4-b319-d6b39633cfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:11.990785 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc391c8-14fa-4ba4-b319-d6b39633cfbf admin admin] PATH_INFO: `/v3/users/3ba2acad97014f949a726abe6b53a3e4` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:11.992138 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc391c8-14fa-4ba4-b319-d6b39633cfbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba2acad97014f949a726abe6b53a3e4)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:11.995283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc391c8-14fa-4ba4-b319-d6b39633cfbf admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:12.099121 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 912/1820] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:12.099121 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cf068-0f1d-4d41-8d11-d9dca8370c6f None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:12.099121 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-810cf068-0f1d-4d41-8d11-d9dca8370c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:12.190525 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cf068-0f1d-4d41-8d11-d9dca8370c6f None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:12.195820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530e22b-7458-4054-aaa3-a60aebb48749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:12.197153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530e22b-7458-4054-aaa3-a60aebb48749 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:12.197636 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530e22b-7458-4054-aaa3-a60aebb48749 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:12.197947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530e22b-7458-4054-aaa3-a60aebb48749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:12.213936 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530e22b-7458-4054-aaa3-a60aebb48749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:12.215612 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530e22b-7458-4054-aaa3-a60aebb48749 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:12.249093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 913/1821] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:12.252966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530e22b-7458-4054-aaa3-a60aebb48749 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:12.256182 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-2530e22b-7458-4054-aaa3-a60aebb48749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:12.387714 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530e22b-7458-4054-aaa3-a60aebb48749 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:12.405432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298660e-50e5-4430-95cd-428aef07ccb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:12.408681 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298660e-50e5-4430-95cd-428aef07ccb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:12.409511 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298660e-50e5-4430-95cd-428aef07ccb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:12.410624 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298660e-50e5-4430-95cd-428aef07ccb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:12.423828 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5cc391c8-14fa-4ba4-b319-d6b39633cfbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba2acad97014f949a726abe6b53a3e4'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:12.437940 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298660e-50e5-4430-95cd-428aef07ccb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:12.439568 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298660e-50e5-4430-95cd-428aef07ccb4 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:12.448676 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5cc391c8-14fa-4ba4-b319-d6b39633cfbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba2acad97014f949a726abe6b53a3e4'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:12.471660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 914/1822] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:12.530062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5cc391c8-14fa-4ba4-b319-d6b39633cfbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba2acad97014f949a726abe6b53a3e4'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:12.531756 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5cc391c8-14fa-4ba4-b319-d6b39633cfbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba2acad97014f949a726abe6b53a3e4'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:12.546886 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5cc391c8-14fa-4ba4-b319-d6b39633cfbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba2acad97014f949a726abe6b53a3e4'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:12.556738 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 909/1823] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:11 2022] DELETE /identity/v3/users/3ba2acad97014f949a726abe6b53a3e4 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:12.586018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:12.966868 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298660e-50e5-4430-95cd-428aef07ccb4 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:12.968397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-c298660e-50e5-4430-95cd-428aef07ccb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:13.012469 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298660e-50e5-4430-95cd-428aef07ccb4 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:13.035192 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc391c8-14fa-4ba4-b319-d6b39633cfbf admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:13.038389 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-5cc391c8-14fa-4ba4-b319-d6b39633cfbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:13.114572 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f15eb0-3f82-473a-be00-80a1af116419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:13.115378 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f15eb0-3f82-473a-be00-80a1af116419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:13.115660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f15eb0-3f82-473a-be00-80a1af116419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:13.115934 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f15eb0-3f82-473a-be00-80a1af116419 admin admin] PATH_INFO: `/v3/projects/78c57e41f4924046a74d3d7a1bd93a42` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:13.117259 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f15eb0-3f82-473a-be00-80a1af116419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c57e41f4924046a74d3d7a1bd93a42)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:13.119411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f15eb0-3f82-473a-be00-80a1af116419 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:13.153814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc391c8-14fa-4ba4-b319-d6b39633cfbf admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:13.159050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06846c8-61ae-4e14-bc1e-4a983f6a46d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:13.159713 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06846c8-61ae-4e14-bc1e-4a983f6a46d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:13.159997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06846c8-61ae-4e14-bc1e-4a983f6a46d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:13.160268 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06846c8-61ae-4e14-bc1e-4a983f6a46d4 admin admin] PATH_INFO: `/v3/users/cf1a02c5be0941f88e2fd616ef8fdd4b` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:13.161639 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06846c8-61ae-4e14-bc1e-4a983f6a46d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1a02c5be0941f88e2fd616ef8fdd4b)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:13.163614 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06846c8-61ae-4e14-bc1e-4a983f6a46d4 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:13.338096 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d5f15eb0-3f82-473a-be00-80a1af116419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c57e41f4924046a74d3d7a1bd93a42', 'request_id': 'req-d5f15eb0-3f82-473a-be00-80a1af116419'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:13.443068 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d5f15eb0-3f82-473a-be00-80a1af116419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c57e41f4924046a74d3d7a1bd93a42', 'request_id': 'req-d5f15eb0-3f82-473a-be00-80a1af116419'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:13.457652 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d5f15eb0-3f82-473a-be00-80a1af116419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c57e41f4924046a74d3d7a1bd93a42', 'request_id': 'req-d5f15eb0-3f82-473a-be00-80a1af116419'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:13.479320 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f06846c8-61ae-4e14-bc1e-4a983f6a46d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1a02c5be0941f88e2fd616ef8fdd4b'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:13.483726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d5f15eb0-3f82-473a-be00-80a1af116419 admin admin] The token cache is being invalidate because project 78c57e41f4924046a74d3d7a1bd93a42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:13.484229 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d5f15eb0-3f82-473a-be00-80a1af116419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:13.485374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d5f15eb0-3f82-473a-be00-80a1af116419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:13.493654 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 915/1824] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:12 2022] DELETE /identity/v3/projects/78c57e41f4924046a74d3d7a1bd93a42 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:13.493654 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f15eb0-3f82-473a-be00-80a1af116419 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:13.493654 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d5f15eb0-3f82-473a-be00-80a1af116419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:13.499051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f06846c8-61ae-4e14-bc1e-4a983f6a46d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1a02c5be0941f88e2fd616ef8fdd4b'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:13.597410 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f06846c8-61ae-4e14-bc1e-4a983f6a46d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1a02c5be0941f88e2fd616ef8fdd4b'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:13.599069 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f06846c8-61ae-4e14-bc1e-4a983f6a46d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1a02c5be0941f88e2fd616ef8fdd4b'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:13.624699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f06846c8-61ae-4e14-bc1e-4a983f6a46d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1a02c5be0941f88e2fd616ef8fdd4b'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:13.642612 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 910/1825] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:13 2022] DELETE /identity/v3/users/cf1a02c5be0941f88e2fd616ef8fdd4b => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:13.644227 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06846c8-61ae-4e14-bc1e-4a983f6a46d4 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:13.647117 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f06846c8-61ae-4e14-bc1e-4a983f6a46d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:13.649877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f15eb0-3f82-473a-be00-80a1af116419 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:13.837727 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d471f-5161-4513-bb28-1d663dde31f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:13.837727 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d471f-5161-4513-bb28-1d663dde31f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:13.837727 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d471f-5161-4513-bb28-1d663dde31f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:13.837727 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d471f-5161-4513-bb28-1d663dde31f5 admin admin] PATH_INFO: `/v3/projects/3ffbadd7318946f98b06ba9d133b0211` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:13.838029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d471f-5161-4513-bb28-1d663dde31f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ffbadd7318946f98b06ba9d133b0211)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:13.838097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06846c8-61ae-4e14-bc1e-4a983f6a46d4 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:13.838170 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d471f-5161-4513-bb28-1d663dde31f5 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:13.848849 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b6dad-ae2b-4736-aa46-3facce015aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:13.849957 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6dad-ae2b-4736-aa46-3facce015aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:13.850719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6dad-ae2b-4736-aa46-3facce015aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:13.851384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6dad-ae2b-4736-aa46-3facce015aff admin admin] PATH_INFO: `/v3/users/491a162232bc4fce9f3d8987bb46af4e` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:13.854057 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b6dad-ae2b-4736-aa46-3facce015aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=491a162232bc4fce9f3d8987bb46af4e)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:13.871414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b6dad-ae2b-4736-aa46-3facce015aff admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:14.108667 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7c4d471f-5161-4513-bb28-1d663dde31f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ffbadd7318946f98b06ba9d133b0211', 'request_id': 'req-7c4d471f-5161-4513-bb28-1d663dde31f5'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:14.339038 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-209b6dad-ae2b-4736-aa46-3facce015aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '491a162232bc4fce9f3d8987bb46af4e'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:14.358522 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7c4d471f-5161-4513-bb28-1d663dde31f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ffbadd7318946f98b06ba9d133b0211', 'request_id': 'req-7c4d471f-5161-4513-bb28-1d663dde31f5'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:14.365825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-209b6dad-ae2b-4736-aa46-3facce015aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '491a162232bc4fce9f3d8987bb46af4e'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:14.370624 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7c4d471f-5161-4513-bb28-1d663dde31f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ffbadd7318946f98b06ba9d133b0211', 'request_id': 'req-7c4d471f-5161-4513-bb28-1d663dde31f5'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:14.383864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7c4d471f-5161-4513-bb28-1d663dde31f5 admin admin] The token cache is being invalidate because project 3ffbadd7318946f98b06ba9d133b0211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:14.384100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7c4d471f-5161-4513-bb28-1d663dde31f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:14.384725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7c4d471f-5161-4513-bb28-1d663dde31f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:14.386248 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 916/1826] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:13 2022] DELETE /identity/v3/projects/3ffbadd7318946f98b06ba9d133b0211 => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:14.387499 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80485fd-b89a-4c0d-80b5-70662316209b None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:14.387792 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80485fd-b89a-4c0d-80b5-70662316209b None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:14.388026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80485fd-b89a-4c0d-80b5-70662316209b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:14.411537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-f80485fd-b89a-4c0d-80b5-70662316209b None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:14.412744 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f80485fd-b89a-4c0d-80b5-70662316209b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:14.460289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:14.484286 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 917/1827] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:14.485458 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80485fd-b89a-4c0d-80b5-70662316209b None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:14.486973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f80485fd-b89a-4c0d-80b5-70662316209b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:14.524053 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-209b6dad-ae2b-4736-aa46-3facce015aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '491a162232bc4fce9f3d8987bb46af4e'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:14.530497 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-209b6dad-ae2b-4736-aa46-3facce015aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '491a162232bc4fce9f3d8987bb46af4e'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:14.548374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-209b6dad-ae2b-4736-aa46-3facce015aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '491a162232bc4fce9f3d8987bb46af4e'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:14.557398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 911/1828] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:13 2022] DELETE /identity/v3/users/491a162232bc4fce9f3d8987bb46af4e => generated 0 bytes in 914 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:14.560256 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96338fe5-dece-4cd2-a05c-7680799408f4 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:14.561367 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96338fe5-dece-4cd2-a05c-7680799408f4 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:14.562073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96338fe5-dece-4cd2-a05c-7680799408f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:14.594216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-96338fe5-dece-4cd2-a05c-7680799408f4 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:14.595836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-96338fe5-dece-4cd2-a05c-7680799408f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:14.631853 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80485fd-b89a-4c0d-80b5-70662316209b None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:14.712429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 912/1829] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:14.714616 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96338fe5-dece-4cd2-a05c-7680799408f4 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:14.718988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-96338fe5-dece-4cd2-a05c-7680799408f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:14.786313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9a859-6ff9-49cc-b1c5-02d12eb87b5e tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96a12ee56c184380b7db40434f1af4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c9a736e936d4a14aff66477039bc17a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:14.786983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9a859-6ff9-49cc-b1c5-02d12eb87b5e tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:14.787284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9a859-6ff9-49cc-b1c5-02d12eb87b5e tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:14.787551 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9a859-6ff9-49cc-b1c5-02d12eb87b5e tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:14.788219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9a859-6ff9-49cc-b1c5-02d12eb87b5e tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:31:14.788532 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9a859-6ff9-49cc-b1c5-02d12eb87b5e tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:14.790387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9a859-6ff9-49cc-b1c5-02d12eb87b5e tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:14.819554 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 918/1830] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:31:14.820896 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee77f9b-ec92-4146-a4b2-5c8cf7b2b279 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:14.821187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee77f9b-ec92-4146-a4b2-5c8cf7b2b279 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:14.821460 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee77f9b-ec92-4146-a4b2-5c8cf7b2b279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:14.858561 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96338fe5-dece-4cd2-a05c-7680799408f4 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:14.863568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296dbf5-b882-4b13-b063-581ac365c835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:14.864195 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296dbf5-b882-4b13-b063-581ac365c835 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:14.864471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296dbf5-b882-4b13-b063-581ac365c835 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:14.864795 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296dbf5-b882-4b13-b063-581ac365c835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:14.867466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-2296dbf5-b882-4b13-b063-581ac365c835 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:14.867857 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-4ee77f9b-ec92-4146-a4b2-5c8cf7b2b279 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:14.869188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-4ee77f9b-ec92-4146-a4b2-5c8cf7b2b279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:14.894230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 919/1831] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:14.895441 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee77f9b-ec92-4146-a4b2-5c8cf7b2b279 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:14.901006 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-4ee77f9b-ec92-4146-a4b2-5c8cf7b2b279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:14.909163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296dbf5-b882-4b13-b063-581ac365c835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:14.913602 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296dbf5-b882-4b13-b063-581ac365c835 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:14.931701 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee77f9b-ec92-4146-a4b2-5c8cf7b2b279 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:14.937906 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 913/1832] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:14.938889 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296dbf5-b882-4b13-b063-581ac365c835 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:14.947708 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67d5d0-d98e-4b0d-b29b-a73951e2ad3a tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96a12ee56c184380b7db40434f1af4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c9a736e936d4a14aff66477039bc17a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:14.948349 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67d5d0-d98e-4b0d-b29b-a73951e2ad3a tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:14.948632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67d5d0-d98e-4b0d-b29b-a73951e2ad3a tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:14.948910 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67d5d0-d98e-4b0d-b29b-a73951e2ad3a tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:14.954625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67d5d0-d98e-4b0d-b29b-a73951e2ad3a tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:14.954625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67d5d0-d98e-4b0d-b29b-a73951e2ad3a tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:14.962193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296dbf5-b882-4b13-b063-581ac365c835 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:14.972705 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3fb29-58cb-460e-b247-ed6dd4c05572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:14.973674 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3fb29-58cb-460e-b247-ed6dd4c05572 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:14.973959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3fb29-58cb-460e-b247-ed6dd4c05572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:14.974459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3fb29-58cb-460e-b247-ed6dd4c05572 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:14.980920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3fb29-58cb-460e-b247-ed6dd4c05572 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:31:14.981496 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3fb29-58cb-460e-b247-ed6dd4c05572 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:14.983762 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3fb29-58cb-460e-b247-ed6dd4c05572 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:15.013226 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 914/1833] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:31:15.020380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3fb29-58cb-460e-b247-ed6dd4c05572 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:15.029352 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:15.033844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3fb29-58cb-460e-b247-ed6dd4c05572 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:15.039199 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccc876-caa6-455d-9ab1-c26cdf8210d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:15.039960 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccc876-caa6-455d-9ab1-c26cdf8210d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:15.040399 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccc876-caa6-455d-9ab1-c26cdf8210d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:15.040755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccc876-caa6-455d-9ab1-c26cdf8210d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:15.041507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ccc876-caa6-455d-9ab1-c26cdf8210d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:15.043998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ccc876-caa6-455d-9ab1-c26cdf8210d1 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:15.149812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 920/1834] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:14 2022] POST /identity/v3/projects => generated 355 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:15.151826 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67d5d0-d98e-4b0d-b29b-a73951e2ad3a tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:15.189984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 915/1835] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:15 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:31:15.195306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccc876-caa6-455d-9ab1-c26cdf8210d1 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:15.316185 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67d5d0-d98e-4b0d-b29b-a73951e2ad3a tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:15.351624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccc876-caa6-455d-9ab1-c26cdf8210d1 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:15.358676 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0136e88-e69b-4697-b85f-401ed79d76df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:15.359288 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0136e88-e69b-4697-b85f-401ed79d76df admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:15.359569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0136e88-e69b-4697-b85f-401ed79d76df admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:15.359837 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0136e88-e69b-4697-b85f-401ed79d76df admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:15.360564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0136e88-e69b-4697-b85f-401ed79d76df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:15.362574 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0136e88-e69b-4697-b85f-401ed79d76df admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:15.424281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1e098-ca77-48b7-98f0-0b0304d49409 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96a12ee56c184380b7db40434f1af4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c9a736e936d4a14aff66477039bc17a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:15.425025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1e098-ca77-48b7-98f0-0b0304d49409 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:15.425451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1e098-ca77-48b7-98f0-0b0304d49409 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:15.425849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1e098-ca77-48b7-98f0-0b0304d49409 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:15.426932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1e098-ca77-48b7-98f0-0b0304d49409 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:31:15.427385 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1e098-ca77-48b7-98f0-0b0304d49409 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:15.430825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1e098-ca77-48b7-98f0-0b0304d49409 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:15.460743 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 921/1836] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:31:15.460743 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1e098-ca77-48b7-98f0-0b0304d49409 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:15.460743 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-e1b1e098-ca77-48b7-98f0-0b0304d49409 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:15.490270 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1e098-ca77-48b7-98f0-0b0304d49409 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:15.500152 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed90ff-27a2-443c-9f79-00cd94035bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:15.502693 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed90ff-27a2-443c-9f79-00cd94035bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:15.504079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed90ff-27a2-443c-9f79-00cd94035bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:15.504535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed90ff-27a2-443c-9f79-00cd94035bf1 admin admin] PATH_INFO: `/v3/projects/64f0205f28e9443b8975b28be5711a84` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:15.507969 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed90ff-27a2-443c-9f79-00cd94035bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64f0205f28e9443b8975b28be5711a84)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:15.511891 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed90ff-27a2-443c-9f79-00cd94035bf1 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:15.532620 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 916/1837] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:15 2022] POST /identity/v3/users => generated 294 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:15.537164 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0136e88-e69b-4697-b85f-401ed79d76df admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:15.566696 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0136e88-e69b-4697-b85f-401ed79d76df admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:15.568751 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317c80a-bb51-4753-b62f-eb47caf9fe3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:15.570052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317c80a-bb51-4753-b62f-eb47caf9fe3e admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:15.570052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317c80a-bb51-4753-b62f-eb47caf9fe3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:15.570052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317c80a-bb51-4753-b62f-eb47caf9fe3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:15.572505 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317c80a-bb51-4753-b62f-eb47caf9fe3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:15.576598 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317c80a-bb51-4753-b62f-eb47caf9fe3e admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:15.599045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 917/1838] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:15.604363 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317c80a-bb51-4753-b62f-eb47caf9fe3e admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:15.625604 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317c80a-bb51-4753-b62f-eb47caf9fe3e admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:15.635940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d00744-c868-454b-840f-3dd609f95d54 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96a12ee56c184380b7db40434f1af4c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c9a736e936d4a14aff66477039bc17a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:15.637073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d00744-c868-454b-840f-3dd609f95d54 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:15.638031 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d00744-c868-454b-840f-3dd609f95d54 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:15.639324 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d00744-c868-454b-840f-3dd609f95d54 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] PATH_INFO: `/v3/projects/226dd6223d124bdaaa5c94de8667115e` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:15.644813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d00744-c868-454b-840f-3dd609f95d54 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] RBAC: Authorizing `identity:delete_project(project_id=226dd6223d124bdaaa5c94de8667115e)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:15.658626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d00744-c868-454b-840f-3dd609f95d54 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:15.728024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-44ed90ff-27a2-443c-9f79-00cd94035bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64f0205f28e9443b8975b28be5711a84', 'request_id': 'req-44ed90ff-27a2-443c-9f79-00cd94035bf1'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:15.895510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-44ed90ff-27a2-443c-9f79-00cd94035bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64f0205f28e9443b8975b28be5711a84', 'request_id': 'req-44ed90ff-27a2-443c-9f79-00cd94035bf1'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:15.913260 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-44ed90ff-27a2-443c-9f79-00cd94035bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64f0205f28e9443b8975b28be5711a84', 'request_id': 'req-44ed90ff-27a2-443c-9f79-00cd94035bf1'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:15.946781 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-44ed90ff-27a2-443c-9f79-00cd94035bf1 admin admin] The token cache is being invalidate because project 64f0205f28e9443b8975b28be5711a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:15.957715 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-44ed90ff-27a2-443c-9f79-00cd94035bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:15.957715 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-44ed90ff-27a2-443c-9f79-00cd94035bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:15.959699 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 922/1839] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:15 2022] DELETE /identity/v3/projects/64f0205f28e9443b8975b28be5711a84 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:15.960734 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed90ff-27a2-443c-9f79-00cd94035bf1 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:15.964858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-44ed90ff-27a2-443c-9f79-00cd94035bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:15.999288 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-74d00744-c868-454b-840f-3dd609f95d54 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '226dd6223d124bdaaa5c94de8667115e', 'request_id': 'req-74d00744-c868-454b-840f-3dd609f95d54'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:16.098877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed90ff-27a2-443c-9f79-00cd94035bf1 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:16.101057 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-74d00744-c868-454b-840f-3dd609f95d54 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '226dd6223d124bdaaa5c94de8667115e', 'request_id': 'req-74d00744-c868-454b-840f-3dd609f95d54'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:16.114262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-74d00744-c868-454b-840f-3dd609f95d54 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '226dd6223d124bdaaa5c94de8667115e', 'request_id': 'req-74d00744-c868-454b-840f-3dd609f95d54'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:16.142309 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-74d00744-c868-454b-840f-3dd609f95d54 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] The token cache is being invalidate because project 226dd6223d124bdaaa5c94de8667115e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:16.143801 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-74d00744-c868-454b-840f-3dd609f95d54 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:16.147805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-74d00744-c868-454b-840f-3dd609f95d54 tempest-VolumeQuotaClassesTest-179833619 tempest-VolumeQuotaClassesTest-179833619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:16.152918 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 918/1840] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:15 2022] DELETE /identity/v3/projects/226dd6223d124bdaaa5c94de8667115e => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:16.154080 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f089812-170d-4639-bd8f-d4ecad2342a7 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:16.154479 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f089812-170d-4639-bd8f-d4ecad2342a7 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:16.154807 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f089812-170d-4639-bd8f-d4ecad2342a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:16.187607 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-5f089812-170d-4639-bd8f-d4ecad2342a7 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:16.189669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-5f089812-170d-4639-bd8f-d4ecad2342a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:16.220340 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103fc55-8829-460c-864a-2c714312e5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:16.221026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103fc55-8829-460c-864a-2c714312e5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:16.221283 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103fc55-8829-460c-864a-2c714312e5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:16.224126 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103fc55-8829-460c-864a-2c714312e5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:16.225872 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103fc55-8829-460c-864a-2c714312e5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:16.228362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103fc55-8829-460c-864a-2c714312e5b0 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:16.249398 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 923/1841] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:16.250489 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103fc55-8829-460c-864a-2c714312e5b0 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:16.261140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-4103fc55-8829-460c-864a-2c714312e5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:16.285780 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103fc55-8829-460c-864a-2c714312e5b0 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:16.291973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b149b95-857c-457b-9f80-10b4ca58b076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:16.292808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b149b95-857c-457b-9f80-10b4ca58b076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:16.293294 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b149b95-857c-457b-9f80-10b4ca58b076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:16.293552 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b149b95-857c-457b-9f80-10b4ca58b076 admin admin] PATH_INFO: `/v3/projects/8a77a64019ad4b3399adfa6d00142bad` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:16.295797 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b149b95-857c-457b-9f80-10b4ca58b076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a77a64019ad4b3399adfa6d00142bad)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:16.298845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b149b95-857c-457b-9f80-10b4ca58b076 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:16.362651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 919/1842] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:16.362651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f089812-170d-4639-bd8f-d4ecad2342a7 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:16.362651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-5f089812-170d-4639-bd8f-d4ecad2342a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:16.378386 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f089812-170d-4639-bd8f-d4ecad2342a7 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:16.384915 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9ba4a-b97e-4b8e-b1c9-16b0e630f995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:16.385911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9ba4a-b97e-4b8e-b1c9-16b0e630f995 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:16.386306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9ba4a-b97e-4b8e-b1c9-16b0e630f995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:16.387329 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9ba4a-b97e-4b8e-b1c9-16b0e630f995 admin admin] PATH_INFO: `/v3/projects/8e5dfc215a9e4bc88345af694d3600a8/users/df3664ef23da4a14bc30a2b41d1ee924/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:16.409837 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9ba4a-b97e-4b8e-b1c9-16b0e630f995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5dfc215a9e4bc88345af694d3600a8, user_id=df3664ef23da4a14bc30a2b41d1ee924, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:16.413066 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9ba4a-b97e-4b8e-b1c9-16b0e630f995 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:16.533093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 920/1843] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:16 2022] PUT /identity/v3/projects/8e5dfc215a9e4bc88345af694d3600a8/users/df3664ef23da4a14bc30a2b41d1ee924/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:16.535032 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeabde7-7da6-4758-8462-9278811bbfba None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:16.535549 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeabde7-7da6-4758-8462-9278811bbfba None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:16.536281 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeabde7-7da6-4758-8462-9278811bbfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:16.553149 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-4b149b95-857c-457b-9f80-10b4ca58b076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a77a64019ad4b3399adfa6d00142bad', 'request_id': 'req-4b149b95-857c-457b-9f80-10b4ca58b076'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:16.568730 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-ddeabde7-7da6-4758-8462-9278811bbfba None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:16.577968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ddeabde7-7da6-4758-8462-9278811bbfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:16.671764 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-4b149b95-857c-457b-9f80-10b4ca58b076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a77a64019ad4b3399adfa6d00142bad', 'request_id': 'req-4b149b95-857c-457b-9f80-10b4ca58b076'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:16.680022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-4b149b95-857c-457b-9f80-10b4ca58b076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a77a64019ad4b3399adfa6d00142bad', 'request_id': 'req-4b149b95-857c-457b-9f80-10b4ca58b076'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:16.699560 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 921/1844] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:16.701533 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b569e8c-b405-4976-8a8f-7f7d5f97812d None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:16.701838 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b569e8c-b405-4976-8a8f-7f7d5f97812d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:16.702107 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b569e8c-b405-4976-8a8f-7f7d5f97812d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:16.705588 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-4b149b95-857c-457b-9f80-10b4ca58b076 admin admin] The token cache is being invalidate because project 8a77a64019ad4b3399adfa6d00142bad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:16.706227 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-4b149b95-857c-457b-9f80-10b4ca58b076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:16.707456 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-4b149b95-857c-457b-9f80-10b4ca58b076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:16.722776 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 924/1845] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:16 2022] DELETE /identity/v3/projects/8a77a64019ad4b3399adfa6d00142bad => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:16.722776 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b149b95-857c-457b-9f80-10b4ca58b076 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:16.722776 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-4b149b95-857c-457b-9f80-10b4ca58b076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:16.740173 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b149b95-857c-457b-9f80-10b4ca58b076 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:16.746998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c5e73-3540-48f6-9172-9d9ec5a1a658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:16.747796 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c5e73-3540-48f6-9172-9d9ec5a1a658 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:16.752111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c5e73-3540-48f6-9172-9d9ec5a1a658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:16.752430 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c5e73-3540-48f6-9172-9d9ec5a1a658 admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:16.753156 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c5e73-3540-48f6-9172-9d9ec5a1a658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:31:16.753466 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c5e73-3540-48f6-9172-9d9ec5a1a658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:16.755175 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c5e73-3540-48f6-9172-9d9ec5a1a658 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:16.764024 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-2b569e8c-b405-4976-8a8f-7f7d5f97812d None None] MFA Rules not processed for user `df3664ef23da4a14bc30a2b41d1ee924`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:16.766000 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-2b569e8c-b405-4976-8a8f-7f7d5f97812d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:16.782791 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 925/1846] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:31:16.782791 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c5e73-3540-48f6-9172-9d9ec5a1a658 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:16.788284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-5c8c5e73-3540-48f6-9172-9d9ec5a1a658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:16.819019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c5e73-3540-48f6-9172-9d9ec5a1a658 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:16.834337 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d3e5d-ed2b-460f-a08f-854d24a522eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:16.838456 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d3e5d-ed2b-460f-a08f-854d24a522eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:16.839001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d3e5d-ed2b-460f-a08f-854d24a522eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:16.839494 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d3e5d-ed2b-460f-a08f-854d24a522eb admin admin] PATH_INFO: `/v3/users/f098dc6eb2fb436ea0d0c8a2e670f88c` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:16.843928 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d3e5d-ed2b-460f-a08f-854d24a522eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f098dc6eb2fb436ea0d0c8a2e670f88c)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:16.855064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d3e5d-ed2b-460f-a08f-854d24a522eb admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:16.916769 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 922/1847] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:16.917804 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b569e8c-b405-4976-8a8f-7f7d5f97812d None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:16.931073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b569e8c-b405-4976-8a8f-7f7d5f97812d None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:16.937690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d3212-1803-45ba-bdd4-f9867d775a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:16.939313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d3212-1803-45ba-bdd4-f9867d775a47 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:16.939801 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d3212-1803-45ba-bdd4-f9867d775a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:16.940352 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d3212-1803-45ba-bdd4-f9867d775a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:16.948221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d3212-1803-45ba-bdd4-f9867d775a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:16.948221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d3212-1803-45ba-bdd4-f9867d775a47 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:17.204864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:17.213297 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 923/1848] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:16 2022] POST /identity/v3/projects => generated 375 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:17.213297 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d3212-1803-45ba-bdd4-f9867d775a47 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:17.223889 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-af4d3212-1803-45ba-bdd4-f9867d775a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:17.277885 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1d0d3e5d-ed2b-460f-a08f-854d24a522eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f098dc6eb2fb436ea0d0c8a2e670f88c'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:17.336018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d3212-1803-45ba-bdd4-f9867d775a47 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:17.353129 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418e825-cb9e-46ca-a405-847f9a1f033b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:17.354525 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418e825-cb9e-46ca-a405-847f9a1f033b admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:17.354525 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418e825-cb9e-46ca-a405-847f9a1f033b admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:17.354846 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418e825-cb9e-46ca-a405-847f9a1f033b admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:17.355812 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418e825-cb9e-46ca-a405-847f9a1f033b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:17.359086 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418e825-cb9e-46ca-a405-847f9a1f033b admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:17.374018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1d0d3e5d-ed2b-460f-a08f-854d24a522eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f098dc6eb2fb436ea0d0c8a2e670f88c'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:17.374789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1d0d3e5d-ed2b-460f-a08f-854d24a522eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f098dc6eb2fb436ea0d0c8a2e670f88c'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:17.386251 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1d0d3e5d-ed2b-460f-a08f-854d24a522eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f098dc6eb2fb436ea0d0c8a2e670f88c'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:17.387149 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1d0d3e5d-ed2b-460f-a08f-854d24a522eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f098dc6eb2fb436ea0d0c8a2e670f88c'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:17.432398 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 926/1849] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:16 2022] DELETE /identity/v3/users/f098dc6eb2fb436ea0d0c8a2e670f88c => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:17.433524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d3e5d-ed2b-460f-a08f-854d24a522eb admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:17.435165 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-1d0d3e5d-ed2b-460f-a08f-854d24a522eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:17.560257 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d3e5d-ed2b-460f-a08f-854d24a522eb admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:17.562303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 924/1850] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:17 2022] POST /identity/v3/projects => generated 385 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:17.563584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418e825-cb9e-46ca-a405-847f9a1f033b admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:17.565714 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-d418e825-cb9e-46ca-a405-847f9a1f033b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:17.657458 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6826c1-1991-4d0a-8a7e-8a23127d82ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:17.658989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6826c1-1991-4d0a-8a7e-8a23127d82ed admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:17.659545 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6826c1-1991-4d0a-8a7e-8a23127d82ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:17.659915 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6826c1-1991-4d0a-8a7e-8a23127d82ed admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:17.661351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6826c1-1991-4d0a-8a7e-8a23127d82ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:17.665018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6826c1-1991-4d0a-8a7e-8a23127d82ed admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:17.697123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418e825-cb9e-46ca-a405-847f9a1f033b admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:17.710353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f8cdf-69f5-49f9-b0fa-063b6abb55d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:17.711856 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f8cdf-69f5-49f9-b0fa-063b6abb55d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:17.712473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f8cdf-69f5-49f9-b0fa-063b6abb55d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:17.713040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f8cdf-69f5-49f9-b0fa-063b6abb55d5 admin admin] PATH_INFO: `/v3/users/5466fdca47aa42f5aa18945ef9552f12` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:17.715912 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f8cdf-69f5-49f9-b0fa-063b6abb55d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5466fdca47aa42f5aa18945ef9552f12)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:17.720299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f8cdf-69f5-49f9-b0fa-063b6abb55d5 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:17.851201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 927/1851] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:17 2022] POST /identity/v3/users => generated 288 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:17.851201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6826c1-1991-4d0a-8a7e-8a23127d82ed admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:17.855620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-6e6826c1-1991-4d0a-8a7e-8a23127d82ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:17.873772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6826c1-1991-4d0a-8a7e-8a23127d82ed admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:17.881965 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e33228-128b-4c00-8e75-82da7ef8cb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:17.883145 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e33228-128b-4c00-8e75-82da7ef8cb6f admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:17.883495 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e33228-128b-4c00-8e75-82da7ef8cb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:17.884032 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e33228-128b-4c00-8e75-82da7ef8cb6f admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:17.889281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e33228-128b-4c00-8e75-82da7ef8cb6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:17.889281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e33228-128b-4c00-8e75-82da7ef8cb6f admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:18.104898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 928/1852] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:17 2022] POST /identity/v3/users => generated 299 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:18.104898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e33228-128b-4c00-8e75-82da7ef8cb6f admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:18.142104 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e33228-128b-4c00-8e75-82da7ef8cb6f admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:18.165914 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ada7c-464e-4960-acd4-10d323c2665c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:18.171551 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ada7c-464e-4960-acd4-10d323c2665c admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:18.171551 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ada7c-464e-4960-acd4-10d323c2665c admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:18.171551 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ada7c-464e-4960-acd4-10d323c2665c admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:18.171551 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ada7c-464e-4960-acd4-10d323c2665c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:18.174902 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ada7c-464e-4960-acd4-10d323c2665c admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:18.209333 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 929/1853] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:18.209333 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ada7c-464e-4960-acd4-10d323c2665c admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:18.224647 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ada7c-464e-4960-acd4-10d323c2665c admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:18.239194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bde87-e258-45b1-8790-04465990e012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:18.240059 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bde87-e258-45b1-8790-04465990e012 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:18.240746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bde87-e258-45b1-8790-04465990e012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:18.241023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bde87-e258-45b1-8790-04465990e012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:18.242127 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bde87-e258-45b1-8790-04465990e012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:18.244685 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bde87-e258-45b1-8790-04465990e012 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:18.259216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-384f8cdf-69f5-49f9-b0fa-063b6abb55d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5466fdca47aa42f5aa18945ef9552f12'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:18.269073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 930/1854] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:18.269073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bde87-e258-45b1-8790-04465990e012 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:18.270242 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-c54bde87-e258-45b1-8790-04465990e012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:18.292971 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-384f8cdf-69f5-49f9-b0fa-063b6abb55d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5466fdca47aa42f5aa18945ef9552f12'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:18.296177 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bde87-e258-45b1-8790-04465990e012 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:18.304638 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d0545-687b-406a-a323-326e9c0035b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:18.305937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d0545-687b-406a-a323-326e9c0035b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:18.306437 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d0545-687b-406a-a323-326e9c0035b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:18.307004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d0545-687b-406a-a323-326e9c0035b3 admin admin] PATH_INFO: `/v3/projects/9779467a7e34485e8dc5a85c1c9054a5` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:18.309078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d0545-687b-406a-a323-326e9c0035b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9779467a7e34485e8dc5a85c1c9054a5)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:18.313609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d0545-687b-406a-a323-326e9c0035b3 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:18.390704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-384f8cdf-69f5-49f9-b0fa-063b6abb55d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5466fdca47aa42f5aa18945ef9552f12'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:18.391542 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-384f8cdf-69f5-49f9-b0fa-063b6abb55d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5466fdca47aa42f5aa18945ef9552f12'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:18.406172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-384f8cdf-69f5-49f9-b0fa-063b6abb55d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5466fdca47aa42f5aa18945ef9552f12'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:18.435963 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 925/1855] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:17 2022] DELETE /identity/v3/users/5466fdca47aa42f5aa18945ef9552f12 => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:18.435963 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f8cdf-69f5-49f9-b0fa-063b6abb55d5 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:18.435963 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-384f8cdf-69f5-49f9-b0fa-063b6abb55d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:18.539629 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-543d0545-687b-406a-a323-326e9c0035b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9779467a7e34485e8dc5a85c1c9054a5', 'request_id': 'req-543d0545-687b-406a-a323-326e9c0035b3'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:18.549594 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f8cdf-69f5-49f9-b0fa-063b6abb55d5 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:18.617514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3374f-531e-47fa-8e77-4d423cc46ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:18.619159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3374f-531e-47fa-8e77-4d423cc46ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:18.619446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3374f-531e-47fa-8e77-4d423cc46ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:18.619745 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3374f-531e-47fa-8e77-4d423cc46ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:18.624656 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3374f-531e-47fa-8e77-4d423cc46ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:18.624656 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3374f-531e-47fa-8e77-4d423cc46ce7 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:18.635310 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 926/1856] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:18.636215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3374f-531e-47fa-8e77-4d423cc46ce7 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:18.637969 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-99d3374f-531e-47fa-8e77-4d423cc46ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:18.652552 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3374f-531e-47fa-8e77-4d423cc46ce7 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:18.658750 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-543d0545-687b-406a-a323-326e9c0035b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9779467a7e34485e8dc5a85c1c9054a5', 'request_id': 'req-543d0545-687b-406a-a323-326e9c0035b3'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:18.659122 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4dd6d-2d4c-4c0b-b649-0cc350a14bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:18.659817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4dd6d-2d4c-4c0b-b649-0cc350a14bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:18.660095 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4dd6d-2d4c-4c0b-b649-0cc350a14bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:18.660389 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4dd6d-2d4c-4c0b-b649-0cc350a14bf8 admin admin] PATH_INFO: `/v3/projects/47a2c3b766f74d64b525bc4ee572e472/users/1bdb8ab60a194bb0aada8d29ee6ffa1f/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:18.665527 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-543d0545-687b-406a-a323-326e9c0035b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9779467a7e34485e8dc5a85c1c9054a5', 'request_id': 'req-543d0545-687b-406a-a323-326e9c0035b3'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:18.677648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4dd6d-2d4c-4c0b-b649-0cc350a14bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a2c3b766f74d64b525bc4ee572e472, user_id=1bdb8ab60a194bb0aada8d29ee6ffa1f, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:18.678788 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-543d0545-687b-406a-a323-326e9c0035b3 admin admin] The token cache is being invalidate because project 9779467a7e34485e8dc5a85c1c9054a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:18.679349 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-543d0545-687b-406a-a323-326e9c0035b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:18.680035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-543d0545-687b-406a-a323-326e9c0035b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:18.680470 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4dd6d-2d4c-4c0b-b649-0cc350a14bf8 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:18.681832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 931/1857] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:18 2022] DELETE /identity/v3/projects/9779467a7e34485e8dc5a85c1c9054a5 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:18.683358 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdae5a-0bc3-49fd-9f78-fc003b4b8cd7 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:18.683653 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdae5a-0bc3-49fd-9f78-fc003b4b8cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:18.683863 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdae5a-0bc3-49fd-9f78-fc003b4b8cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:18.706153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-92cdae5a-0bc3-49fd-9f78-fc003b4b8cd7 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:18.707431 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-92cdae5a-0bc3-49fd-9f78-fc003b4b8cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:18.715651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 932/1858] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:18.717039 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdae5a-0bc3-49fd-9f78-fc003b4b8cd7 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:18.718352 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-92cdae5a-0bc3-49fd-9f78-fc003b4b8cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:18.733558 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdae5a-0bc3-49fd-9f78-fc003b4b8cd7 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:18.738983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc1186-ce2b-4810-ab28-bd471a18e0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:18.739653 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc1186-ce2b-4810-ab28-bd471a18e0d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:18.739933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc1186-ce2b-4810-ab28-bd471a18e0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:18.740202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc1186-ce2b-4810-ab28-bd471a18e0d8 admin admin] PATH_INFO: `/v3/projects/7d5331a0b5474b238de5ea6fb167d775/users/1dd2181744894ea2864efa6803a4ac95/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:18.755888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc1186-ce2b-4810-ab28-bd471a18e0d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5331a0b5474b238de5ea6fb167d775, user_id=1dd2181744894ea2864efa6803a4ac95, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:18.758632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc1186-ce2b-4810-ab28-bd471a18e0d8 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:18.826876 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 927/1859] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:18 2022] PUT /identity/v3/projects/47a2c3b766f74d64b525bc4ee572e472/users/1bdb8ab60a194bb0aada8d29ee6ffa1f/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:18.834266 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e9f7b-09cb-4fbf-ba27-6f89106ac7d7 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:18.834266 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e9f7b-09cb-4fbf-ba27-6f89106ac7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:18.834266 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e9f7b-09cb-4fbf-ba27-6f89106ac7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:18.858462 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-6e3e9f7b-09cb-4fbf-ba27-6f89106ac7d7 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:18.862953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6e3e9f7b-09cb-4fbf-ba27-6f89106ac7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:18.918087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 933/1860] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:18 2022] PUT /identity/v3/projects/7d5331a0b5474b238de5ea6fb167d775/users/1dd2181744894ea2864efa6803a4ac95/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:18.920492 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc1186-ce2b-4810-ab28-bd471a18e0d8 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:18.933037 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f8cc1186-ce2b-4810-ab28-bd471a18e0d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:18.950046 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 928/1861] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:18.952360 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e9f7b-09cb-4fbf-ba27-6f89106ac7d7 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:18.954407 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6e3e9f7b-09cb-4fbf-ba27-6f89106ac7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:18.977433 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e9f7b-09cb-4fbf-ba27-6f89106ac7d7 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:19.043417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc1186-ce2b-4810-ab28-bd471a18e0d8 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:19.048420 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b7c61-3865-4edd-8e0c-5bee143a650a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:19.049151 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b7c61-3865-4edd-8e0c-5bee143a650a service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:19.049491 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b7c61-3865-4edd-8e0c-5bee143a650a service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:19.049821 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b7c61-3865-4edd-8e0c-5bee143a650a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:19.076944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fdcd9-f314-40af-8e35-36f354c71d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:19.078069 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fdcd9-f314-40af-8e35-36f354c71d80 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:19.078852 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fdcd9-f314-40af-8e35-36f354c71d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:19.079344 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fdcd9-f314-40af-8e35-36f354c71d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:19.080747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fdcd9-f314-40af-8e35-36f354c71d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:19.086009 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fdcd9-f314-40af-8e35-36f354c71d80 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:19.105979 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 929/1862] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:19.109022 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7dcd4f-2afe-4ba3-9d63-8afa4fa5ab73 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:19.109530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7dcd4f-2afe-4ba3-9d63-8afa4fa5ab73 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:19.110000 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7dcd4f-2afe-4ba3-9d63-8afa4fa5ab73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:19.150692 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-0f7dcd4f-2afe-4ba3-9d63-8afa4fa5ab73 None None] MFA Rules not processed for user `1dd2181744894ea2864efa6803a4ac95`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:19.152330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-0f7dcd4f-2afe-4ba3-9d63-8afa4fa5ab73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:19.153530 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b7c61-3865-4edd-8e0c-5bee143a650a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:19.158423 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b7c61-3865-4edd-8e0c-5bee143a650a service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:19.180026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 934/1863] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:19.182194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bad9d-8a97-48c3-98e0-74e3f128af6e None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:19.182731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bad9d-8a97-48c3-98e0-74e3f128af6e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:19.183223 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bad9d-8a97-48c3-98e0-74e3f128af6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:19.221893 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-067bad9d-8a97-48c3-98e0-74e3f128af6e None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:19.224743 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-067bad9d-8a97-48c3-98e0-74e3f128af6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:19.253079 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:19.253180 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 935/1864] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:19.253180 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bad9d-8a97-48c3-98e0-74e3f128af6e None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:19.283983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bad9d-8a97-48c3-98e0-74e3f128af6e None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:19.297587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd1345-eb19-4144-b09d-34c7e675d3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:19.298843 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd1345-eb19-4144-b09d-34c7e675d3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:19.301178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd1345-eb19-4144-b09d-34c7e675d3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:19.301464 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd1345-eb19-4144-b09d-34c7e675d3f0 admin admin] PATH_INFO: `/v3/projects/47a2c3b766f74d64b525bc4ee572e472/users/1bdb8ab60a194bb0aada8d29ee6ffa1f/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:19.305000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd1345-eb19-4144-b09d-34c7e675d3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a2c3b766f74d64b525bc4ee572e472, user_id=1bdb8ab60a194bb0aada8d29ee6ffa1f, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:19.308760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd1345-eb19-4144-b09d-34c7e675d3f0 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:19.327215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 930/1865] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:19.330306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7dcd4f-2afe-4ba3-9d63-8afa4fa5ab73 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:19.353934 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 936/1866] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:19 2022] PUT /identity/v3/projects/47a2c3b766f74d64b525bc4ee572e472/users/1bdb8ab60a194bb0aada8d29ee6ffa1f/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:19.353934 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd1345-eb19-4144-b09d-34c7e675d3f0 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:19.366352 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7dcd4f-2afe-4ba3-9d63-8afa4fa5ab73 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:19.451956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd1345-eb19-4144-b09d-34c7e675d3f0 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:19.458894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a788b-e4e6-4671-b276-4f421dfd1391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:19.459810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a788b-e4e6-4671-b276-4f421dfd1391 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:19.460207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a788b-e4e6-4671-b276-4f421dfd1391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:19.460687 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a788b-e4e6-4671-b276-4f421dfd1391 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:19.461505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a788b-e4e6-4671-b276-4f421dfd1391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:19.466655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a788b-e4e6-4671-b276-4f421dfd1391 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:19.512820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e1c1c-a7c5-43a6-83e2-0f4a1fe70af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:19.514263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e1c1c-a7c5-43a6-83e2-0f4a1fe70af9 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:19.514616 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e1c1c-a7c5-43a6-83e2-0f4a1fe70af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:19.515194 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e1c1c-a7c5-43a6-83e2-0f4a1fe70af9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:19.516219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e1c1c-a7c5-43a6-83e2-0f4a1fe70af9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:31:19.521185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e1c1c-a7c5-43a6-83e2-0f4a1fe70af9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:19.521185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e1c1c-a7c5-43a6-83e2-0f4a1fe70af9 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:19.533447 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 931/1867] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:31:19.537954 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c4cc0-aeec-4b66-a184-a2960fc55c5d None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:19.538428 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c4cc0-aeec-4b66-a184-a2960fc55c5d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:19.539305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c4cc0-aeec-4b66-a184-a2960fc55c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:19.587104 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-6e5c4cc0-aeec-4b66-a184-a2960fc55c5d None None] MFA Rules not processed for user `1bdb8ab60a194bb0aada8d29ee6ffa1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:19.588298 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6e5c4cc0-aeec-4b66-a184-a2960fc55c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:19.618575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 937/1868] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:19 2022] POST /identity/v3/projects => generated 375 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:19.625415 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a788b-e4e6-4671-b276-4f421dfd1391 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:19.733306 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a788b-e4e6-4671-b276-4f421dfd1391 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:19.742137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc1bde-b599-4f33-9d51-aa1621355119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:19.743137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc1bde-b599-4f33-9d51-aa1621355119 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:19.743419 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc1bde-b599-4f33-9d51-aa1621355119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:19.743758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc1bde-b599-4f33-9d51-aa1621355119 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:19.750357 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc1bde-b599-4f33-9d51-aa1621355119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:19.750567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 932/1869] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:19.750567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c4cc0-aeec-4b66-a184-a2960fc55c5d None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:19.751076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc1bde-b599-4f33-9d51-aa1621355119 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:19.765187 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c4cc0-aeec-4b66-a184-a2960fc55c5d None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:19.774725 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f5986-76bd-439f-ad53-306992363666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:19.775429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f5986-76bd-439f-ad53-306992363666 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:19.775716 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f5986-76bd-439f-ad53-306992363666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:19.775995 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f5986-76bd-439f-ad53-306992363666 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:19.776676 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f5986-76bd-439f-ad53-306992363666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:19.778830 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f5986-76bd-439f-ad53-306992363666 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:19.917556 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 938/1870] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:19 2022] POST /identity/v3/projects => generated 367 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:19.923724 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc1bde-b599-4f33-9d51-aa1621355119 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:19.925688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f6fc1bde-b599-4f33-9d51-aa1621355119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:19.953875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 933/1871] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:19 2022] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:19.955076 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f5986-76bd-439f-ad53-306992363666 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:19.973831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f5986-76bd-439f-ad53-306992363666 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:20.007603 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc1bde-b599-4f33-9d51-aa1621355119 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:20.011377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecda841-b39f-4ecf-9215-04cddd3222b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:20.012011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecda841-b39f-4ecf-9215-04cddd3222b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:20.012420 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecda841-b39f-4ecf-9215-04cddd3222b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:20.012651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecda841-b39f-4ecf-9215-04cddd3222b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:20.062714 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef75863-20c0-4933-896b-ec63e63be061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:20.063662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef75863-20c0-4933-896b-ec63e63be061 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:20.063662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef75863-20c0-4933-896b-ec63e63be061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:20.063880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef75863-20c0-4933-896b-ec63e63be061 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:20.064613 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef75863-20c0-4933-896b-ec63e63be061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:20.066968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef75863-20c0-4933-896b-ec63e63be061 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:20.110366 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecda841-b39f-4ecf-9215-04cddd3222b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:20.112326 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecda841-b39f-4ecf-9215-04cddd3222b1 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:20.123704 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 939/1872] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:20.124617 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecda841-b39f-4ecf-9215-04cddd3222b1 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:20.135068 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecda841-b39f-4ecf-9215-04cddd3222b1 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:20.141982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae776ea-1d6d-408b-9851-f94ebb55646a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:20.142649 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae776ea-1d6d-408b-9851-f94ebb55646a admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:20.142931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae776ea-1d6d-408b-9851-f94ebb55646a admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:20.143200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae776ea-1d6d-408b-9851-f94ebb55646a admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:20.143883 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae776ea-1d6d-408b-9851-f94ebb55646a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:20.145577 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae776ea-1d6d-408b-9851-f94ebb55646a admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:20.161304 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 940/1873] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:20.162927 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae776ea-1d6d-408b-9851-f94ebb55646a admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:20.166722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-7ae776ea-1d6d-408b-9851-f94ebb55646a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:20.167653 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 934/1874] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:19 2022] POST /identity/v3/users => generated 284 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:20.168206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef75863-20c0-4933-896b-ec63e63be061 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:20.180550 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef75863-20c0-4933-896b-ec63e63be061 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:20.185902 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae776ea-1d6d-408b-9851-f94ebb55646a admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:20.186201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96d172-4cb4-473b-bbf0-aa7ddbba12e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:20.186984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96d172-4cb4-473b-bbf0-aa7ddbba12e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:20.187367 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96d172-4cb4-473b-bbf0-aa7ddbba12e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:20.187804 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96d172-4cb4-473b-bbf0-aa7ddbba12e3 admin admin] PATH_INFO: `/v3/projects/91d6b3e8f70b4adca962a027d9da11b9/users/31340701bb2345c1a284ffa186642ca4/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:20.192872 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09498f08-1d8e-41fb-bae7-60d6c02271b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:20.193750 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09498f08-1d8e-41fb-bae7-60d6c02271b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:20.194172 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09498f08-1d8e-41fb-bae7-60d6c02271b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:20.194620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09498f08-1d8e-41fb-bae7-60d6c02271b0 admin admin] PATH_INFO: `/v3/projects/266c47fe56784d7fa31e0cca1ec258b0` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:20.196128 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09498f08-1d8e-41fb-bae7-60d6c02271b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=266c47fe56784d7fa31e0cca1ec258b0)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:20.198723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09498f08-1d8e-41fb-bae7-60d6c02271b0 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:20.207961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96d172-4cb4-473b-bbf0-aa7ddbba12e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d6b3e8f70b4adca962a027d9da11b9, user_id=31340701bb2345c1a284ffa186642ca4, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:20.211465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96d172-4cb4-473b-bbf0-aa7ddbba12e3 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:20.306334 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 935/1875] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:20 2022] PUT /identity/v3/projects/91d6b3e8f70b4adca962a027d9da11b9/users/31340701bb2345c1a284ffa186642ca4/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:20.307881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96d172-4cb4-473b-bbf0-aa7ddbba12e3 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:20.384918 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96d172-4cb4-473b-bbf0-aa7ddbba12e3 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:20.398305 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-09498f08-1d8e-41fb-bae7-60d6c02271b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '266c47fe56784d7fa31e0cca1ec258b0', 'request_id': 'req-09498f08-1d8e-41fb-bae7-60d6c02271b0'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:20.447621 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92bf83-acbc-4c27-be42-9640e242243f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:20.448238 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92bf83-acbc-4c27-be42-9640e242243f admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:20.448536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92bf83-acbc-4c27-be42-9640e242243f admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:20.448766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92bf83-acbc-4c27-be42-9640e242243f admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:20.449413 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92bf83-acbc-4c27-be42-9640e242243f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:20.451590 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92bf83-acbc-4c27-be42-9640e242243f admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:20.462297 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 936/1876] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:20.463186 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92bf83-acbc-4c27-be42-9640e242243f admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:20.476627 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92bf83-acbc-4c27-be42-9640e242243f admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:20.482407 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662c835-b0f8-46e0-92a0-b08a389169eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:20.483079 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662c835-b0f8-46e0-92a0-b08a389169eb admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:20.486241 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662c835-b0f8-46e0-92a0-b08a389169eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:20.486241 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662c835-b0f8-46e0-92a0-b08a389169eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:20.486241 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662c835-b0f8-46e0-92a0-b08a389169eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:20.486241 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662c835-b0f8-46e0-92a0-b08a389169eb admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:20.496487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 937/1877] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:20.497338 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662c835-b0f8-46e0-92a0-b08a389169eb admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:20.507259 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662c835-b0f8-46e0-92a0-b08a389169eb admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:20.512131 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0760c4d-afff-4930-9fc2-f2d0a6f46230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:20.512659 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0760c4d-afff-4930-9fc2-f2d0a6f46230 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:20.512936 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0760c4d-afff-4930-9fc2-f2d0a6f46230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:20.513207 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0760c4d-afff-4930-9fc2-f2d0a6f46230 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:20.514386 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0760c4d-afff-4930-9fc2-f2d0a6f46230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:20.516096 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0760c4d-afff-4930-9fc2-f2d0a6f46230 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:20.530502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-09498f08-1d8e-41fb-bae7-60d6c02271b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '266c47fe56784d7fa31e0cca1ec258b0', 'request_id': 'req-09498f08-1d8e-41fb-bae7-60d6c02271b0'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:20.531416 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 938/1878] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:20.532673 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0760c4d-afff-4930-9fc2-f2d0a6f46230 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:20.540627 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-09498f08-1d8e-41fb-bae7-60d6c02271b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '266c47fe56784d7fa31e0cca1ec258b0', 'request_id': 'req-09498f08-1d8e-41fb-bae7-60d6c02271b0'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:20.547623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0760c4d-afff-4930-9fc2-f2d0a6f46230 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:20.552687 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187293a-6356-45b2-a4b5-c448b85c498b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:20.553431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187293a-6356-45b2-a4b5-c448b85c498b admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:20.554055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187293a-6356-45b2-a4b5-c448b85c498b admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:20.554335 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187293a-6356-45b2-a4b5-c448b85c498b admin admin] PATH_INFO: `/v3/projects/91d6b3e8f70b4adca962a027d9da11b9/users/31340701bb2345c1a284ffa186642ca4/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:20.556807 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187293a-6356-45b2-a4b5-c448b85c498b admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d6b3e8f70b4adca962a027d9da11b9, user_id=31340701bb2345c1a284ffa186642ca4, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:20.560459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187293a-6356-45b2-a4b5-c448b85c498b admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:20.562066 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-09498f08-1d8e-41fb-bae7-60d6c02271b0 admin admin] The token cache is being invalidate because project 266c47fe56784d7fa31e0cca1ec258b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:20.562390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-09498f08-1d8e-41fb-bae7-60d6c02271b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:20.563611 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-09498f08-1d8e-41fb-bae7-60d6c02271b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:20.566959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 941/1879] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:20 2022] DELETE /identity/v3/projects/266c47fe56784d7fa31e0cca1ec258b0 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:20.568017 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09498f08-1d8e-41fb-bae7-60d6c02271b0 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:20.570893 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-09498f08-1d8e-41fb-bae7-60d6c02271b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:20.579329 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 939/1880] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:20 2022] PUT /identity/v3/projects/91d6b3e8f70b4adca962a027d9da11b9/users/31340701bb2345c1a284ffa186642ca4/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:20.581973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187293a-6356-45b2-a4b5-c448b85c498b admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:20.582268 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-8187293a-6356-45b2-a4b5-c448b85c498b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:20.602166 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09498f08-1d8e-41fb-bae7-60d6c02271b0 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:20.607930 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:20.702278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e483bbc-70f3-468d-9aa0-f0a514234837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:20.703324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e483bbc-70f3-468d-9aa0-f0a514234837 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:20.703566 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e483bbc-70f3-468d-9aa0-f0a514234837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:20.703920 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e483bbc-70f3-468d-9aa0-f0a514234837 admin admin] PATH_INFO: `/v3/projects/c73593c231754a1f877f3a8b3e3095dc/users/2eed6c3d64534474825ef280d50cd942/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:20.774731 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187293a-6356-45b2-a4b5-c448b85c498b admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:20.777216 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e483bbc-70f3-468d-9aa0-f0a514234837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c73593c231754a1f877f3a8b3e3095dc, user_id=2eed6c3d64534474825ef280d50cd942, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:20.794316 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e483bbc-70f3-468d-9aa0-f0a514234837 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:20.810976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16a287-d0c4-4145-9181-cd1a9267ea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:20.814892 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16a287-d0c4-4145-9181-cd1a9267ea1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:20.816291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16a287-d0c4-4145-9181-cd1a9267ea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:20.818390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16a287-d0c4-4145-9181-cd1a9267ea1c admin admin] PATH_INFO: `/v3/users/96a12ee56c184380b7db40434f1af4c0` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:20.827788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16a287-d0c4-4145-9181-cd1a9267ea1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=96a12ee56c184380b7db40434f1af4c0)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:20.844424 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16a287-d0c4-4145-9181-cd1a9267ea1c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:20.985843 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 942/1881] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:20 2022] PUT /identity/v3/projects/c73593c231754a1f877f3a8b3e3095dc/users/2eed6c3d64534474825ef280d50cd942/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:20.988592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a2fa7-3b82-43d2-a0a7-49086edf308e None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:20.988873 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a2fa7-3b82-43d2-a0a7-49086edf308e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:20.989147 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a2fa7-3b82-43d2-a0a7-49086edf308e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:21.045773 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-545a2fa7-3b82-43d2-a0a7-49086edf308e None None] MFA Rules not processed for user `31340701bb2345c1a284ffa186642ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:21.047137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-545a2fa7-3b82-43d2-a0a7-49086edf308e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:21.128764 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 943/1882] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:21.130311 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b89b49-768d-4b7d-b0b1-da1c6ecd0dad None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:21.130932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b89b49-768d-4b7d-b0b1-da1c6ecd0dad None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:21.131589 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b89b49-768d-4b7d-b0b1-da1c6ecd0dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:21.186491 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-f0b89b49-768d-4b7d-b0b1-da1c6ecd0dad None None] MFA Rules not processed for user `2eed6c3d64534474825ef280d50cd942`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:21.188713 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f0b89b49-768d-4b7d-b0b1-da1c6ecd0dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:21.311706 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ce16a287-d0c4-4145-9181-cd1a9267ea1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96a12ee56c184380b7db40434f1af4c0'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:21.312706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 944/1883] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:21.313886 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b89b49-768d-4b7d-b0b1-da1c6ecd0dad None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:21.322356 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f0b89b49-768d-4b7d-b0b1-da1c6ecd0dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:21.346736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ce16a287-d0c4-4145-9181-cd1a9267ea1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96a12ee56c184380b7db40434f1af4c0'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:21.397503 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b89b49-768d-4b7d-b0b1-da1c6ecd0dad None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:21.401950 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55101dd-30f2-42d4-a133-b89f1558fb4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:21.403301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55101dd-30f2-42d4-a133-b89f1558fb4e service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:21.403570 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55101dd-30f2-42d4-a133-b89f1558fb4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:21.403842 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55101dd-30f2-42d4-a133-b89f1558fb4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:21.421415 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b55101dd-30f2-42d4-a133-b89f1558fb4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:21.461092 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ce16a287-d0c4-4145-9181-cd1a9267ea1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96a12ee56c184380b7db40434f1af4c0'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:21.463270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ce16a287-d0c4-4145-9181-cd1a9267ea1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96a12ee56c184380b7db40434f1af4c0'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:21.485044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ce16a287-d0c4-4145-9181-cd1a9267ea1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96a12ee56c184380b7db40434f1af4c0'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:21.500636 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 940/1884] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:20 2022] DELETE /identity/v3/users/96a12ee56c184380b7db40434f1af4c0 => generated 0 bytes in 921 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:21.502150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16a287-d0c4-4145-9181-cd1a9267ea1c admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:21.504089 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ce16a287-d0c4-4145-9181-cd1a9267ea1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:21.581048 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55101dd-30f2-42d4-a133-b89f1558fb4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:21.584263 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55101dd-30f2-42d4-a133-b89f1558fb4e service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:21.603825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 945/1885] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:21.620071 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16a287-d0c4-4145-9181-cd1a9267ea1c admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:21.628462 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781a8b4-8fea-49f9-95ff-205cec7c6a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:21.630017 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781a8b4-8fea-49f9-95ff-205cec7c6a90 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:21.630380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781a8b4-8fea-49f9-95ff-205cec7c6a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:21.631786 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781a8b4-8fea-49f9-95ff-205cec7c6a90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:21.633807 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781a8b4-8fea-49f9-95ff-205cec7c6a90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:21.642349 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781a8b4-8fea-49f9-95ff-205cec7c6a90 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:21.786276 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 941/1886] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:21 2022] POST /identity/v3/projects => generated 369 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:21.790685 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55101dd-30f2-42d4-a133-b89f1558fb4e service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:21.887264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55101dd-30f2-42d4-a133-b89f1558fb4e service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:21.957629 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e984fa-7f0b-4e7d-b539-d74febb3eba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:21.958137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e984fa-7f0b-4e7d-b539-d74febb3eba2 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:21.958507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e984fa-7f0b-4e7d-b539-d74febb3eba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:21.958795 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e984fa-7f0b-4e7d-b539-d74febb3eba2 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:21.959417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e984fa-7f0b-4e7d-b539-d74febb3eba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:21.961441 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e984fa-7f0b-4e7d-b539-d74febb3eba2 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:22.098808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 946/1887] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:21 2022] POST /identity/v3/users => generated 291 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:22.100128 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781a8b4-8fea-49f9-95ff-205cec7c6a90 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:22.117014 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781a8b4-8fea-49f9-95ff-205cec7c6a90 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:22.128752 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21572218-d7b3-4d51-802c-e9d941387d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:22.129992 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21572218-d7b3-4d51-802c-e9d941387d69 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:22.130557 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21572218-d7b3-4d51-802c-e9d941387d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:22.131408 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21572218-d7b3-4d51-802c-e9d941387d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:22.132661 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21572218-d7b3-4d51-802c-e9d941387d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:22.135954 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21572218-d7b3-4d51-802c-e9d941387d69 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:22.160805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 942/1888] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:22.163430 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e984fa-7f0b-4e7d-b539-d74febb3eba2 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:22.177671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e984fa-7f0b-4e7d-b539-d74febb3eba2 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:22.183955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fc7ce-c8dc-4ea6-96ce-5770e84d1619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:22.184670 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fc7ce-c8dc-4ea6-96ce-5770e84d1619 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:22.184953 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fc7ce-c8dc-4ea6-96ce-5770e84d1619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:22.185813 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fc7ce-c8dc-4ea6-96ce-5770e84d1619 admin admin] PATH_INFO: `/v3/projects/2360cb23f1944a51a52f1d4d95ce5a6b/users/388d93e192264a39aeb11520a5d05be8/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:22.208905 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fc7ce-c8dc-4ea6-96ce-5770e84d1619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2360cb23f1944a51a52f1d4d95ce5a6b, user_id=388d93e192264a39aeb11520a5d05be8, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:22.212239 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fc7ce-c8dc-4ea6-96ce-5770e84d1619 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:22.357255 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 947/1889] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:22 2022] PUT /identity/v3/projects/2360cb23f1944a51a52f1d4d95ce5a6b/users/388d93e192264a39aeb11520a5d05be8/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:22.363498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21572218-d7b3-4d51-802c-e9d941387d69 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:22.376706 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21572218-d7b3-4d51-802c-e9d941387d69 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:22.491623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fc7ce-c8dc-4ea6-96ce-5770e84d1619 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:22.494473 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-128fc7ce-c8dc-4ea6-96ce-5770e84d1619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:22.509273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fec6f-f50b-44e0-9d1e-fad08e3340f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:22.511070 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fec6f-f50b-44e0-9d1e-fad08e3340f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:22.513925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fec6f-f50b-44e0-9d1e-fad08e3340f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:22.513925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fec6f-f50b-44e0-9d1e-fad08e3340f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:22.513925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fec6f-f50b-44e0-9d1e-fad08e3340f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:22.525271 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fc7ce-c8dc-4ea6-96ce-5770e84d1619 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:22.530652 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d8c2f-6b91-48a4-9026-5bbac7c902ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:22.531019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d8c2f-6b91-48a4-9026-5bbac7c902ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:22.531297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d8c2f-6b91-48a4-9026-5bbac7c902ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:22.531567 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d8c2f-6b91-48a4-9026-5bbac7c902ed admin admin] PATH_INFO: `/v3/projects/8c9a736e936d4a14aff66477039bc17a` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:22.533857 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d8c2f-6b91-48a4-9026-5bbac7c902ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9a736e936d4a14aff66477039bc17a)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:22.534825 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fec6f-f50b-44e0-9d1e-fad08e3340f0 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:22.536024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d8c2f-6b91-48a4-9026-5bbac7c902ed admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:22.564439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 943/1890] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:22.570149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fec6f-f50b-44e0-9d1e-fad08e3340f0 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:22.590187 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fec6f-f50b-44e0-9d1e-fad08e3340f0 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:22.595265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52464d6c-58cb-434f-ba45-1ba3b65cc4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:22.596222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52464d6c-58cb-434f-ba45-1ba3b65cc4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:22.596960 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52464d6c-58cb-434f-ba45-1ba3b65cc4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:22.597333 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52464d6c-58cb-434f-ba45-1ba3b65cc4cf admin admin] PATH_INFO: `/v3/projects/2360cb23f1944a51a52f1d4d95ce5a6b/users/388d93e192264a39aeb11520a5d05be8/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:22.599507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52464d6c-58cb-434f-ba45-1ba3b65cc4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2360cb23f1944a51a52f1d4d95ce5a6b, user_id=388d93e192264a39aeb11520a5d05be8, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:22.602837 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52464d6c-58cb-434f-ba45-1ba3b65cc4cf admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:22.625068 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 944/1891] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:22 2022] PUT /identity/v3/projects/2360cb23f1944a51a52f1d4d95ce5a6b/users/388d93e192264a39aeb11520a5d05be8/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:22.647444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77c984-d13e-423f-ba26-f61551acd99f None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:22.648469 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77c984-d13e-423f-ba26-f61551acd99f None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:22.648951 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77c984-d13e-423f-ba26-f61551acd99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:22.695118 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-9c77c984-d13e-423f-ba26-f61551acd99f None None] MFA Rules not processed for user `388d93e192264a39aeb11520a5d05be8`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:22.697314 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-9c77c984-d13e-423f-ba26-f61551acd99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:22.733658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-c73d8c2f-6b91-48a4-9026-5bbac7c902ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9a736e936d4a14aff66477039bc17a', 'request_id': 'req-c73d8c2f-6b91-48a4-9026-5bbac7c902ed'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:22.821222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:22.883417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-c73d8c2f-6b91-48a4-9026-5bbac7c902ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9a736e936d4a14aff66477039bc17a', 'request_id': 'req-c73d8c2f-6b91-48a4-9026-5bbac7c902ed'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:22.909352 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-c73d8c2f-6b91-48a4-9026-5bbac7c902ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9a736e936d4a14aff66477039bc17a', 'request_id': 'req-c73d8c2f-6b91-48a4-9026-5bbac7c902ed'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:22.936524 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 945/1892] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:22.941429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77c984-d13e-423f-ba26-f61551acd99f None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:22.956103 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-9c77c984-d13e-423f-ba26-f61551acd99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:22.968206 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-c73d8c2f-6b91-48a4-9026-5bbac7c902ed admin admin] The token cache is being invalidate because project 8c9a736e936d4a14aff66477039bc17a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:22.969706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-c73d8c2f-6b91-48a4-9026-5bbac7c902ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:22.971443 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-c73d8c2f-6b91-48a4-9026-5bbac7c902ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:22.976514 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 948/1893] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:22 2022] DELETE /identity/v3/projects/8c9a736e936d4a14aff66477039bc17a => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:22.978944 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d8c2f-6b91-48a4-9026-5bbac7c902ed admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:22.984385 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-c73d8c2f-6b91-48a4-9026-5bbac7c902ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:23.128227 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d8c2f-6b91-48a4-9026-5bbac7c902ed admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:23.134703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb420f68-25bc-4931-967d-0c489d28952b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:23.135597 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb420f68-25bc-4931-967d-0c489d28952b service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:23.136723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb420f68-25bc-4931-967d-0c489d28952b service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:23.137098 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb420f68-25bc-4931-967d-0c489d28952b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:23.140461 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-bb420f68-25bc-4931-967d-0c489d28952b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:23.199380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77c984-d13e-423f-ba26-f61551acd99f None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:23.280912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb420f68-25bc-4931-967d-0c489d28952b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:23.287545 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb420f68-25bc-4931-967d-0c489d28952b service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:23.310387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 949/1894] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:23.321720 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff946e8c-304d-4141-ad9c-feff94f65b54 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:23.322314 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff946e8c-304d-4141-ad9c-feff94f65b54 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:23.324403 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff946e8c-304d-4141-ad9c-feff94f65b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:23.324726 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064b10c-1551-4aba-b877-3ffb9d7e84fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:23.326902 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064b10c-1551-4aba-b877-3ffb9d7e84fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:23.327653 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064b10c-1551-4aba-b877-3ffb9d7e84fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:23.328298 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064b10c-1551-4aba-b877-3ffb9d7e84fd admin admin] PATH_INFO: `/v3/users/df3664ef23da4a14bc30a2b41d1ee924` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:23.330578 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064b10c-1551-4aba-b877-3ffb9d7e84fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=df3664ef23da4a14bc30a2b41d1ee924)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:23.334477 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064b10c-1551-4aba-b877-3ffb9d7e84fd admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:23.389836 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-ff946e8c-304d-4141-ad9c-feff94f65b54 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:23.391994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ff946e8c-304d-4141-ad9c-feff94f65b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:23.412293 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 950/1895] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:23.416172 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd6ac2-b8e8-4caf-8b61-3e87ec1ea55f None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:23.416735 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd6ac2-b8e8-4caf-8b61-3e87ec1ea55f None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:23.417201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd6ac2-b8e8-4caf-8b61-3e87ec1ea55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:23.458494 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-cefd6ac2-b8e8-4caf-8b61-3e87ec1ea55f None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:23.460561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-cefd6ac2-b8e8-4caf-8b61-3e87ec1ea55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:23.475414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 951/1896] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:23.487914 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd6ac2-b8e8-4caf-8b61-3e87ec1ea55f None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:23.518101 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd6ac2-b8e8-4caf-8b61-3e87ec1ea55f None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:23.525110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d72ed4-13b5-41eb-a367-4e546203183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:23.528468 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d72ed4-13b5-41eb-a367-4e546203183f admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:23.529603 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d72ed4-13b5-41eb-a367-4e546203183f admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:23.530072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d72ed4-13b5-41eb-a367-4e546203183f admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:23.530994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d72ed4-13b5-41eb-a367-4e546203183f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:31:23.531773 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d72ed4-13b5-41eb-a367-4e546203183f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:23.534105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d72ed4-13b5-41eb-a367-4e546203183f admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:23.556328 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 952/1897] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:31:23.557717 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d72ed4-13b5-41eb-a367-4e546203183f admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:23.573998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d72ed4-13b5-41eb-a367-4e546203183f admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:23.582624 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875cc5a-bb2b-4414-bc1a-956d97a29393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:23.583769 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875cc5a-bb2b-4414-bc1a-956d97a29393 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:23.584220 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875cc5a-bb2b-4414-bc1a-956d97a29393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:23.584689 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875cc5a-bb2b-4414-bc1a-956d97a29393 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:23.585638 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875cc5a-bb2b-4414-bc1a-956d97a29393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:23.589028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875cc5a-bb2b-4414-bc1a-956d97a29393 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:23.707411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-9064b10c-1551-4aba-b877-3ffb9d7e84fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df3664ef23da4a14bc30a2b41d1ee924'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:23.729215 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 953/1898] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:23 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:23.736036 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875cc5a-bb2b-4414-bc1a-956d97a29393 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:23.771919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-9064b10c-1551-4aba-b877-3ffb9d7e84fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df3664ef23da4a14bc30a2b41d1ee924'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:23.808314 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:23.878513 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-9064b10c-1551-4aba-b877-3ffb9d7e84fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df3664ef23da4a14bc30a2b41d1ee924'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:23.879512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-9064b10c-1551-4aba-b877-3ffb9d7e84fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df3664ef23da4a14bc30a2b41d1ee924'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:23.895684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-9064b10c-1551-4aba-b877-3ffb9d7e84fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df3664ef23da4a14bc30a2b41d1ee924'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:23.914489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 946/1899] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:22 2022] DELETE /identity/v3/users/df3664ef23da4a14bc30a2b41d1ee924 => generated 0 bytes in 971 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:23.920820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e651708-daa5-42c8-8a93-6172b444626f None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:23.920820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e651708-daa5-42c8-8a93-6172b444626f None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:23.920820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e651708-daa5-42c8-8a93-6172b444626f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:23.944498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875cc5a-bb2b-4414-bc1a-956d97a29393 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:23.992405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-8e651708-daa5-42c8-8a93-6172b444626f None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:24.001338 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-8e651708-daa5-42c8-8a93-6172b444626f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:24.105328 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea474a-ac19-48e7-b448-7341e5647e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:24.107735 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea474a-ac19-48e7-b448-7341e5647e5c admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:24.108382 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea474a-ac19-48e7-b448-7341e5647e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:24.109156 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea474a-ac19-48e7-b448-7341e5647e5c admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:24.110769 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea474a-ac19-48e7-b448-7341e5647e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:24.116756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea474a-ac19-48e7-b448-7341e5647e5c admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:24.276344 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 954/1900] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:23 2022] POST /identity/v3/users => generated 293 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:31:24.283720 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea474a-ac19-48e7-b448-7341e5647e5c admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:24.286814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 947/1901] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:24.288505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b6ea474a-ac19-48e7-b448-7341e5647e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:24.326984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea474a-ac19-48e7-b448-7341e5647e5c admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:24.336116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08ada9-c88c-4c4a-93c1-10635a267e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:24.337629 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08ada9-c88c-4c4a-93c1-10635a267e99 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:24.338119 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08ada9-c88c-4c4a-93c1-10635a267e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:24.338681 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08ada9-c88c-4c4a-93c1-10635a267e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:24.340219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08ada9-c88c-4c4a-93c1-10635a267e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:24.344993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08ada9-c88c-4c4a-93c1-10635a267e99 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:24.363771 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e651708-daa5-42c8-8a93-6172b444626f None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:24.366706 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-8e651708-daa5-42c8-8a93-6172b444626f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:24.390629 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 955/1902] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:24.392482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08ada9-c88c-4c4a-93c1-10635a267e99 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:24.422278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08ada9-c88c-4c4a-93c1-10635a267e99 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:24.453955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc1b19-8a3c-486a-8cef-6d9a1bddad31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:24.455080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc1b19-8a3c-486a-8cef-6d9a1bddad31 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:24.456022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc1b19-8a3c-486a-8cef-6d9a1bddad31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:24.456022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc1b19-8a3c-486a-8cef-6d9a1bddad31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:24.457194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc1b19-8a3c-486a-8cef-6d9a1bddad31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:24.460552 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc1b19-8a3c-486a-8cef-6d9a1bddad31 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:24.509041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 956/1903] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:24.512738 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc1b19-8a3c-486a-8cef-6d9a1bddad31 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:24.542925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e651708-daa5-42c8-8a93-6172b444626f None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:24.543955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fde78-8ce0-4c2d-aedf-23f17cb8e720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:24.544487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fde78-8ce0-4c2d-aedf-23f17cb8e720 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:24.545427 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fde78-8ce0-4c2d-aedf-23f17cb8e720 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:24.545736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fde78-8ce0-4c2d-aedf-23f17cb8e720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:24.549660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc1b19-8a3c-486a-8cef-6d9a1bddad31 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:24.568752 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fde78-8ce0-4c2d-aedf-23f17cb8e720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:24.572064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90b194-652f-4c8c-954f-630927b2fa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:24.572810 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fde78-8ce0-4c2d-aedf-23f17cb8e720 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:24.572967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90b194-652f-4c8c-954f-630927b2fa01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:24.579425 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90b194-652f-4c8c-954f-630927b2fa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:24.579936 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90b194-652f-4c8c-954f-630927b2fa01 admin admin] PATH_INFO: `/v3/projects/bf14d644f9614396b432bef8e49f0edb/users/e9a4955474ac404e832880ad13b22d37/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:24.587752 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 948/1904] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:31:24.641434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90b194-652f-4c8c-954f-630927b2fa01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf14d644f9614396b432bef8e49f0edb, user_id=e9a4955474ac404e832880ad13b22d37, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:24.644902 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90b194-652f-4c8c-954f-630927b2fa01 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:24.748801 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 957/1905] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:24 2022] PUT /identity/v3/projects/bf14d644f9614396b432bef8e49f0edb/users/e9a4955474ac404e832880ad13b22d37/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:24.762928 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10b1a3-673d-4059-b5bc-c8a8c83ef818 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:24.764294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10b1a3-673d-4059-b5bc-c8a8c83ef818 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:24.764693 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10b1a3-673d-4059-b5bc-c8a8c83ef818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:24.821498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-5a10b1a3-673d-4059-b5bc-c8a8c83ef818 None None] MFA Rules not processed for user `e9a4955474ac404e832880ad13b22d37`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:24.823364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-5a10b1a3-673d-4059-b5bc-c8a8c83ef818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:24.970896 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 949/1906] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:24.976100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90b194-652f-4c8c-954f-630927b2fa01 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:25.130120 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:25.180285 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90b194-652f-4c8c-954f-630927b2fa01 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:25.187939 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3316d6-f696-4f58-b698-88fdc97f257e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:25.189562 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3316d6-f696-4f58-b698-88fdc97f257e admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:25.189955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3316d6-f696-4f58-b698-88fdc97f257e admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:25.190244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3316d6-f696-4f58-b698-88fdc97f257e admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:25.190949 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3316d6-f696-4f58-b698-88fdc97f257e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:25.193312 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3316d6-f696-4f58-b698-88fdc97f257e admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:25.344273 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 958/1907] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:24 2022] POST /identity/v3/projects => generated 385 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:25.350698 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10b1a3-673d-4059-b5bc-c8a8c83ef818 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:25.404015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10b1a3-673d-4059-b5bc-c8a8c83ef818 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:25.514069 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7eecae-4f1c-46b0-9fe6-012c5236c91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:25.515053 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eecae-4f1c-46b0-9fe6-012c5236c91a admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:25.515525 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eecae-4f1c-46b0-9fe6-012c5236c91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:25.515955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eecae-4f1c-46b0-9fe6-012c5236c91a admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:25.517066 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7eecae-4f1c-46b0-9fe6-012c5236c91a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:25.519817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7eecae-4f1c-46b0-9fe6-012c5236c91a admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:25.549097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3316d6-f696-4f58-b698-88fdc97f257e admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:25.552022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-0c3316d6-f696-4f58-b698-88fdc97f257e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:25.580431 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3316d6-f696-4f58-b698-88fdc97f257e admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:25.589521 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0b854-e0cf-48fc-b880-b10ddb6e0093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:25.590318 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b854-e0cf-48fc-b880-b10ddb6e0093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:25.590702 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b854-e0cf-48fc-b880-b10ddb6e0093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:25.590908 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b854-e0cf-48fc-b880-b10ddb6e0093 admin admin] PATH_INFO: `/v3/projects/8e5dfc215a9e4bc88345af694d3600a8` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:25.592331 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0b854-e0cf-48fc-b880-b10ddb6e0093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5dfc215a9e4bc88345af694d3600a8)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:25.594903 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0b854-e0cf-48fc-b880-b10ddb6e0093 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:25.709198 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 950/1908] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:25 2022] POST /identity/v3/users => generated 293 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:25.717832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7eecae-4f1c-46b0-9fe6-012c5236c91a admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:25.744757 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7eecae-4f1c-46b0-9fe6-012c5236c91a admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:25.757983 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87cb67-9b64-4ae5-835f-e00daed51cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:25.762086 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87cb67-9b64-4ae5-835f-e00daed51cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:25.766166 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87cb67-9b64-4ae5-835f-e00daed51cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:25.766946 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87cb67-9b64-4ae5-835f-e00daed51cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:25.777655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87cb67-9b64-4ae5-835f-e00daed51cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:25.781153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87cb67-9b64-4ae5-835f-e00daed51cf0 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:25.844426 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 951/1909] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:25.846103 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87cb67-9b64-4ae5-835f-e00daed51cf0 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:25.851886 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-24b0b854-e0cf-48fc-b880-b10ddb6e0093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5dfc215a9e4bc88345af694d3600a8', 'request_id': 'req-24b0b854-e0cf-48fc-b880-b10ddb6e0093'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:25.891711 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87cb67-9b64-4ae5-835f-e00daed51cf0 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:25.991700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-24b0b854-e0cf-48fc-b880-b10ddb6e0093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5dfc215a9e4bc88345af694d3600a8', 'request_id': 'req-24b0b854-e0cf-48fc-b880-b10ddb6e0093'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:26.007294 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-24b0b854-e0cf-48fc-b880-b10ddb6e0093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5dfc215a9e4bc88345af694d3600a8', 'request_id': 'req-24b0b854-e0cf-48fc-b880-b10ddb6e0093'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:26.049016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-24b0b854-e0cf-48fc-b880-b10ddb6e0093 admin admin] The token cache is being invalidate because project 8e5dfc215a9e4bc88345af694d3600a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:26.052964 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-24b0b854-e0cf-48fc-b880-b10ddb6e0093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:26.052964 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-24b0b854-e0cf-48fc-b880-b10ddb6e0093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:26.053686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 959/1910] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:25 2022] DELETE /identity/v3/projects/8e5dfc215a9e4bc88345af694d3600a8 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:31:26.059764 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0b854-e0cf-48fc-b880-b10ddb6e0093 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:26.076768 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-24b0b854-e0cf-48fc-b880-b10ddb6e0093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:26.108607 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1e292-45e8-41e0-89be-309f6288088b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:26.109704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1e292-45e8-41e0-89be-309f6288088b admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:26.115924 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1e292-45e8-41e0-89be-309f6288088b admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:26.115924 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1e292-45e8-41e0-89be-309f6288088b admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:26.115924 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1e292-45e8-41e0-89be-309f6288088b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:26.115924 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1e292-45e8-41e0-89be-309f6288088b admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:26.143820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 952/1911] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:26.145759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1e292-45e8-41e0-89be-309f6288088b admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:26.149267 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-9ad1e292-45e8-41e0-89be-309f6288088b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:26.183246 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1e292-45e8-41e0-89be-309f6288088b admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:26.196367 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f7ce8-5c5a-4266-a656-e43dde0c1365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:26.199674 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f7ce8-5c5a-4266-a656-e43dde0c1365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:26.200089 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f7ce8-5c5a-4266-a656-e43dde0c1365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:26.200653 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f7ce8-5c5a-4266-a656-e43dde0c1365 admin admin] PATH_INFO: `/v3/users/1dd2181744894ea2864efa6803a4ac95` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:26.204774 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f7ce8-5c5a-4266-a656-e43dde0c1365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dd2181744894ea2864efa6803a4ac95)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:26.210037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f7ce8-5c5a-4266-a656-e43dde0c1365 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:26.302178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:26.313087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0b854-e0cf-48fc-b880-b10ddb6e0093 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:26.328925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072871b-d7c9-4caa-ba0e-2c6276e4720f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:26.330740 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072871b-d7c9-4caa-ba0e-2c6276e4720f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:26.331598 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072871b-d7c9-4caa-ba0e-2c6276e4720f admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:26.332787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072871b-d7c9-4caa-ba0e-2c6276e4720f admin admin] PATH_INFO: `/v3/users/1bdb8ab60a194bb0aada8d29ee6ffa1f` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:26.338822 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072871b-d7c9-4caa-ba0e-2c6276e4720f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bdb8ab60a194bb0aada8d29ee6ffa1f)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:26.344213 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072871b-d7c9-4caa-ba0e-2c6276e4720f admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:26.954629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0e5f7ce8-5c5a-4266-a656-e43dde0c1365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dd2181744894ea2864efa6803a4ac95'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:26.990013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0e5f7ce8-5c5a-4266-a656-e43dde0c1365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dd2181744894ea2864efa6803a4ac95'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:27.066001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-5072871b-d7c9-4caa-ba0e-2c6276e4720f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bdb8ab60a194bb0aada8d29ee6ffa1f'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:27.162284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0e5f7ce8-5c5a-4266-a656-e43dde0c1365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dd2181744894ea2864efa6803a4ac95'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:27.163020 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0e5f7ce8-5c5a-4266-a656-e43dde0c1365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dd2181744894ea2864efa6803a4ac95'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:27.186792 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0e5f7ce8-5c5a-4266-a656-e43dde0c1365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dd2181744894ea2864efa6803a4ac95'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:27.197338 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 953/1912] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:26 2022] DELETE /identity/v3/users/1dd2181744894ea2864efa6803a4ac95 => generated 0 bytes in 1043 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:27.197338 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f7ce8-5c5a-4266-a656-e43dde0c1365 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:27.201633 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-0e5f7ce8-5c5a-4266-a656-e43dde0c1365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:27.240292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-5072871b-d7c9-4caa-ba0e-2c6276e4720f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bdb8ab60a194bb0aada8d29ee6ffa1f'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:27.244202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-5072871b-d7c9-4caa-ba0e-2c6276e4720f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bdb8ab60a194bb0aada8d29ee6ffa1f'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:27.280181 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-5072871b-d7c9-4caa-ba0e-2c6276e4720f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bdb8ab60a194bb0aada8d29ee6ffa1f'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:27.281828 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-5072871b-d7c9-4caa-ba0e-2c6276e4720f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bdb8ab60a194bb0aada8d29ee6ffa1f'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:27.382931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 960/1913] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:26 2022] DELETE /identity/v3/users/1bdb8ab60a194bb0aada8d29ee6ffa1f => generated 0 bytes in 1318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:31:27.385230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb62ee-3728-4508-8cd4-2a06319ccc9c None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:27.391510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb62ee-3728-4508-8cd4-2a06319ccc9c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:27.393136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb62ee-3728-4508-8cd4-2a06319ccc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:27.480394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-59fb62ee-3728-4508-8cd4-2a06319ccc9c None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:27.485800 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-59fb62ee-3728-4508-8cd4-2a06319ccc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:27.563968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f7ce8-5c5a-4266-a656-e43dde0c1365 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:27.777833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 961/1914] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:27.805451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb62ee-3728-4508-8cd4-2a06319ccc9c None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:27.805451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-59fb62ee-3728-4508-8cd4-2a06319ccc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:27.858272 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e2d13-8e32-4cce-9b67-197a806c0caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:27.859962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e2d13-8e32-4cce-9b67-197a806c0caa admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:27.860674 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e2d13-8e32-4cce-9b67-197a806c0caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:27.861374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e2d13-8e32-4cce-9b67-197a806c0caa admin admin] PATH_INFO: `/v3/projects/da7d5ffedd4d4fb5abdf5de7e8e7c6a7/users/25680a66c1554d7d9df8bcb45ca7a346/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:27.894379 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e2d13-8e32-4cce-9b67-197a806c0caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=da7d5ffedd4d4fb5abdf5de7e8e7c6a7, user_id=25680a66c1554d7d9df8bcb45ca7a346, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:27.902078 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e2d13-8e32-4cce-9b67-197a806c0caa admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:28.014907 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb62ee-3728-4508-8cd4-2a06319ccc9c None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:28.042125 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c68c5-37dc-4294-9ed1-96165641ce9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:28.044756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c68c5-37dc-4294-9ed1-96165641ce9c service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:28.048682 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c68c5-37dc-4294-9ed1-96165641ce9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:28.048682 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c68c5-37dc-4294-9ed1-96165641ce9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:28.123796 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c68c5-37dc-4294-9ed1-96165641ce9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:28.127429 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c68c5-37dc-4294-9ed1-96165641ce9c service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:28.163485 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 954/1915] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:27 2022] PUT /identity/v3/projects/da7d5ffedd4d4fb5abdf5de7e8e7c6a7/users/25680a66c1554d7d9df8bcb45ca7a346/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 964 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:28.170476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 962/1916] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:28.184590 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d57e6d-9909-4518-9ebe-d3a1a7cdd92c None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:28.190249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d57e6d-9909-4518-9ebe-d3a1a7cdd92c None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:28.190249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d57e6d-9909-4518-9ebe-d3a1a7cdd92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:28.215790 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:28.269314 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-56d57e6d-9909-4518-9ebe-d3a1a7cdd92c None None] MFA Rules not processed for user `25680a66c1554d7d9df8bcb45ca7a346`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:28.272906 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-56d57e6d-9909-4518-9ebe-d3a1a7cdd92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:28.387679 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:28.510515 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 955/1917] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:28.516711 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c68c5-37dc-4294-9ed1-96165641ce9c service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:28.519539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-006c68c5-37dc-4294-9ed1-96165641ce9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:28.551277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c68c5-37dc-4294-9ed1-96165641ce9c service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:28.645433 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d57e6d-9909-4518-9ebe-d3a1a7cdd92c None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:28.648187 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-56d57e6d-9909-4518-9ebe-d3a1a7cdd92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:28.726179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4bed4-b89d-4678-8455-86f5c5909ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:28.726179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4bed4-b89d-4678-8455-86f5c5909ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:28.726179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4bed4-b89d-4678-8455-86f5c5909ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:28.726179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4bed4-b89d-4678-8455-86f5c5909ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:28.726693 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4bed4-b89d-4678-8455-86f5c5909ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:28.727616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4bed4-b89d-4678-8455-86f5c5909ff6 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:28.889380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d57e6d-9909-4518-9ebe-d3a1a7cdd92c None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:28.896564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291ef57-da5c-4a2d-beee-0c1a2d92420c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:28.898067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291ef57-da5c-4a2d-beee-0c1a2d92420c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:28.898768 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291ef57-da5c-4a2d-beee-0c1a2d92420c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:28.899794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291ef57-da5c-4a2d-beee-0c1a2d92420c admin admin] PATH_INFO: `/v3/projects/47a2c3b766f74d64b525bc4ee572e472` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:28.902208 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291ef57-da5c-4a2d-beee-0c1a2d92420c admin admin] RBAC: Authorizing `identity:delete_project(project_id=47a2c3b766f74d64b525bc4ee572e472)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:28.906827 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291ef57-da5c-4a2d-beee-0c1a2d92420c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:28.943469 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 963/1918] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:28 2022] POST /identity/v3/projects => generated 383 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:28.950038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4bed4-b89d-4678-8455-86f5c5909ff6 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:29.070359 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4bed4-b89d-4678-8455-86f5c5909ff6 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:29.078148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cbc5b-70ff-470e-a699-ecb83a711895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:29.079047 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cbc5b-70ff-470e-a699-ecb83a711895 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:29.079413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cbc5b-70ff-470e-a699-ecb83a711895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:29.079773 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cbc5b-70ff-470e-a699-ecb83a711895 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:29.080672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cbc5b-70ff-470e-a699-ecb83a711895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:29.082868 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cbc5b-70ff-470e-a699-ecb83a711895 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:29.169289 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4291ef57-da5c-4a2d-beee-0c1a2d92420c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47a2c3b766f74d64b525bc4ee572e472', 'request_id': 'req-4291ef57-da5c-4a2d-beee-0c1a2d92420c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:29.236058 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 964/1919] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:28 2022] POST /identity/v3/users => generated 298 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:29.237916 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cbc5b-70ff-470e-a699-ecb83a711895 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:29.240671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-4b8cbc5b-70ff-470e-a699-ecb83a711895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:29.257720 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cbc5b-70ff-470e-a699-ecb83a711895 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:29.340125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4291ef57-da5c-4a2d-beee-0c1a2d92420c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47a2c3b766f74d64b525bc4ee572e472', 'request_id': 'req-4291ef57-da5c-4a2d-beee-0c1a2d92420c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:29.354240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4291ef57-da5c-4a2d-beee-0c1a2d92420c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47a2c3b766f74d64b525bc4ee572e472', 'request_id': 'req-4291ef57-da5c-4a2d-beee-0c1a2d92420c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:29.382821 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4291ef57-da5c-4a2d-beee-0c1a2d92420c admin admin] The token cache is being invalidate because project 47a2c3b766f74d64b525bc4ee572e472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:29.382821 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4291ef57-da5c-4a2d-beee-0c1a2d92420c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:29.382821 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4291ef57-da5c-4a2d-beee-0c1a2d92420c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:29.382821 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 956/1920] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:28 2022] DELETE /identity/v3/projects/47a2c3b766f74d64b525bc4ee572e472 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:31:29.382821 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291ef57-da5c-4a2d-beee-0c1a2d92420c admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:29.383436 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4291ef57-da5c-4a2d-beee-0c1a2d92420c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:29.398434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9ed4d-982d-4f94-aa75-777c3813595e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:29.399251 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9ed4d-982d-4f94-aa75-777c3813595e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:29.399618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9ed4d-982d-4f94-aa75-777c3813595e admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:29.399965 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9ed4d-982d-4f94-aa75-777c3813595e admin admin] PATH_INFO: `/v3/projects/7d5331a0b5474b238de5ea6fb167d775` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:29.401725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9ed4d-982d-4f94-aa75-777c3813595e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d5331a0b5474b238de5ea6fb167d775)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:29.403869 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9ed4d-982d-4f94-aa75-777c3813595e admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:29.508767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291ef57-da5c-4a2d-beee-0c1a2d92420c admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:29.519160 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033b9af-01cd-4303-879e-3d97bdfc75d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:29.519845 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033b9af-01cd-4303-879e-3d97bdfc75d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:29.520267 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033b9af-01cd-4303-879e-3d97bdfc75d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:29.520682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033b9af-01cd-4303-879e-3d97bdfc75d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:29.521389 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033b9af-01cd-4303-879e-3d97bdfc75d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:29.523509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033b9af-01cd-4303-879e-3d97bdfc75d8 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:29.537108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 957/1921] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:29.537108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3113f-926f-428b-bc76-48d764caae5a None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:29.537108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3113f-926f-428b-bc76-48d764caae5a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:29.537108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3113f-926f-428b-bc76-48d764caae5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:29.559308 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-eae3113f-926f-428b-bc76-48d764caae5a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:29.560790 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-eae3113f-926f-428b-bc76-48d764caae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:29.569656 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 958/1922] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:29.570772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3113f-926f-428b-bc76-48d764caae5a None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:29.581175 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3113f-926f-428b-bc76-48d764caae5a None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:29.585971 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b71978-a33a-47e3-a4fb-74753dbb07ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:29.586614 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b71978-a33a-47e3-a4fb-74753dbb07ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:29.586890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b71978-a33a-47e3-a4fb-74753dbb07ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:29.587161 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b71978-a33a-47e3-a4fb-74753dbb07ab admin admin] PATH_INFO: `/v3/projects/e2eece3dce0e4106bee1633049c4c926/users/a7c1ad2910e94024acd11601a46aed28/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:29.602290 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b71978-a33a-47e3-a4fb-74753dbb07ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2eece3dce0e4106bee1633049c4c926, user_id=a7c1ad2910e94024acd11601a46aed28, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:29.604992 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b71978-a33a-47e3-a4fb-74753dbb07ab admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:29.692567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 959/1923] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:29 2022] PUT /identity/v3/projects/e2eece3dce0e4106bee1633049c4c926/users/a7c1ad2910e94024acd11601a46aed28/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:29.695027 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28606060-df1e-4578-98d4-2ed39e4676a5 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:29.696030 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28606060-df1e-4578-98d4-2ed39e4676a5 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:29.696564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28606060-df1e-4578-98d4-2ed39e4676a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:29.707024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-76d9ed4d-982d-4f94-aa75-777c3813595e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d5331a0b5474b238de5ea6fb167d775', 'request_id': 'req-76d9ed4d-982d-4f94-aa75-777c3813595e'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:29.727011 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-28606060-df1e-4578-98d4-2ed39e4676a5 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:29.731230 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-28606060-df1e-4578-98d4-2ed39e4676a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:29.793671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-76d9ed4d-982d-4f94-aa75-777c3813595e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d5331a0b5474b238de5ea6fb167d775', 'request_id': 'req-76d9ed4d-982d-4f94-aa75-777c3813595e'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:29.806159 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-76d9ed4d-982d-4f94-aa75-777c3813595e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d5331a0b5474b238de5ea6fb167d775', 'request_id': 'req-76d9ed4d-982d-4f94-aa75-777c3813595e'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:29.829600 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-76d9ed4d-982d-4f94-aa75-777c3813595e admin admin] The token cache is being invalidate because project 7d5331a0b5474b238de5ea6fb167d775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:29.829973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-76d9ed4d-982d-4f94-aa75-777c3813595e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:29.830754 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-76d9ed4d-982d-4f94-aa75-777c3813595e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:29.836509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 965/1924] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:29 2022] DELETE /identity/v3/projects/7d5331a0b5474b238de5ea6fb167d775 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:29.836509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9ed4d-982d-4f94-aa75-777c3813595e admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:29.836509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-76d9ed4d-982d-4f94-aa75-777c3813595e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:29.847505 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 960/1925] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:29.849477 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28606060-df1e-4578-98d4-2ed39e4676a5 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:29.853103 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-28606060-df1e-4578-98d4-2ed39e4676a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:29.868911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9ed4d-982d-4f94-aa75-777c3813595e admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:29.868911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3bf29-9f57-4eb3-abe8-aab7532baab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:29.868911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3bf29-9f57-4eb3-abe8-aab7532baab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:29.868911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3bf29-9f57-4eb3-abe8-aab7532baab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:29.869495 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3bf29-9f57-4eb3-abe8-aab7532baab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:29.869495 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3bf29-9f57-4eb3-abe8-aab7532baab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:29.869495 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3bf29-9f57-4eb3-abe8-aab7532baab1 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:29.885626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28606060-df1e-4578-98d4-2ed39e4676a5 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:29.889113 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 966/1926] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:29.890537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3bf29-9f57-4eb3-abe8-aab7532baab1 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:29.895724 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-12a3bf29-9f57-4eb3-abe8-aab7532baab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:29.897226 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d031fb-a41b-4cf2-861c-eb8baead3564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:29.898251 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d031fb-a41b-4cf2-861c-eb8baead3564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:29.898723 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d031fb-a41b-4cf2-861c-eb8baead3564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:29.899185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d031fb-a41b-4cf2-861c-eb8baead3564 admin admin] PATH_INFO: `/v3/users/31340701bb2345c1a284ffa186642ca4` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:29.901225 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d031fb-a41b-4cf2-861c-eb8baead3564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31340701bb2345c1a284ffa186642ca4)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:29.905101 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d031fb-a41b-4cf2-861c-eb8baead3564 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:29.915810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3bf29-9f57-4eb3-abe8-aab7532baab1 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:29.924587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a448f2-999f-4f22-ac04-cb687c8ac328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:29.925702 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a448f2-999f-4f22-ac04-cb687c8ac328 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:29.926493 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a448f2-999f-4f22-ac04-cb687c8ac328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:29.927867 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a448f2-999f-4f22-ac04-cb687c8ac328 admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:29.927867 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a448f2-999f-4f22-ac04-cb687c8ac328 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:31:29.928355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a448f2-999f-4f22-ac04-cb687c8ac328 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:29.930922 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a448f2-999f-4f22-ac04-cb687c8ac328 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:29.952694 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 967/1927] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:31:29.954537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a448f2-999f-4f22-ac04-cb687c8ac328 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:29.956996 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-44a448f2-999f-4f22-ac04-cb687c8ac328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:29.977845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a448f2-999f-4f22-ac04-cb687c8ac328 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:29.985249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21773c8-791a-4171-84d8-ac347f00c72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:29.985905 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21773c8-791a-4171-84d8-ac347f00c72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:29.986184 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21773c8-791a-4171-84d8-ac347f00c72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:29.986452 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21773c8-791a-4171-84d8-ac347f00c72e admin admin] PATH_INFO: `/v3/users/2eed6c3d64534474825ef280d50cd942` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:29.987725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21773c8-791a-4171-84d8-ac347f00c72e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eed6c3d64534474825ef280d50cd942)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:29.989697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21773c8-791a-4171-84d8-ac347f00c72e admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:30.255119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-79d031fb-a41b-4cf2-861c-eb8baead3564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31340701bb2345c1a284ffa186642ca4'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:30.285657 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-a21773c8-791a-4171-84d8-ac347f00c72e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eed6c3d64534474825ef280d50cd942'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:30.288048 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-79d031fb-a41b-4cf2-861c-eb8baead3564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31340701bb2345c1a284ffa186642ca4'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:30.369530 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-a21773c8-791a-4171-84d8-ac347f00c72e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eed6c3d64534474825ef280d50cd942'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:30.370259 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-a21773c8-791a-4171-84d8-ac347f00c72e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eed6c3d64534474825ef280d50cd942'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:30.384911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-a21773c8-791a-4171-84d8-ac347f00c72e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eed6c3d64534474825ef280d50cd942'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:30.386295 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-a21773c8-791a-4171-84d8-ac347f00c72e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eed6c3d64534474825ef280d50cd942'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:30.391596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:30.420389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 968/1928] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:29 2022] DELETE /identity/v3/users/2eed6c3d64534474825ef280d50cd942 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:30.421295 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21773c8-791a-4171-84d8-ac347f00c72e admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:30.422808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a21773c8-791a-4171-84d8-ac347f00c72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:30.465776 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-79d031fb-a41b-4cf2-861c-eb8baead3564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31340701bb2345c1a284ffa186642ca4'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:30.467586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-79d031fb-a41b-4cf2-861c-eb8baead3564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31340701bb2345c1a284ffa186642ca4'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:30.488507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-79d031fb-a41b-4cf2-861c-eb8baead3564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31340701bb2345c1a284ffa186642ca4'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:30.502797 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 961/1929] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:29 2022] DELETE /identity/v3/users/31340701bb2345c1a284ffa186642ca4 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:30.504792 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d031fb-a41b-4cf2-861c-eb8baead3564 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:30.524022 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-79d031fb-a41b-4cf2-861c-eb8baead3564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:30.541640 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21773c8-791a-4171-84d8-ac347f00c72e admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:30.601230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:30.641006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d031fb-a41b-4cf2-861c-eb8baead3564 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:30.647918 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa4bad-da89-4184-90c1-b6293b069ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:30.648615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa4bad-da89-4184-90c1-b6293b069ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:30.648900 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa4bad-da89-4184-90c1-b6293b069ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:30.649171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa4bad-da89-4184-90c1-b6293b069ea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:30.650232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa4bad-da89-4184-90c1-b6293b069ea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:30.657730 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa4bad-da89-4184-90c1-b6293b069ea1 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:30.665673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4ddab-0494-495f-b21d-c6e0f8cb19ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:30.666385 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4ddab-0494-495f-b21d-c6e0f8cb19ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:30.666691 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4ddab-0494-495f-b21d-c6e0f8cb19ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:30.666963 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4ddab-0494-495f-b21d-c6e0f8cb19ff admin admin] PATH_INFO: `/v3/projects/e2eece3dce0e4106bee1633049c4c926/users/a7c1ad2910e94024acd11601a46aed28/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:30.671533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4ddab-0494-495f-b21d-c6e0f8cb19ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2eece3dce0e4106bee1633049c4c926, user_id=a7c1ad2910e94024acd11601a46aed28, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:30.676787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4ddab-0494-495f-b21d-c6e0f8cb19ff admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:30.701199 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 969/1930] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:30 2022] PUT /identity/v3/projects/e2eece3dce0e4106bee1633049c4c926/users/a7c1ad2910e94024acd11601a46aed28/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:30.704719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b06d34-6916-4106-a1b0-a6ec47bda3ef None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:30.705366 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b06d34-6916-4106-a1b0-a6ec47bda3ef None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:30.706067 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b06d34-6916-4106-a1b0-a6ec47bda3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:30.743204 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-07b06d34-6916-4106-a1b0-a6ec47bda3ef None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:30.745281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-07b06d34-6916-4106-a1b0-a6ec47bda3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:30.821857 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 970/1931] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:30.825414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65446c-cbe7-4933-b2de-f66ac05c4675 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:30.825414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65446c-cbe7-4933-b2de-f66ac05c4675 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:30.825414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65446c-cbe7-4933-b2de-f66ac05c4675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:30.862230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-2f65446c-cbe7-4933-b2de-f66ac05c4675 None None] MFA Rules not processed for user `a7c1ad2910e94024acd11601a46aed28`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:30.864264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-2f65446c-cbe7-4933-b2de-f66ac05c4675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:30.941782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 962/1932] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:30 2022] POST /identity/v3/projects => generated 383 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:30.945908 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa4bad-da89-4184-90c1-b6293b069ea1 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:30.955295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-14aa4bad-da89-4184-90c1-b6293b069ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:31.009884 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 971/1933] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:31.010975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65446c-cbe7-4933-b2de-f66ac05c4675 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:31.036655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65446c-cbe7-4933-b2de-f66ac05c4675 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:31.070851 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa4bad-da89-4184-90c1-b6293b069ea1 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:31.075459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b1f60-3a2f-4c9b-944c-b4f06817bcf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:31.076726 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b1f60-3a2f-4c9b-944c-b4f06817bcf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:31.077062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b1f60-3a2f-4c9b-944c-b4f06817bcf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:31.077340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b1f60-3a2f-4c9b-944c-b4f06817bcf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:31.144855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206de216-aa61-416d-ab2d-faab96d0de20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:31.145680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206de216-aa61-416d-ab2d-faab96d0de20 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:31.146324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206de216-aa61-416d-ab2d-faab96d0de20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:31.146536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206de216-aa61-416d-ab2d-faab96d0de20 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:31.153450 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206de216-aa61-416d-ab2d-faab96d0de20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:31.155091 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206de216-aa61-416d-ab2d-faab96d0de20 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:31.199520 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b1f60-3a2f-4c9b-944c-b4f06817bcf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:31.201291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b1f60-3a2f-4c9b-944c-b4f06817bcf2 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:31.213703 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 963/1934] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:31.214848 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b1f60-3a2f-4c9b-944c-b4f06817bcf2 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:31.216771 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-5f1b1f60-3a2f-4c9b-944c-b4f06817bcf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:31.303187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 972/1935] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:31 2022] POST /identity/v3/users => generated 292 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:31.308672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206de216-aa61-416d-ab2d-faab96d0de20 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:31.319044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b1f60-3a2f-4c9b-944c-b4f06817bcf2 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:31.323985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206de216-aa61-416d-ab2d-faab96d0de20 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:31.328228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cdb74-2b86-4a52-9984-4f6434e740fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:31.329313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cdb74-2b86-4a52-9984-4f6434e740fe service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:31.330157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cdb74-2b86-4a52-9984-4f6434e740fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:31.330157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cdb74-2b86-4a52-9984-4f6434e740fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:31.332009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff8bf8-0e97-427e-825e-d471b54caca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:31.333301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff8bf8-0e97-427e-825e-d471b54caca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:31.333710 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff8bf8-0e97-427e-825e-d471b54caca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:31.334106 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff8bf8-0e97-427e-825e-d471b54caca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:31.334939 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff8bf8-0e97-427e-825e-d471b54caca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:31.337683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff8bf8-0e97-427e-825e-d471b54caca6 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:31.357418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 973/1936] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:31:31.363103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff8bf8-0e97-427e-825e-d471b54caca6 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:31.379738 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff8bf8-0e97-427e-825e-d471b54caca6 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:31.384874 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dec9cd-cd4e-48c8-b03e-8c325f2a6e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:31.385507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dec9cd-cd4e-48c8-b03e-8c325f2a6e8c admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:31.385817 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dec9cd-cd4e-48c8-b03e-8c325f2a6e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:31.386469 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dec9cd-cd4e-48c8-b03e-8c325f2a6e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:31.387204 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dec9cd-cd4e-48c8-b03e-8c325f2a6e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:31.388941 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dec9cd-cd4e-48c8-b03e-8c325f2a6e8c admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:31.404485 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 974/1937] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:31.410416 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dec9cd-cd4e-48c8-b03e-8c325f2a6e8c admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:31.429299 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dec9cd-cd4e-48c8-b03e-8c325f2a6e8c admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:31.436624 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fab95-c3b7-4146-a523-d4efd5f6f5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:31.437390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fab95-c3b7-4146-a523-d4efd5f6f5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:31.437707 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fab95-c3b7-4146-a523-d4efd5f6f5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:31.438545 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fab95-c3b7-4146-a523-d4efd5f6f5e2 admin admin] PATH_INFO: `/v3/projects/76d404cca7d8428db84d8ce88cd6e3e3/users/db2d640ec8ad4043b3ab2e4c72fdda01/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:31.458026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fab95-c3b7-4146-a523-d4efd5f6f5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d404cca7d8428db84d8ce88cd6e3e3, user_id=db2d640ec8ad4043b3ab2e4c72fdda01, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:31.460785 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fab95-c3b7-4146-a523-d4efd5f6f5e2 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:31.462910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cdb74-2b86-4a52-9984-4f6434e740fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:31.464617 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cdb74-2b86-4a52-9984-4f6434e740fe service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:31.481771 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 964/1938] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:31.548127 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cdb74-2b86-4a52-9984-4f6434e740fe service cinder] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:31.561661 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-da5cdb74-2b86-4a52-9984-4f6434e740fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:31.568851 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cdb74-2b86-4a52-9984-4f6434e740fe service cinder] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:31.575503 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d874df3-d4b3-4fa8-a0ec-625237bc2974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:31.576788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d874df3-d4b3-4fa8-a0ec-625237bc2974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:31.577131 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d874df3-d4b3-4fa8-a0ec-625237bc2974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:31.577473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d874df3-d4b3-4fa8-a0ec-625237bc2974 admin admin] PATH_INFO: `/v3/projects/91d6b3e8f70b4adca962a027d9da11b9` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:31.578996 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d874df3-d4b3-4fa8-a0ec-625237bc2974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d6b3e8f70b4adca962a027d9da11b9)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:31.581037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d874df3-d4b3-4fa8-a0ec-625237bc2974 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:31.599351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 975/1939] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:31 2022] PUT /identity/v3/projects/76d404cca7d8428db84d8ce88cd6e3e3/users/db2d640ec8ad4043b3ab2e4c72fdda01/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:31.612667 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa832a-c5ff-4c36-b592-63f590d29010 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:31.613051 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa832a-c5ff-4c36-b592-63f590d29010 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:31.613400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa832a-c5ff-4c36-b592-63f590d29010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:31.697193 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-3afa832a-c5ff-4c36-b592-63f590d29010 None None] MFA Rules not processed for user `db2d640ec8ad4043b3ab2e4c72fdda01`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:31.699965 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-3afa832a-c5ff-4c36-b592-63f590d29010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:31.782772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5d874df3-d4b3-4fa8-a0ec-625237bc2974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d6b3e8f70b4adca962a027d9da11b9', 'request_id': 'req-5d874df3-d4b3-4fa8-a0ec-625237bc2974'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:31.842460 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 976/1940] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:31.843823 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa832a-c5ff-4c36-b592-63f590d29010 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:31.900204 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5d874df3-d4b3-4fa8-a0ec-625237bc2974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d6b3e8f70b4adca962a027d9da11b9', 'request_id': 'req-5d874df3-d4b3-4fa8-a0ec-625237bc2974'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:31.936192 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5d874df3-d4b3-4fa8-a0ec-625237bc2974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d6b3e8f70b4adca962a027d9da11b9', 'request_id': 'req-5d874df3-d4b3-4fa8-a0ec-625237bc2974'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:31.990773 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5d874df3-d4b3-4fa8-a0ec-625237bc2974 admin admin] The token cache is being invalidate because project 91d6b3e8f70b4adca962a027d9da11b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:31.991723 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5d874df3-d4b3-4fa8-a0ec-625237bc2974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:31.994690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5d874df3-d4b3-4fa8-a0ec-625237bc2974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:31.999922 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 965/1941] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:31 2022] DELETE /identity/v3/projects/91d6b3e8f70b4adca962a027d9da11b9 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:31:32.010816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159a0ac-4e74-4dc4-8215-556d3b485fc1 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:32.010816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159a0ac-4e74-4dc4-8215-556d3b485fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:32.010816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159a0ac-4e74-4dc4-8215-556d3b485fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:32.030697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa832a-c5ff-4c36-b592-63f590d29010 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:32.090892 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-d159a0ac-4e74-4dc4-8215-556d3b485fc1 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:32.094146 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-d159a0ac-4e74-4dc4-8215-556d3b485fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:32.208989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85213ec-e299-49e6-8fd1-1ba4bcfa5e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:32.208989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85213ec-e299-49e6-8fd1-1ba4bcfa5e41 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:32.208989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85213ec-e299-49e6-8fd1-1ba4bcfa5e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:32.208989 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85213ec-e299-49e6-8fd1-1ba4bcfa5e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:32.210069 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85213ec-e299-49e6-8fd1-1ba4bcfa5e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:32.210069 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85213ec-e299-49e6-8fd1-1ba4bcfa5e41 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:32.274322 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:32.315506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 966/1942] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:32.322255 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453c11c-8e02-4863-bd21-55c7c54cbcdf None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:32.324276 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453c11c-8e02-4863-bd21-55c7c54cbcdf None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:32.324880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453c11c-8e02-4863-bd21-55c7c54cbcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:32.381453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 977/1943] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:31 2022] POST /identity/v3/projects => generated 381 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:31:32.383840 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85213ec-e299-49e6-8fd1-1ba4bcfa5e41 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:32.390536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-e453c11c-8e02-4863-bd21-55c7c54cbcdf None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:32.392187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-c85213ec-e299-49e6-8fd1-1ba4bcfa5e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:32.396442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e453c11c-8e02-4863-bd21-55c7c54cbcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:32.438298 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=88,keystone:INSERT=7,keystone:DELETE=5 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:32.566976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85213ec-e299-49e6-8fd1-1ba4bcfa5e41 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:32.576652 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a99b6-7e0f-47d3-8d9b-14d4e73f47b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:32.579513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a99b6-7e0f-47d3-8d9b-14d4e73f47b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:32.579513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a99b6-7e0f-47d3-8d9b-14d4e73f47b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:32.579513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a99b6-7e0f-47d3-8d9b-14d4e73f47b7 admin admin] PATH_INFO: `/v3/projects/c73593c231754a1f877f3a8b3e3095dc` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:32.580463 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a99b6-7e0f-47d3-8d9b-14d4e73f47b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c73593c231754a1f877f3a8b3e3095dc)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:32.583366 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a99b6-7e0f-47d3-8d9b-14d4e73f47b7 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:32.589133 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 967/1944] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:32.590296 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453c11c-8e02-4863-bd21-55c7c54cbcdf None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:32.597531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e453c11c-8e02-4863-bd21-55c7c54cbcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:32.617524 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453c11c-8e02-4863-bd21-55c7c54cbcdf None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:32.624830 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b69373-6ba1-4913-b2fa-0d1c45a6d5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:32.625902 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b69373-6ba1-4913-b2fa-0d1c45a6d5be admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:32.626337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b69373-6ba1-4913-b2fa-0d1c45a6d5be admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:32.626854 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b69373-6ba1-4913-b2fa-0d1c45a6d5be admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:32.627785 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b69373-6ba1-4913-b2fa-0d1c45a6d5be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:32.630759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b69373-6ba1-4913-b2fa-0d1c45a6d5be admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:32.742234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-197a99b6-7e0f-47d3-8d9b-14d4e73f47b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c73593c231754a1f877f3a8b3e3095dc', 'request_id': 'req-197a99b6-7e0f-47d3-8d9b-14d4e73f47b7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:32.779918 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 968/1945] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:32 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:32.781184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b69373-6ba1-4913-b2fa-0d1c45a6d5be admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:32.799172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b69373-6ba1-4913-b2fa-0d1c45a6d5be admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:32.814262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-197a99b6-7e0f-47d3-8d9b-14d4e73f47b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c73593c231754a1f877f3a8b3e3095dc', 'request_id': 'req-197a99b6-7e0f-47d3-8d9b-14d4e73f47b7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:32.825795 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-197a99b6-7e0f-47d3-8d9b-14d4e73f47b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c73593c231754a1f877f3a8b3e3095dc', 'request_id': 'req-197a99b6-7e0f-47d3-8d9b-14d4e73f47b7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:32.850705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-197a99b6-7e0f-47d3-8d9b-14d4e73f47b7 admin admin] The token cache is being invalidate because project c73593c231754a1f877f3a8b3e3095dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:32.854403 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-197a99b6-7e0f-47d3-8d9b-14d4e73f47b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:32.854403 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-197a99b6-7e0f-47d3-8d9b-14d4e73f47b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:32.855940 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 978/1946] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:32 2022] DELETE /identity/v3/projects/c73593c231754a1f877f3a8b3e3095dc => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:32.859068 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a99b6-7e0f-47d3-8d9b-14d4e73f47b7 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:32.861437 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-197a99b6-7e0f-47d3-8d9b-14d4e73f47b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:32.929679 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0d77f-4b37-4afd-8d00-a25cf374b8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:32.930708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0d77f-4b37-4afd-8d00-a25cf374b8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:32.931029 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0d77f-4b37-4afd-8d00-a25cf374b8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:32.931353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0d77f-4b37-4afd-8d00-a25cf374b8e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:32.932220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0d77f-4b37-4afd-8d00-a25cf374b8e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:31:32.932527 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0d77f-4b37-4afd-8d00-a25cf374b8e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:32.934888 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0d77f-4b37-4afd-8d00-a25cf374b8e0 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:32.949361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 969/1947] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:31:32.950278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0d77f-4b37-4afd-8d00-a25cf374b8e0 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:32.952591 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b4e0d77f-4b37-4afd-8d00-a25cf374b8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:32.967213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0d77f-4b37-4afd-8d00-a25cf374b8e0 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:32.972752 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2a299-fd15-406b-8d6f-a286077c708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:32.973432 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2a299-fd15-406b-8d6f-a286077c708c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:32.973920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2a299-fd15-406b-8d6f-a286077c708c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:32.974076 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2a299-fd15-406b-8d6f-a286077c708c admin admin] PATH_INFO: `/v3/users/388d93e192264a39aeb11520a5d05be8` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:32.975317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2a299-fd15-406b-8d6f-a286077c708c admin admin] RBAC: Authorizing `identity:delete_user(user_id=388d93e192264a39aeb11520a5d05be8)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:32.977325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2a299-fd15-406b-8d6f-a286077c708c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:32.983978 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a99b6-7e0f-47d3-8d9b-14d4e73f47b7 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:32.992415 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b489fd-0ce4-4b26-8a6b-727b456fedc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:32.993410 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b489fd-0ce4-4b26-8a6b-727b456fedc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:32.993880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b489fd-0ce4-4b26-8a6b-727b456fedc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:32.994353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b489fd-0ce4-4b26-8a6b-727b456fedc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:32.995658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b489fd-0ce4-4b26-8a6b-727b456fedc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:32.999186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b489fd-0ce4-4b26-8a6b-727b456fedc1 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:33.019343 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 979/1948] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:33.020908 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b489fd-0ce4-4b26-8a6b-727b456fedc1 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:33.024001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-52b489fd-0ce4-4b26-8a6b-727b456fedc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:33.039572 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b489fd-0ce4-4b26-8a6b-727b456fedc1 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:33.046521 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc3248-9035-45b4-9a4b-223cc509f246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:33.047906 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc3248-9035-45b4-9a4b-223cc509f246 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:33.048379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc3248-9035-45b4-9a4b-223cc509f246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:33.048896 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc3248-9035-45b4-9a4b-223cc509f246 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:33.050134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc3248-9035-45b4-9a4b-223cc509f246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:33.054072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc3248-9035-45b4-9a4b-223cc509f246 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:33.218768 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 980/1949] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:33 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:33.220259 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc3248-9035-45b4-9a4b-223cc509f246 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:33.226344 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-b0c2a299-fd15-406b-8d6f-a286077c708c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388d93e192264a39aeb11520a5d05be8'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:33.257387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-b0c2a299-fd15-406b-8d6f-a286077c708c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388d93e192264a39aeb11520a5d05be8'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:33.349097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc3248-9035-45b4-9a4b-223cc509f246 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:33.354524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cf44c-5596-42b6-82aa-ca1c681b97ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:33.355292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cf44c-5596-42b6-82aa-ca1c681b97ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:33.355587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cf44c-5596-42b6-82aa-ca1c681b97ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:33.355870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cf44c-5596-42b6-82aa-ca1c681b97ab admin admin] PATH_INFO: `/v3/projects/6e5190eb7b034984848faa1f399f3ab4/users/96c1b87dc6774ff89dbe859b35db8619/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:33.361845 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-b0c2a299-fd15-406b-8d6f-a286077c708c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388d93e192264a39aeb11520a5d05be8'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:33.363340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-b0c2a299-fd15-406b-8d6f-a286077c708c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388d93e192264a39aeb11520a5d05be8'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:33.379559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-b0c2a299-fd15-406b-8d6f-a286077c708c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388d93e192264a39aeb11520a5d05be8'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:33.383450 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6cf44c-5596-42b6-82aa-ca1c681b97ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5190eb7b034984848faa1f399f3ab4, user_id=96c1b87dc6774ff89dbe859b35db8619, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:33.387064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6cf44c-5596-42b6-82aa-ca1c681b97ab admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:33.393864 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 970/1950] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:32 2022] DELETE /identity/v3/users/388d93e192264a39aeb11520a5d05be8 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:33.396043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2a299-fd15-406b-8d6f-a286077c708c admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:33.399781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b0c2a299-fd15-406b-8d6f-a286077c708c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:33.523669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2a299-fd15-406b-8d6f-a286077c708c admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:33.529311 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 981/1951] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:33 2022] PUT /identity/v3/projects/6e5190eb7b034984848faa1f399f3ab4/users/96c1b87dc6774ff89dbe859b35db8619/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:33.530328 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cf44c-5596-42b6-82aa-ca1c681b97ab admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:33.534578 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-eb6cf44c-5596-42b6-82aa-ca1c681b97ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:33.610333 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c136f-025a-439c-bbae-fda712fedd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:33.611427 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c136f-025a-439c-bbae-fda712fedd8a admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:33.611984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c136f-025a-439c-bbae-fda712fedd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:33.612529 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c136f-025a-439c-bbae-fda712fedd8a admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:33.613447 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c136f-025a-439c-bbae-fda712fedd8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:33.615677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c136f-025a-439c-bbae-fda712fedd8a admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:33.627975 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:33.630993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cf44c-5596-42b6-82aa-ca1c681b97ab admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:33.635448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff07409-1f1d-4003-972b-b5e5e3f5fa6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:33.640210 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff07409-1f1d-4003-972b-b5e5e3f5fa6a service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:33.640210 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff07409-1f1d-4003-972b-b5e5e3f5fa6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:33.640210 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff07409-1f1d-4003-972b-b5e5e3f5fa6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:33.640210 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-4ff07409-1f1d-4003-972b-b5e5e3f5fa6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:33.715040 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff07409-1f1d-4003-972b-b5e5e3f5fa6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:33.716577 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff07409-1f1d-4003-972b-b5e5e3f5fa6a service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:33.727383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 982/1952] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:33.728274 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff07409-1f1d-4003-972b-b5e5e3f5fa6a service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:33.729833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-4ff07409-1f1d-4003-972b-b5e5e3f5fa6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:33.747364 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff07409-1f1d-4003-972b-b5e5e3f5fa6a service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:33.766468 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2759ff-634c-4430-902d-e5419a2ad958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:33.766468 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2759ff-634c-4430-902d-e5419a2ad958 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:33.766468 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2759ff-634c-4430-902d-e5419a2ad958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:33.766468 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2759ff-634c-4430-902d-e5419a2ad958 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:33.766903 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2759ff-634c-4430-902d-e5419a2ad958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:33.766903 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2759ff-634c-4430-902d-e5419a2ad958 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:33.770812 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 971/1953] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:33 2022] POST /identity/v3/users => generated 289 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:33.772189 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c136f-025a-439c-bbae-fda712fedd8a admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:33.790481 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:33.790772 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c136f-025a-439c-bbae-fda712fedd8a admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:33.797902 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 983/1954] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:33.809363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2759ff-634c-4430-902d-e5419a2ad958 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:33.814339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847797e3-ded6-4d78-967d-27e6de259fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:33.820256 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847797e3-ded6-4d78-967d-27e6de259fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:33.820555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847797e3-ded6-4d78-967d-27e6de259fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:33.821050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847797e3-ded6-4d78-967d-27e6de259fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:33.821672 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847797e3-ded6-4d78-967d-27e6de259fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:33.824814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847797e3-ded6-4d78-967d-27e6de259fe8 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:33.837730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2759ff-634c-4430-902d-e5419a2ad958 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:33.841729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 972/1955] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:33.845233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c8a59-ffa7-41fc-9886-41281d2de1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:33.846215 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c8a59-ffa7-41fc-9886-41281d2de1b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:33.846671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c8a59-ffa7-41fc-9886-41281d2de1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:33.846837 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847797e3-ded6-4d78-967d-27e6de259fe8 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:33.847145 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c8a59-ffa7-41fc-9886-41281d2de1b8 admin admin] PATH_INFO: `/v3/projects/6e5190eb7b034984848faa1f399f3ab4/users/96c1b87dc6774ff89dbe859b35db8619/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:33.849823 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c8a59-ffa7-41fc-9886-41281d2de1b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5190eb7b034984848faa1f399f3ab4, user_id=96c1b87dc6774ff89dbe859b35db8619, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:33.856135 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c8a59-ffa7-41fc-9886-41281d2de1b8 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:33.861379 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847797e3-ded6-4d78-967d-27e6de259fe8 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:33.867316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218081bf-0d0e-4884-a799-494d11529f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:33.869144 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218081bf-0d0e-4884-a799-494d11529f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:33.869588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218081bf-0d0e-4884-a799-494d11529f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:33.869950 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218081bf-0d0e-4884-a799-494d11529f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:33.871430 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218081bf-0d0e-4884-a799-494d11529f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:33.875332 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218081bf-0d0e-4884-a799-494d11529f70 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:33.899317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 984/1956] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:33 2022] PUT /identity/v3/projects/6e5190eb7b034984848faa1f399f3ab4/users/96c1b87dc6774ff89dbe859b35db8619/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:33.899487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 973/1957] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:33.900514 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c8a59-ffa7-41fc-9886-41281d2de1b8 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:33.909401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05a344-1b7e-4676-8413-c3d0af964794 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:33.910278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05a344-1b7e-4676-8413-c3d0af964794 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:33.910999 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05a344-1b7e-4676-8413-c3d0af964794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:33.977983 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-ad05a344-1b7e-4676-8413-c3d0af964794 None None] MFA Rules not processed for user `96c1b87dc6774ff89dbe859b35db8619`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:33.979683 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ad05a344-1b7e-4676-8413-c3d0af964794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:34.007988 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c8a59-ffa7-41fc-9886-41281d2de1b8 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:34.014854 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473bbc4-9efa-4726-ae8e-2c13f36ebd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:34.015798 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473bbc4-9efa-4726-ae8e-2c13f36ebd83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:34.017672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473bbc4-9efa-4726-ae8e-2c13f36ebd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:34.017672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473bbc4-9efa-4726-ae8e-2c13f36ebd83 admin admin] PATH_INFO: `/v3/projects/dce8a0afd6c64abe9ffbf329c76d3e25/users/212e0d6cba494552a244e4af9ab2f613/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:34.035141 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473bbc4-9efa-4726-ae8e-2c13f36ebd83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dce8a0afd6c64abe9ffbf329c76d3e25, user_id=212e0d6cba494552a244e4af9ab2f613, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:34.038001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473bbc4-9efa-4726-ae8e-2c13f36ebd83 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:34.069172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 974/1958] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:34.081581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05a344-1b7e-4676-8413-c3d0af964794 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:34.083055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ad05a344-1b7e-4676-8413-c3d0af964794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:34.087914 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:34.134890 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 985/1959] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:33 2022] PUT /identity/v3/projects/dce8a0afd6c64abe9ffbf329c76d3e25/users/212e0d6cba494552a244e4af9ab2f613/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:34.134890 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473bbc4-9efa-4726-ae8e-2c13f36ebd83 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:34.145956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-0473bbc4-9efa-4726-ae8e-2c13f36ebd83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:34.177388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05a344-1b7e-4676-8413-c3d0af964794 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:34.240077 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473bbc4-9efa-4726-ae8e-2c13f36ebd83 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:34.241762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5b3d0-8044-4f36-8dea-41dd7ee86ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:34.242750 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5b3d0-8044-4f36-8dea-41dd7ee86ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:34.243339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5b3d0-8044-4f36-8dea-41dd7ee86ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:34.243784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5b3d0-8044-4f36-8dea-41dd7ee86ff1 admin admin] PATH_INFO: `/v3/projects/2360cb23f1944a51a52f1d4d95ce5a6b` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:34.246175 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5b3d0-8044-4f36-8dea-41dd7ee86ff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2360cb23f1944a51a52f1d4d95ce5a6b)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:34.248667 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5b3d0-8044-4f36-8dea-41dd7ee86ff1 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:34.275622 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad693f-043c-46f9-b6de-08680d35829a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:34.276262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad693f-043c-46f9-b6de-08680d35829a service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:34.276540 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad693f-043c-46f9-b6de-08680d35829a service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:34.276865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad693f-043c-46f9-b6de-08680d35829a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:34.374973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad693f-043c-46f9-b6de-08680d35829a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:34.377841 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad693f-043c-46f9-b6de-08680d35829a service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:34.394140 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 975/1960] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:31:34.408146 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfb4d9-33e0-49d7-9da0-c1203e51cbb2 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:34.408732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfb4d9-33e0-49d7-9da0-c1203e51cbb2 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:34.409442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfb4d9-33e0-49d7-9da0-c1203e51cbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:34.420444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-77b5b3d0-8044-4f36-8dea-41dd7ee86ff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2360cb23f1944a51a52f1d4d95ce5a6b', 'request_id': 'req-77b5b3d0-8044-4f36-8dea-41dd7ee86ff1'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:34.448902 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-fddfb4d9-33e0-49d7-9da0-c1203e51cbb2 None None] MFA Rules not processed for user `212e0d6cba494552a244e4af9ab2f613`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:34.450470 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-fddfb4d9-33e0-49d7-9da0-c1203e51cbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:34.516495 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-77b5b3d0-8044-4f36-8dea-41dd7ee86ff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2360cb23f1944a51a52f1d4d95ce5a6b', 'request_id': 'req-77b5b3d0-8044-4f36-8dea-41dd7ee86ff1'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:34.528569 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-77b5b3d0-8044-4f36-8dea-41dd7ee86ff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2360cb23f1944a51a52f1d4d95ce5a6b', 'request_id': 'req-77b5b3d0-8044-4f36-8dea-41dd7ee86ff1'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:34.547757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-77b5b3d0-8044-4f36-8dea-41dd7ee86ff1 admin admin] The token cache is being invalidate because project 2360cb23f1944a51a52f1d4d95ce5a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:34.548190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-77b5b3d0-8044-4f36-8dea-41dd7ee86ff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:34.549149 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-77b5b3d0-8044-4f36-8dea-41dd7ee86ff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:34.554633 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 986/1961] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:34 2022] DELETE /identity/v3/projects/2360cb23f1944a51a52f1d4d95ce5a6b => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:34.557717 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 976/1962] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:34.558918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003cfb9-48f9-4b4a-8166-664a79857209 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:34.560618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003cfb9-48f9-4b4a-8166-664a79857209 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:34.560618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003cfb9-48f9-4b4a-8166-664a79857209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:34.585321 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-4003cfb9-48f9-4b4a-8166-664a79857209 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:34.586575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-4003cfb9-48f9-4b4a-8166-664a79857209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:34.651543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfb4d9-33e0-49d7-9da0-c1203e51cbb2 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:34.694226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 987/1963] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:31:34.705264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003cfb9-48f9-4b4a-8166-664a79857209 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:34.707300 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-4003cfb9-48f9-4b4a-8166-664a79857209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:34.761072 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfb4d9-33e0-49d7-9da0-c1203e51cbb2 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:34.768161 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5806a7-0f0c-49e7-898d-4a3fc7986b5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:34.769245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5806a7-0f0c-49e7-898d-4a3fc7986b5a service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:34.769744 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5806a7-0f0c-49e7-898d-4a3fc7986b5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:34.770228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5806a7-0f0c-49e7-898d-4a3fc7986b5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:34.773506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-8c5806a7-0f0c-49e7-898d-4a3fc7986b5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:34.794521 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003cfb9-48f9-4b4a-8166-664a79857209 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:34.794986 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5806a7-0f0c-49e7-898d-4a3fc7986b5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:34.797877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5806a7-0f0c-49e7-898d-4a3fc7986b5a service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:34.804219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a563b4-830d-49a8-8770-b7d67d926120 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:34.805663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a563b4-830d-49a8-8770-b7d67d926120 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:34.806376 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a563b4-830d-49a8-8770-b7d67d926120 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:34.807431 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a563b4-830d-49a8-8770-b7d67d926120 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:34.811409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-11a563b4-830d-49a8-8770-b7d67d926120 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:34.815214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 977/1964] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:31:34.817096 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ce42e-99f7-4744-a155-9d0fd8be5826 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:34.820006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ce42e-99f7-4744-a155-9d0fd8be5826 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:34.820006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ce42e-99f7-4744-a155-9d0fd8be5826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:34.858128 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-357ce42e-99f7-4744-a155-9d0fd8be5826 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:34.858128 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-357ce42e-99f7-4744-a155-9d0fd8be5826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:34.892554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 978/1965] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:34.898346 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ce42e-99f7-4744-a155-9d0fd8be5826 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:34.909841 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ce42e-99f7-4744-a155-9d0fd8be5826 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:34.916343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb506d9-6a6e-4967-aeb0-ba8fdc3ba142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:34.916983 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb506d9-6a6e-4967-aeb0-ba8fdc3ba142 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:34.917266 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb506d9-6a6e-4967-aeb0-ba8fdc3ba142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:34.917536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb506d9-6a6e-4967-aeb0-ba8fdc3ba142 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:34.918263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb506d9-6a6e-4967-aeb0-ba8fdc3ba142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:31:34.918765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb506d9-6a6e-4967-aeb0-ba8fdc3ba142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:34.920794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb506d9-6a6e-4967-aeb0-ba8fdc3ba142 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:34.936737 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 979/1966] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:31:34.939574 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:34.943521 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb506d9-6a6e-4967-aeb0-ba8fdc3ba142 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:34.958018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a563b4-830d-49a8-8770-b7d67d926120 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:34.959276 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb506d9-6a6e-4967-aeb0-ba8fdc3ba142 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:34.961306 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a563b4-830d-49a8-8770-b7d67d926120 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:34.966302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9887b6-d514-477b-9e06-7a9e4718db04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:34.966990 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9887b6-d514-477b-9e06-7a9e4718db04 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:34.967279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9887b6-d514-477b-9e06-7a9e4718db04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:34.967872 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9887b6-d514-477b-9e06-7a9e4718db04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:34.968800 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9887b6-d514-477b-9e06-7a9e4718db04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:34.978840 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 988/1967] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:31:34.993889 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9887b6-d514-477b-9e06-7a9e4718db04 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:35.164098 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:35.172966 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 980/1968] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:34 2022] POST /identity/v3/projects => generated 369 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:35.177062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a563b4-830d-49a8-8770-b7d67d926120 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:35.191086 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a563b4-830d-49a8-8770-b7d67d926120 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:35.270547 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1dcb6-1976-4613-a445-594c02db021a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:35.271597 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1dcb6-1976-4613-a445-594c02db021a admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:35.271957 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1dcb6-1976-4613-a445-594c02db021a admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:35.272270 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1dcb6-1976-4613-a445-594c02db021a admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:35.273018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1dcb6-1976-4613-a445-594c02db021a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:35.275050 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1dcb6-1976-4613-a445-594c02db021a admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:35.419688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 989/1969] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:35 2022] POST /identity/v3/users => generated 285 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:35.432779 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9887b6-d514-477b-9e06-7a9e4718db04 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:35.446215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9887b6-d514-477b-9e06-7a9e4718db04 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:35.451840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59da5dd-e42b-4320-a2a9-37d0048b524d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:35.452473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59da5dd-e42b-4320-a2a9-37d0048b524d admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:35.452749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59da5dd-e42b-4320-a2a9-37d0048b524d admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:35.453016 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59da5dd-e42b-4320-a2a9-37d0048b524d admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:35.453669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59da5dd-e42b-4320-a2a9-37d0048b524d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:35.455327 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59da5dd-e42b-4320-a2a9-37d0048b524d admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:35.471992 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 981/1970] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:35.474219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1dcb6-1976-4613-a445-594c02db021a admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:35.485114 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1dcb6-1976-4613-a445-594c02db021a admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:35.496880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d027e6f-d375-4701-9d24-bf1e08e154b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:35.497798 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d027e6f-d375-4701-9d24-bf1e08e154b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:35.498223 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d027e6f-d375-4701-9d24-bf1e08e154b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:35.498622 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d027e6f-d375-4701-9d24-bf1e08e154b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:35.499433 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d027e6f-d375-4701-9d24-bf1e08e154b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:35.501319 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d027e6f-d375-4701-9d24-bf1e08e154b4 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:35.512301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 990/1971] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:35.519206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59da5dd-e42b-4320-a2a9-37d0048b524d admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:35.530863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59da5dd-e42b-4320-a2a9-37d0048b524d admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:35.536607 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee7f11-18fd-4385-a4c4-8546fc646214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:35.537351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee7f11-18fd-4385-a4c4-8546fc646214 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:35.537639 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee7f11-18fd-4385-a4c4-8546fc646214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:35.537917 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee7f11-18fd-4385-a4c4-8546fc646214 admin admin] PATH_INFO: `/v3/projects/40ca488c78074df397046582ea263b70/users/c37f287ac53047cfa1457c8abb8ad05d/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:35.557808 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee7f11-18fd-4385-a4c4-8546fc646214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ca488c78074df397046582ea263b70, user_id=c37f287ac53047cfa1457c8abb8ad05d, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:35.564133 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee7f11-18fd-4385-a4c4-8546fc646214 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:35.713516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 982/1972] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:35 2022] PUT /identity/v3/projects/40ca488c78074df397046582ea263b70/users/c37f287ac53047cfa1457c8abb8ad05d/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:31:35.734401 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a2d22-8401-4a85-b544-fb3f5af9f3b5 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:35.735025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a2d22-8401-4a85-b544-fb3f5af9f3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:35.737942 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a2d22-8401-4a85-b544-fb3f5af9f3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:35.820728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-3f1a2d22-8401-4a85-b544-fb3f5af9f3b5 None None] MFA Rules not processed for user `c37f287ac53047cfa1457c8abb8ad05d`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:35.822028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-3f1a2d22-8401-4a85-b544-fb3f5af9f3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:35.926532 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 991/1973] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:35.944491 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee7f11-18fd-4385-a4c4-8546fc646214 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:36.040925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee7f11-18fd-4385-a4c4-8546fc646214 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:36.049483 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716663ca-e173-4c3d-a747-1faeca9fea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:36.050441 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716663ca-e173-4c3d-a747-1faeca9fea6b admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:36.050916 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716663ca-e173-4c3d-a747-1faeca9fea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:36.051380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716663ca-e173-4c3d-a747-1faeca9fea6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:36.052460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716663ca-e173-4c3d-a747-1faeca9fea6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:36.056075 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716663ca-e173-4c3d-a747-1faeca9fea6b admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:36.135775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:36.196438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a2d22-8401-4a85-b544-fb3f5af9f3b5 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:36.198274 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-3f1a2d22-8401-4a85-b544-fb3f5af9f3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:36.219823 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a2d22-8401-4a85-b544-fb3f5af9f3b5 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:36.225389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43194113-8849-48cb-8116-f07977e91f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:36.226387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43194113-8849-48cb-8116-f07977e91f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:36.227778 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43194113-8849-48cb-8116-f07977e91f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:36.227778 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43194113-8849-48cb-8116-f07977e91f78 admin admin] PATH_INFO: `/v3/users/db2d640ec8ad4043b3ab2e4c72fdda01` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:36.229613 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 983/1974] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:35 2022] POST /identity/v3/projects => generated 369 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:36.235427 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43194113-8849-48cb-8116-f07977e91f78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db2d640ec8ad4043b3ab2e4c72fdda01)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:36.235841 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716663ca-e173-4c3d-a747-1faeca9fea6b admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:36.238817 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43194113-8849-48cb-8116-f07977e91f78 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:36.269418 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:36.375097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716663ca-e173-4c3d-a747-1faeca9fea6b admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:36.383426 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a4500-706d-47a0-8a90-53357f6d9450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:36.384633 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a4500-706d-47a0-8a90-53357f6d9450 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:36.385357 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a4500-706d-47a0-8a90-53357f6d9450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:36.386056 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a4500-706d-47a0-8a90-53357f6d9450 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:36.387401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a4500-706d-47a0-8a90-53357f6d9450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:36.395239 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a4500-706d-47a0-8a90-53357f6d9450 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:36.721483 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 984/1975] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:36 2022] POST /identity/v3/users => generated 291 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:36.727139 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a4500-706d-47a0-8a90-53357f6d9450 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:36.733544 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-43194113-8849-48cb-8116-f07977e91f78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db2d640ec8ad4043b3ab2e4c72fdda01'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:36.744514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a4500-706d-47a0-8a90-53357f6d9450 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:36.749749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29b1f7-830c-4e7c-8b64-614e7aca12aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:36.750505 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29b1f7-830c-4e7c-8b64-614e7aca12aa admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:36.750833 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29b1f7-830c-4e7c-8b64-614e7aca12aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:36.751079 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29b1f7-830c-4e7c-8b64-614e7aca12aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:36.751733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29b1f7-830c-4e7c-8b64-614e7aca12aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:36.753579 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29b1f7-830c-4e7c-8b64-614e7aca12aa admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:36.768422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 985/1976] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:31:36.773403 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29b1f7-830c-4e7c-8b64-614e7aca12aa admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:36.793226 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29b1f7-830c-4e7c-8b64-614e7aca12aa admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:36.799228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220469d-470e-49ed-978c-771bd2558d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:36.802493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220469d-470e-49ed-978c-771bd2558d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:36.802958 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220469d-470e-49ed-978c-771bd2558d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:36.803313 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220469d-470e-49ed-978c-771bd2558d2c admin admin] PATH_INFO: `/v3/projects/902402090b8b410ca1df6dac523388d6/users/e32c76a1e08c4bf3abd77ad509167bdd/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:36.828582 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220469d-470e-49ed-978c-771bd2558d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=902402090b8b410ca1df6dac523388d6, user_id=e32c76a1e08c4bf3abd77ad509167bdd, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:36.833925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220469d-470e-49ed-978c-771bd2558d2c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:36.911402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-43194113-8849-48cb-8116-f07977e91f78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db2d640ec8ad4043b3ab2e4c72fdda01'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:36.912423 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-43194113-8849-48cb-8116-f07977e91f78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db2d640ec8ad4043b3ab2e4c72fdda01'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:36.937591 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-43194113-8849-48cb-8116-f07977e91f78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db2d640ec8ad4043b3ab2e4c72fdda01'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:36.937591 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-43194113-8849-48cb-8116-f07977e91f78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db2d640ec8ad4043b3ab2e4c72fdda01'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:36.962682 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 992/1977] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:36 2022] DELETE /identity/v3/users/db2d640ec8ad4043b3ab2e4c72fdda01 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:31:36.966112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f4235-19c9-4e61-8005-e2d290bae4fc None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:36.966962 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f4235-19c9-4e61-8005-e2d290bae4fc None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:36.967249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f4235-19c9-4e61-8005-e2d290bae4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:36.996154 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-f48f4235-19c9-4e61-8005-e2d290bae4fc None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:36.998422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f48f4235-19c9-4e61-8005-e2d290bae4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:37.087233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 993/1978] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:37.108169 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f4235-19c9-4e61-8005-e2d290bae4fc None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:37.111273 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f48f4235-19c9-4e61-8005-e2d290bae4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:37.124200 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 986/1979] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:36 2022] PUT /identity/v3/projects/902402090b8b410ca1df6dac523388d6/users/e32c76a1e08c4bf3abd77ad509167bdd/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:37.129348 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220469d-470e-49ed-978c-771bd2558d2c admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:37.132402 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-9220469d-470e-49ed-978c-771bd2558d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:37.213632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f4235-19c9-4e61-8005-e2d290bae4fc None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:37.271012 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220469d-470e-49ed-978c-771bd2558d2c admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:37.277367 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa0074-54d0-41d4-9810-e90ae8c94af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:37.278033 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa0074-54d0-41d4-9810-e90ae8c94af2 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:37.278484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa0074-54d0-41d4-9810-e90ae8c94af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:37.279008 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa0074-54d0-41d4-9810-e90ae8c94af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:37.279827 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa0074-54d0-41d4-9810-e90ae8c94af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:37.281680 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa0074-54d0-41d4-9810-e90ae8c94af2 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:37.297518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 987/1980] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:31:37.298876 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa0074-54d0-41d4-9810-e90ae8c94af2 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:37.302186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135eb845-06c9-404f-85e7-7bcec22c0a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:37.303907 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135eb845-06c9-404f-85e7-7bcec22c0a7c service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:37.304887 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135eb845-06c9-404f-85e7-7bcec22c0a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:37.305521 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135eb845-06c9-404f-85e7-7bcec22c0a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:37.310356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa0074-54d0-41d4-9810-e90ae8c94af2 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:37.316336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf6efe-2807-4f87-a777-1de1fa6d3fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:37.317404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf6efe-2807-4f87-a777-1de1fa6d3fce admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:37.317911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf6efe-2807-4f87-a777-1de1fa6d3fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:37.318427 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf6efe-2807-4f87-a777-1de1fa6d3fce admin admin] PATH_INFO: `/v3/projects/902402090b8b410ca1df6dac523388d6/users/e32c76a1e08c4bf3abd77ad509167bdd/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:37.320907 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf6efe-2807-4f87-a777-1de1fa6d3fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=902402090b8b410ca1df6dac523388d6, user_id=e32c76a1e08c4bf3abd77ad509167bdd, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:37.324276 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf6efe-2807-4f87-a777-1de1fa6d3fce admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:37.326415 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135eb845-06c9-404f-85e7-7bcec22c0a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:37.329235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135eb845-06c9-404f-85e7-7bcec22c0a7c service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:37.342274 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 988/1981] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:37 2022] PUT /identity/v3/projects/902402090b8b410ca1df6dac523388d6/users/e32c76a1e08c4bf3abd77ad509167bdd/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:37.349338 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 994/1982] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:31:37.353168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e88b44-7d8a-4dab-a35c-f56d3f3e144f None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:37.353512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e88b44-7d8a-4dab-a35c-f56d3f3e144f None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:37.353721 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e88b44-7d8a-4dab-a35c-f56d3f3e144f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:37.389388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-e4e88b44-7d8a-4dab-a35c-f56d3f3e144f None None] MFA Rules not processed for user `e32c76a1e08c4bf3abd77ad509167bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:37.390902 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e4e88b44-7d8a-4dab-a35c-f56d3f3e144f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:37.527169 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 989/1983] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:31:37.537705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135eb845-06c9-404f-85e7-7bcec22c0a7c service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:37.539143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-135eb845-06c9-404f-85e7-7bcec22c0a7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:37.613170 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135eb845-06c9-404f-85e7-7bcec22c0a7c service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:37.679463 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e76ae-1fd7-4563-a5e7-d7f1ac2c9c54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:37.680257 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e76ae-1fd7-4563-a5e7-d7f1ac2c9c54 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:37.680889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e76ae-1fd7-4563-a5e7-d7f1ac2c9c54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:37.681178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e76ae-1fd7-4563-a5e7-d7f1ac2c9c54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:37.698330 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e76ae-1fd7-4563-a5e7-d7f1ac2c9c54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:37.705502 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e76ae-1fd7-4563-a5e7-d7f1ac2c9c54 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:37.733489 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 995/1984] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:37.917084 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e88b44-7d8a-4dab-a35c-f56d3f3e144f None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:37.935427 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e88b44-7d8a-4dab-a35c-f56d3f3e144f None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:37.940372 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f5c51-44d9-4549-9f4b-ee00db91a730 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:37.941089 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f5c51-44d9-4549-9f4b-ee00db91a730 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:37.941380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f5c51-44d9-4549-9f4b-ee00db91a730 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:37.941655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f5c51-44d9-4549-9f4b-ee00db91a730 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:37.944420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-c46f5c51-44d9-4549-9f4b-ee00db91a730 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:38.011839 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:38.021257 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e76ae-1fd7-4563-a5e7-d7f1ac2c9c54 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:38.023913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-479e76ae-1fd7-4563-a5e7-d7f1ac2c9c54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:38.090571 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f5c51-44d9-4549-9f4b-ee00db91a730 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:38.094078 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f5c51-44d9-4549-9f4b-ee00db91a730 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:38.119664 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 990/1985] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:38.121209 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:38.164640 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e76ae-1fd7-4563-a5e7-d7f1ac2c9c54 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:38.171306 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed329138-fdfb-40a1-963e-5237f7214171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:38.171828 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed329138-fdfb-40a1-963e-5237f7214171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:38.172190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed329138-fdfb-40a1-963e-5237f7214171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:38.172533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed329138-fdfb-40a1-963e-5237f7214171 admin admin] PATH_INFO: `/v3/projects/76d404cca7d8428db84d8ce88cd6e3e3` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:38.174378 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed329138-fdfb-40a1-963e-5237f7214171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d404cca7d8428db84d8ce88cd6e3e3)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:38.177268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed329138-fdfb-40a1-963e-5237f7214171 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:38.376309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-ed329138-fdfb-40a1-963e-5237f7214171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d404cca7d8428db84d8ce88cd6e3e3', 'request_id': 'req-ed329138-fdfb-40a1-963e-5237f7214171'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:38.415273 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:38.551137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-ed329138-fdfb-40a1-963e-5237f7214171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d404cca7d8428db84d8ce88cd6e3e3', 'request_id': 'req-ed329138-fdfb-40a1-963e-5237f7214171'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:38.562632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-ed329138-fdfb-40a1-963e-5237f7214171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d404cca7d8428db84d8ce88cd6e3e3', 'request_id': 'req-ed329138-fdfb-40a1-963e-5237f7214171'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:38.581510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-ed329138-fdfb-40a1-963e-5237f7214171 admin admin] The token cache is being invalidate because project 76d404cca7d8428db84d8ce88cd6e3e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:38.581943 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-ed329138-fdfb-40a1-963e-5237f7214171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:38.582732 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-ed329138-fdfb-40a1-963e-5237f7214171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:38.584507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 996/1986] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:38 2022] DELETE /identity/v3/projects/76d404cca7d8428db84d8ce88cd6e3e3 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:31:38.588986 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f5c51-44d9-4549-9f4b-ee00db91a730 service cinder] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:38.600605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f5c51-44d9-4549-9f4b-ee00db91a730 service cinder] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:38.676970 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e60cf3-66cf-43b2-8f51-2650e690772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:38.678268 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e60cf3-66cf-43b2-8f51-2650e690772d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:38.678574 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e60cf3-66cf-43b2-8f51-2650e690772d admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:38.678934 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e60cf3-66cf-43b2-8f51-2650e690772d admin admin] PATH_INFO: `/v3/users/96c1b87dc6774ff89dbe859b35db8619` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:38.680623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e60cf3-66cf-43b2-8f51-2650e690772d admin admin] RBAC: Authorizing `identity:delete_user(user_id=96c1b87dc6774ff89dbe859b35db8619)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:38.683842 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e60cf3-66cf-43b2-8f51-2650e690772d admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:39.036061 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c9e60cf3-66cf-43b2-8f51-2650e690772d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96c1b87dc6774ff89dbe859b35db8619'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:39.063525 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c9e60cf3-66cf-43b2-8f51-2650e690772d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96c1b87dc6774ff89dbe859b35db8619'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:39.260171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c9e60cf3-66cf-43b2-8f51-2650e690772d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96c1b87dc6774ff89dbe859b35db8619'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:39.262116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:39.266251 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c9e60cf3-66cf-43b2-8f51-2650e690772d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96c1b87dc6774ff89dbe859b35db8619'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:39.293630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c9e60cf3-66cf-43b2-8f51-2650e690772d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96c1b87dc6774ff89dbe859b35db8619'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:39.322113 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 991/1987] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:38 2022] DELETE /identity/v3/users/96c1b87dc6774ff89dbe859b35db8619 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:40.106243 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed329138-fdfb-40a1-963e-5237f7214171 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:40.110954 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ed329138-fdfb-40a1-963e-5237f7214171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:40.148707 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed329138-fdfb-40a1-963e-5237f7214171 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:40.267286 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf130a18-2508-4efb-ab18-281d9a11253f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:40.268189 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf130a18-2508-4efb-ab18-281d9a11253f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:40.268471 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf130a18-2508-4efb-ab18-281d9a11253f admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:40.268742 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf130a18-2508-4efb-ab18-281d9a11253f admin admin] PATH_INFO: `/v3/projects/6e5190eb7b034984848faa1f399f3ab4` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:40.270076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf130a18-2508-4efb-ab18-281d9a11253f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5190eb7b034984848faa1f399f3ab4)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:40.272221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf130a18-2508-4efb-ab18-281d9a11253f admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:40.595846 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bf130a18-2508-4efb-ab18-281d9a11253f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5190eb7b034984848faa1f399f3ab4', 'request_id': 'req-bf130a18-2508-4efb-ab18-281d9a11253f'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:40.751090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bf130a18-2508-4efb-ab18-281d9a11253f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5190eb7b034984848faa1f399f3ab4', 'request_id': 'req-bf130a18-2508-4efb-ab18-281d9a11253f'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:40.758818 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bf130a18-2508-4efb-ab18-281d9a11253f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5190eb7b034984848faa1f399f3ab4', 'request_id': 'req-bf130a18-2508-4efb-ab18-281d9a11253f'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:40.773253 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bf130a18-2508-4efb-ab18-281d9a11253f admin admin] The token cache is being invalidate because project 6e5190eb7b034984848faa1f399f3ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:40.773548 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bf130a18-2508-4efb-ab18-281d9a11253f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:40.774241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bf130a18-2508-4efb-ab18-281d9a11253f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:40.775912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 997/1988] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:40 2022] DELETE /identity/v3/projects/6e5190eb7b034984848faa1f399f3ab4 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:40.782388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29766ed5-134f-4f86-8d10-be27fc9d7f93 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:40.783035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29766ed5-134f-4f86-8d10-be27fc9d7f93 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:40.783035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29766ed5-134f-4f86-8d10-be27fc9d7f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:40.816179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-29766ed5-134f-4f86-8d10-be27fc9d7f93 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:40.818243 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-29766ed5-134f-4f86-8d10-be27fc9d7f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:40.924370 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 992/1989] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:40.933203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea4acc-08a7-4233-8bda-4f61d22c12a4 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:40.933203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea4acc-08a7-4233-8bda-4f61d22c12a4 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:40.933599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea4acc-08a7-4233-8bda-4f61d22c12a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:40.961591 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-11ea4acc-08a7-4233-8bda-4f61d22c12a4 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:40.962910 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-11ea4acc-08a7-4233-8bda-4f61d22c12a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:40.980848 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 998/1990] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:31:40.987567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29766ed5-134f-4f86-8d10-be27fc9d7f93 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:41.006175 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29766ed5-134f-4f86-8d10-be27fc9d7f93 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:41.012394 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34608f25-c163-4afe-8fc0-f46d8e77adba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:41.013629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34608f25-c163-4afe-8fc0-f46d8e77adba admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:41.013908 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34608f25-c163-4afe-8fc0-f46d8e77adba admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:41.014179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34608f25-c163-4afe-8fc0-f46d8e77adba admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:41.015123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34608f25-c163-4afe-8fc0-f46d8e77adba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:31:41.015587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34608f25-c163-4afe-8fc0-f46d8e77adba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:41.017106 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34608f25-c163-4afe-8fc0-f46d8e77adba admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:41.033925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 993/1991] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:31:41.038755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea4acc-08a7-4233-8bda-4f61d22c12a4 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:41.051735 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea4acc-08a7-4233-8bda-4f61d22c12a4 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:41.059656 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea72c2e-7341-465b-a9a2-4f615dd9353a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:41.061792 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea72c2e-7341-465b-a9a2-4f615dd9353a admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:41.062264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea72c2e-7341-465b-a9a2-4f615dd9353a admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:41.062718 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea72c2e-7341-465b-a9a2-4f615dd9353a admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:41.064163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea72c2e-7341-465b-a9a2-4f615dd9353a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:41.066533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea72c2e-7341-465b-a9a2-4f615dd9353a admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:41.152228 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:41.218830 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 999/1992] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:41 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:41.223583 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34608f25-c163-4afe-8fc0-f46d8e77adba admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:41.234732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34608f25-c163-4afe-8fc0-f46d8e77adba admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:41.336731 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ae8a2-2bed-44be-b7ec-2f17338f425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:41.337787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ae8a2-2bed-44be-b7ec-2f17338f425c admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:41.338293 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ae8a2-2bed-44be-b7ec-2f17338f425c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:41.339727 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ae8a2-2bed-44be-b7ec-2f17338f425c admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:41.340554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ae8a2-2bed-44be-b7ec-2f17338f425c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:41.343155 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ae8a2-2bed-44be-b7ec-2f17338f425c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:41.541890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 994/1993] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:41 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:41.545685 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea72c2e-7341-465b-a9a2-4f615dd9353a admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:41.566397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea72c2e-7341-465b-a9a2-4f615dd9353a admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:41.588380 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62083251-96ec-47d2-9df2-b0e0c0fca3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:41.589174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62083251-96ec-47d2-9df2-b0e0c0fca3af admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:41.589638 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62083251-96ec-47d2-9df2-b0e0c0fca3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:41.589912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62083251-96ec-47d2-9df2-b0e0c0fca3af admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:41.590605 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62083251-96ec-47d2-9df2-b0e0c0fca3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:41.593001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62083251-96ec-47d2-9df2-b0e0c0fca3af admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:41.606751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1000/1994] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:31:41.610353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ae8a2-2bed-44be-b7ec-2f17338f425c admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:41.623820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ae8a2-2bed-44be-b7ec-2f17338f425c admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:41.628794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e4989-8a50-4a95-9763-3f3e961ab61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:41.629898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e4989-8a50-4a95-9763-3f3e961ab61a admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:41.629898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e4989-8a50-4a95-9763-3f3e961ab61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:41.630070 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e4989-8a50-4a95-9763-3f3e961ab61a admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:41.630730 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e4989-8a50-4a95-9763-3f3e961ab61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:41.632261 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e4989-8a50-4a95-9763-3f3e961ab61a admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:41.645247 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 995/1995] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:31:41.650012 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62083251-96ec-47d2-9df2-b0e0c0fca3af admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:41.664075 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62083251-96ec-47d2-9df2-b0e0c0fca3af admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:41.670239 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4494912-e527-4b3c-bfcf-8a18b40cca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:41.671083 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4494912-e527-4b3c-bfcf-8a18b40cca18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:41.671365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4494912-e527-4b3c-bfcf-8a18b40cca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:41.671825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4494912-e527-4b3c-bfcf-8a18b40cca18 admin admin] PATH_INFO: `/v3/projects/515f916758ea44f1bf55507e915c2d2f/users/a5525e92f55b46f3b43483d8f4fcc92f/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:41.695662 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4494912-e527-4b3c-bfcf-8a18b40cca18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=515f916758ea44f1bf55507e915c2d2f, user_id=a5525e92f55b46f3b43483d8f4fcc92f, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:41.701284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4494912-e527-4b3c-bfcf-8a18b40cca18 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:41.804619 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1001/1996] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:41 2022] PUT /identity/v3/projects/515f916758ea44f1bf55507e915c2d2f/users/a5525e92f55b46f3b43483d8f4fcc92f/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:41.817380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e7a80-6bd0-432b-8848-7cb8dc544e80 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:41.817966 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e7a80-6bd0-432b-8848-7cb8dc544e80 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:41.818345 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e7a80-6bd0-432b-8848-7cb8dc544e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:41.898532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-619e7a80-6bd0-432b-8848-7cb8dc544e80 None None] MFA Rules not processed for user `a5525e92f55b46f3b43483d8f4fcc92f`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:41.901330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-619e7a80-6bd0-432b-8848-7cb8dc544e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:42.129430 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 996/1997] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:42.173723 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:42.218697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4494912-e527-4b3c-bfcf-8a18b40cca18 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:42.223850 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a4494912-e527-4b3c-bfcf-8a18b40cca18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:42.362850 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4494912-e527-4b3c-bfcf-8a18b40cca18 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:42.368924 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c66e62-b6d7-4598-b93b-dcf051e98874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:42.369986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c66e62-b6d7-4598-b93b-dcf051e98874 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:42.370446 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c66e62-b6d7-4598-b93b-dcf051e98874 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:42.370973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c66e62-b6d7-4598-b93b-dcf051e98874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:42.396100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c66e62-b6d7-4598-b93b-dcf051e98874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:42.396100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c66e62-b6d7-4598-b93b-dcf051e98874 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:42.405631 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1002/1998] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:42.438993 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e7a80-6bd0-432b-8848-7cb8dc544e80 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:42.597475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e7a80-6bd0-432b-8848-7cb8dc544e80 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:42.609267 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca25c8-1770-4a39-b3f3-7e27f2bc5607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:42.613193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca25c8-1770-4a39-b3f3-7e27f2bc5607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:42.613193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca25c8-1770-4a39-b3f3-7e27f2bc5607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:42.613193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca25c8-1770-4a39-b3f3-7e27f2bc5607 admin admin] PATH_INFO: `/v3/users/a5525e92f55b46f3b43483d8f4fcc92f` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:42.613193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca25c8-1770-4a39-b3f3-7e27f2bc5607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5525e92f55b46f3b43483d8f4fcc92f)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:42.622435 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca25c8-1770-4a39-b3f3-7e27f2bc5607 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:42.765424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c66e62-b6d7-4598-b93b-dcf051e98874 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:42.776594 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c66e62-b6d7-4598-b93b-dcf051e98874 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:42.809746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df99152-aa34-4cdd-aa13-ecff70c5bb1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:42.810709 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df99152-aa34-4cdd-aa13-ecff70c5bb1e service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:42.811066 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df99152-aa34-4cdd-aa13-ecff70c5bb1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:42.811356 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df99152-aa34-4cdd-aa13-ecff70c5bb1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:42.816095 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-3df99152-aa34-4cdd-aa13-ecff70c5bb1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:42.920608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df99152-aa34-4cdd-aa13-ecff70c5bb1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:42.921517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df99152-aa34-4cdd-aa13-ecff70c5bb1e service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:42.932052 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1003/1999] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:42.953853 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:42.969025 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-42ca25c8-1770-4a39-b3f3-7e27f2bc5607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5525e92f55b46f3b43483d8f4fcc92f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:43.020926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-42ca25c8-1770-4a39-b3f3-7e27f2bc5607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5525e92f55b46f3b43483d8f4fcc92f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:43.102023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a4f51-59d3-460f-98ef-446305f034d6 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:43.102307 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a4f51-59d3-460f-98ef-446305f034d6 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:43.102713 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a4f51-59d3-460f-98ef-446305f034d6 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:43.104275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1004/2000] 10.222.0.83 () {54 vars in 921 bytes} [Fri Sep 23 01:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:31:43.147876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a93693-f23f-4832-aa28-7aa23b2fc4a7 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:43.148597 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a93693-f23f-4832-aa28-7aa23b2fc4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:43.149369 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a93693-f23f-4832-aa28-7aa23b2fc4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:43.173400 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-42ca25c8-1770-4a39-b3f3-7e27f2bc5607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5525e92f55b46f3b43483d8f4fcc92f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:43.174179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-42ca25c8-1770-4a39-b3f3-7e27f2bc5607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5525e92f55b46f3b43483d8f4fcc92f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:43.182276 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-89a93693-f23f-4832-aa28-7aa23b2fc4a7 None None] MFA Rules not processed for user `3eab2cbff5984fa6a8e715ed6553db82`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:43.183246 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-42ca25c8-1770-4a39-b3f3-7e27f2bc5607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5525e92f55b46f3b43483d8f4fcc92f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:43.184568 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-89a93693-f23f-4832-aa28-7aa23b2fc4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:43.191122 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 997/2001] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:42 2022] DELETE /identity/v3/users/a5525e92f55b46f3b43483d8f4fcc92f => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:31:43.196116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb490d25-50b5-4f5b-8c08-1aa12a8bf4ac None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:43.196432 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb490d25-50b5-4f5b-8c08-1aa12a8bf4ac None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:43.196877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb490d25-50b5-4f5b-8c08-1aa12a8bf4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:43.220455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-fb490d25-50b5-4f5b-8c08-1aa12a8bf4ac None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:43.221711 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-fb490d25-50b5-4f5b-8c08-1aa12a8bf4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:43.333693 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1005/2002] 10.222.0.83 () {58 vars in 1018 bytes} [Fri Sep 23 01:31:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:31:43.335208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a93693-f23f-4832-aa28-7aa23b2fc4a7 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:43.344912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-89a93693-f23f-4832-aa28-7aa23b2fc4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:43.383310 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 998/2003] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:31:43.385104 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb490d25-50b5-4f5b-8c08-1aa12a8bf4ac None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:43.387461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-fb490d25-50b5-4f5b-8c08-1aa12a8bf4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:43.393170 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a93693-f23f-4832-aa28-7aa23b2fc4a7 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:43.411090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddfb96-9e20-4b5e-817c-04d26627a69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:43.413249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddfb96-9e20-4b5e-817c-04d26627a69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:43.414046 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddfb96-9e20-4b5e-817c-04d26627a69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:43.414845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddfb96-9e20-4b5e-817c-04d26627a69a admin admin] PATH_INFO: `/v3/users/ca2a9d6e977f4ac7abd8745d092a9472` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:43.417151 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddfb96-9e20-4b5e-817c-04d26627a69a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca2a9d6e977f4ac7abd8745d092a9472)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:43.422135 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddfb96-9e20-4b5e-817c-04d26627a69a admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:43.497679 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb490d25-50b5-4f5b-8c08-1aa12a8bf4ac None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:43.507059 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911b69c-b47f-4823-99cc-0a9d73f6ac36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eab2cbff5984fa6a8e715ed6553db82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:43.507740 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911b69c-b47f-4823-99cc-0a9d73f6ac36 service placement] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:43.508019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911b69c-b47f-4823-99cc-0a9d73f6ac36 service placement] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:43.508355 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911b69c-b47f-4823-99cc-0a9d73f6ac36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:43.525356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911b69c-b47f-4823-99cc-0a9d73f6ac36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:43.527990 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911b69c-b47f-4823-99cc-0a9d73f6ac36 service placement] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:43.543386 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 999/2004] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:43.553049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911b69c-b47f-4823-99cc-0a9d73f6ac36 service placement] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:43.554530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-3911b69c-b47f-4823-99cc-0a9d73f6ac36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:43.642048 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911b69c-b47f-4823-99cc-0a9d73f6ac36 service placement] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:43.646404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833576e-4bf2-4197-9882-ef1ffd316d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:43.647148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833576e-4bf2-4197-9882-ef1ffd316d77 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:43.647516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833576e-4bf2-4197-9882-ef1ffd316d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:43.647849 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833576e-4bf2-4197-9882-ef1ffd316d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:43.661245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833576e-4bf2-4197-9882-ef1ffd316d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:43.663515 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833576e-4bf2-4197-9882-ef1ffd316d77 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:43.680098 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1000/2005] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:43.787781 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-26ddfb96-9e20-4b5e-817c-04d26627a69a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca2a9d6e977f4ac7abd8745d092a9472'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:43.899464 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-26ddfb96-9e20-4b5e-817c-04d26627a69a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca2a9d6e977f4ac7abd8745d092a9472'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:43.900123 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-26ddfb96-9e20-4b5e-817c-04d26627a69a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca2a9d6e977f4ac7abd8745d092a9472'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:43.914571 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-26ddfb96-9e20-4b5e-817c-04d26627a69a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca2a9d6e977f4ac7abd8745d092a9472'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:43.917079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-26ddfb96-9e20-4b5e-817c-04d26627a69a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca2a9d6e977f4ac7abd8745d092a9472'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:43.949820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1006/2006] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:43 2022] DELETE /identity/v3/users/ca2a9d6e977f4ac7abd8745d092a9472 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:44.345599 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833576e-4bf2-4197-9882-ef1ffd316d77 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:44.345599 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a833576e-4bf2-4197-9882-ef1ffd316d77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:44.357393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddfb96-9e20-4b5e-817c-04d26627a69a admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:44.364610 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833576e-4bf2-4197-9882-ef1ffd316d77 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:44.366264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-26ddfb96-9e20-4b5e-817c-04d26627a69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:44.450117 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdafd3a-6ec8-4d10-a606-3c18e9bdb259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:44.450956 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdafd3a-6ec8-4d10-a606-3c18e9bdb259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:44.451241 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdafd3a-6ec8-4d10-a606-3c18e9bdb259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:44.451516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdafd3a-6ec8-4d10-a606-3c18e9bdb259 admin admin] PATH_INFO: `/v3/projects/515f916758ea44f1bf55507e915c2d2f` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:44.452763 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdafd3a-6ec8-4d10-a606-3c18e9bdb259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=515f916758ea44f1bf55507e915c2d2f)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:44.457171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdafd3a-6ec8-4d10-a606-3c18e9bdb259 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:44.494064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddfb96-9e20-4b5e-817c-04d26627a69a admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:44.500476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9e88d-5eb1-4f5d-9265-93a58091d002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:44.501223 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9e88d-5eb1-4f5d-9265-93a58091d002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:44.501556 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9e88d-5eb1-4f5d-9265-93a58091d002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:44.501900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9e88d-5eb1-4f5d-9265-93a58091d002 admin admin] PATH_INFO: `/v3/projects/6023955c03b4428e8c2bceccd706da12` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:44.503639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9e88d-5eb1-4f5d-9265-93a58091d002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6023955c03b4428e8c2bceccd706da12)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:44.506054 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9e88d-5eb1-4f5d-9265-93a58091d002 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:44.667581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-abdafd3a-6ec8-4d10-a606-3c18e9bdb259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '515f916758ea44f1bf55507e915c2d2f', 'request_id': 'req-abdafd3a-6ec8-4d10-a606-3c18e9bdb259'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:44.691345 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bed9e88d-5eb1-4f5d-9265-93a58091d002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6023955c03b4428e8c2bceccd706da12', 'request_id': 'req-bed9e88d-5eb1-4f5d-9265-93a58091d002'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:44.843824 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-abdafd3a-6ec8-4d10-a606-3c18e9bdb259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '515f916758ea44f1bf55507e915c2d2f', 'request_id': 'req-abdafd3a-6ec8-4d10-a606-3c18e9bdb259'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:44.853640 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-abdafd3a-6ec8-4d10-a606-3c18e9bdb259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '515f916758ea44f1bf55507e915c2d2f', 'request_id': 'req-abdafd3a-6ec8-4d10-a606-3c18e9bdb259'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:44.870519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-abdafd3a-6ec8-4d10-a606-3c18e9bdb259 admin admin] The token cache is being invalidate because project 515f916758ea44f1bf55507e915c2d2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:44.870987 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-abdafd3a-6ec8-4d10-a606-3c18e9bdb259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:44.871727 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-abdafd3a-6ec8-4d10-a606-3c18e9bdb259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:44.873683 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1001/2007] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:44 2022] DELETE /identity/v3/projects/515f916758ea44f1bf55507e915c2d2f => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:44.880880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca67469-1f14-46fa-9ef0-a7e0a4999d98 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:44.881169 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca67469-1f14-46fa-9ef0-a7e0a4999d98 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:44.881640 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca67469-1f14-46fa-9ef0-a7e0a4999d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:44.911523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-aca67469-1f14-46fa-9ef0-a7e0a4999d98 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:44.912871 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-aca67469-1f14-46fa-9ef0-a7e0a4999d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:45.004315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1002/2008] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:45.014084 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5d7a2-083a-4949-b52b-e150201d46d6 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:45.014785 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5d7a2-083a-4949-b52b-e150201d46d6 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:45.015127 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5d7a2-083a-4949-b52b-e150201d46d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:45.051926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-35e5d7a2-083a-4949-b52b-e150201d46d6 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:45.054065 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-35e5d7a2-083a-4949-b52b-e150201d46d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:45.066744 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1003/2009] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:31:45.072478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5d7a2-083a-4949-b52b-e150201d46d6 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:45.072710 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bed9e88d-5eb1-4f5d-9265-93a58091d002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6023955c03b4428e8c2bceccd706da12', 'request_id': 'req-bed9e88d-5eb1-4f5d-9265-93a58091d002'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:45.083783 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bed9e88d-5eb1-4f5d-9265-93a58091d002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6023955c03b4428e8c2bceccd706da12', 'request_id': 'req-bed9e88d-5eb1-4f5d-9265-93a58091d002'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:45.084387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5d7a2-083a-4949-b52b-e150201d46d6 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:45.089404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5823ef-ecf4-47aa-b7bb-44d3ef127a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:45.090040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5823ef-ecf4-47aa-b7bb-44d3ef127a6d admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:45.090332 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5823ef-ecf4-47aa-b7bb-44d3ef127a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:45.090628 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5823ef-ecf4-47aa-b7bb-44d3ef127a6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:45.091932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5823ef-ecf4-47aa-b7bb-44d3ef127a6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:31:45.092322 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5823ef-ecf4-47aa-b7bb-44d3ef127a6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:45.103635 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5823ef-ecf4-47aa-b7bb-44d3ef127a6d admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:45.103839 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bed9e88d-5eb1-4f5d-9265-93a58091d002 admin admin] The token cache is being invalidate because project 6023955c03b4428e8c2bceccd706da12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:45.103839 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bed9e88d-5eb1-4f5d-9265-93a58091d002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:45.103839 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bed9e88d-5eb1-4f5d-9265-93a58091d002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:45.103839 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1007/2010] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:44 2022] DELETE /identity/v3/projects/6023955c03b4428e8c2bceccd706da12 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:45.108841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2310d-2d2a-459e-9cc8-7f5015b26b15 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:45.109213 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2310d-2d2a-459e-9cc8-7f5015b26b15 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:45.109520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2310d-2d2a-459e-9cc8-7f5015b26b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:45.110627 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1004/2011] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:31:45.115043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5823ef-ecf4-47aa-b7bb-44d3ef127a6d admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:45.116837 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-2f5823ef-ecf4-47aa-b7bb-44d3ef127a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:45.130188 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5823ef-ecf4-47aa-b7bb-44d3ef127a6d admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:45.137349 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a384422-9038-4ab2-8f2a-eae8252cda6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:45.139265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a384422-9038-4ab2-8f2a-eae8252cda6c admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:45.149484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a384422-9038-4ab2-8f2a-eae8252cda6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:45.149484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a384422-9038-4ab2-8f2a-eae8252cda6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:45.149484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a384422-9038-4ab2-8f2a-eae8252cda6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:45.149878 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-67f2310d-2d2a-459e-9cc8-7f5015b26b15 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:45.149959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a384422-9038-4ab2-8f2a-eae8252cda6c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:45.150070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-67f2310d-2d2a-459e-9cc8-7f5015b26b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:45.161168 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1008/2012] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:45.171163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4c271-b6d4-4335-8fb2-0cbc2ef03693 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:45.171645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4c271-b6d4-4335-8fb2-0cbc2ef03693 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:45.172115 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4c271-b6d4-4335-8fb2-0cbc2ef03693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:45.198618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-63e4c271-b6d4-4335-8fb2-0cbc2ef03693 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:45.199876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-63e4c271-b6d4-4335-8fb2-0cbc2ef03693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:45.208374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1009/2013] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:31:45.212588 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4c271-b6d4-4335-8fb2-0cbc2ef03693 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:45.222481 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4c271-b6d4-4335-8fb2-0cbc2ef03693 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:45.227310 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74adb5-bfae-4760-b44c-3b4b2af1e471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:45.227916 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74adb5-bfae-4760-b44c-3b4b2af1e471 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:45.228190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74adb5-bfae-4760-b44c-3b4b2af1e471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:45.228455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74adb5-bfae-4760-b44c-3b4b2af1e471 admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:45.229140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74adb5-bfae-4760-b44c-3b4b2af1e471 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:31:45.229437 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74adb5-bfae-4760-b44c-3b4b2af1e471 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:45.231087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74adb5-bfae-4760-b44c-3b4b2af1e471 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:45.244832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1010/2014] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:31:45.249386 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74adb5-bfae-4760-b44c-3b4b2af1e471 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:45.260437 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74adb5-bfae-4760-b44c-3b4b2af1e471 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:45.277197 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e988d-98bb-493e-a0b1-d1781976c3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:45.277197 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e988d-98bb-493e-a0b1-d1781976c3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:45.277197 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e988d-98bb-493e-a0b1-d1781976c3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:45.277197 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e988d-98bb-493e-a0b1-d1781976c3c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:45.277664 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e988d-98bb-493e-a0b1-d1781976c3c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:45.280459 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e988d-98bb-493e-a0b1-d1781976c3c8 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:45.317268 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1005/2015] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:45 2022] POST /identity/v3/projects => generated 363 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:31:45.320359 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a384422-9038-4ab2-8f2a-eae8252cda6c admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:45.398821 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a384422-9038-4ab2-8f2a-eae8252cda6c admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:45.404509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266b87f-f4f0-4114-9067-9a04da51d629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:45.405350 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266b87f-f4f0-4114-9067-9a04da51d629 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:45.405515 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266b87f-f4f0-4114-9067-9a04da51d629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:45.405811 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266b87f-f4f0-4114-9067-9a04da51d629 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:45.406490 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266b87f-f4f0-4114-9067-9a04da51d629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:45.409017 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266b87f-f4f0-4114-9067-9a04da51d629 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:45.442690 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1011/2016] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:45 2022] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:31:45.444619 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e988d-98bb-493e-a0b1-d1781976c3c8 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:45.447811 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-100e988d-98bb-493e-a0b1-d1781976c3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:45.540417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e988d-98bb-493e-a0b1-d1781976c3c8 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:45.548481 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e7e2b-7256-4da0-9cdc-5f33cdedb75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:45.549560 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e7e2b-7256-4da0-9cdc-5f33cdedb75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:45.550112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e7e2b-7256-4da0-9cdc-5f33cdedb75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:45.550611 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e7e2b-7256-4da0-9cdc-5f33cdedb75d admin admin] PATH_INFO: `/v3/users/c37f287ac53047cfa1457c8abb8ad05d` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:45.552628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e7e2b-7256-4da0-9cdc-5f33cdedb75d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c37f287ac53047cfa1457c8abb8ad05d)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:45.556134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e7e2b-7256-4da0-9cdc-5f33cdedb75d admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:45.574457 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1006/2017] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:45 2022] POST /identity/v3/users => generated 282 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:31:45.576052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266b87f-f4f0-4114-9067-9a04da51d629 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:45.586959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266b87f-f4f0-4114-9067-9a04da51d629 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:45.596658 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e3167-f2c7-495b-8f8e-0901a534c035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:45.596658 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e3167-f2c7-495b-8f8e-0901a534c035 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:45.596658 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e3167-f2c7-495b-8f8e-0901a534c035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:45.596658 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e3167-f2c7-495b-8f8e-0901a534c035 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:45.597075 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e3167-f2c7-495b-8f8e-0901a534c035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:45.597075 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e3167-f2c7-495b-8f8e-0901a534c035 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:45.695278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1007/2018] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:45 2022] POST /identity/v3/users => generated 284 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:45.696119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e3167-f2c7-495b-8f8e-0901a534c035 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:45.708371 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e3167-f2c7-495b-8f8e-0901a534c035 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:45.712516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac93f2-cc38-4e34-9329-97c489d4dfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:45.712723 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac93f2-cc38-4e34-9329-97c489d4dfe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:45.713008 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac93f2-cc38-4e34-9329-97c489d4dfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:45.713259 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac93f2-cc38-4e34-9329-97c489d4dfe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:45.721591 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac93f2-cc38-4e34-9329-97c489d4dfe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:45.721591 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac93f2-cc38-4e34-9329-97c489d4dfe3 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:45.727393 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1008/2019] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:45.729208 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac93f2-cc38-4e34-9329-97c489d4dfe3 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:45.742610 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac93f2-cc38-4e34-9329-97c489d4dfe3 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:45.754238 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072b876-2fb8-4f1a-81e7-cf8b61512282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:45.754910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072b876-2fb8-4f1a-81e7-cf8b61512282 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:45.755191 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072b876-2fb8-4f1a-81e7-cf8b61512282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:45.755472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072b876-2fb8-4f1a-81e7-cf8b61512282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:45.756205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072b876-2fb8-4f1a-81e7-cf8b61512282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:45.758359 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072b876-2fb8-4f1a-81e7-cf8b61512282 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:45.774770 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1009/2020] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:45.774770 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072b876-2fb8-4f1a-81e7-cf8b61512282 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:45.785496 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072b876-2fb8-4f1a-81e7-cf8b61512282 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:45.793992 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b426305-604b-4714-a667-3ce8dcda882c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:45.793992 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b426305-604b-4714-a667-3ce8dcda882c admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:45.793992 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b426305-604b-4714-a667-3ce8dcda882c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:45.793992 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b426305-604b-4714-a667-3ce8dcda882c admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:45.794968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b426305-604b-4714-a667-3ce8dcda882c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:45.795338 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b426305-604b-4714-a667-3ce8dcda882c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:45.807309 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1010/2021] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:45.808222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b426305-604b-4714-a667-3ce8dcda882c admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:45.819207 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b426305-604b-4714-a667-3ce8dcda882c admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:45.826891 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9ab4e-1a70-4e9c-8420-be07bb32542b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:45.827875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9ab4e-1a70-4e9c-8420-be07bb32542b admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:45.828038 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9ab4e-1a70-4e9c-8420-be07bb32542b admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:45.828322 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9ab4e-1a70-4e9c-8420-be07bb32542b admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:45.829054 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9ab4e-1a70-4e9c-8420-be07bb32542b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:45.831061 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9ab4e-1a70-4e9c-8420-be07bb32542b admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:45.834478 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-940e7e2b-7256-4da0-9cdc-5f33cdedb75d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c37f287ac53047cfa1457c8abb8ad05d'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:45.842634 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1011/2022] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:45.843488 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9ab4e-1a70-4e9c-8420-be07bb32542b admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:45.856080 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9ab4e-1a70-4e9c-8420-be07bb32542b admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:45.862029 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4150e3-c040-479f-8b8a-97ddf1d7fea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:45.866915 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4150e3-c040-479f-8b8a-97ddf1d7fea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:45.866915 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4150e3-c040-479f-8b8a-97ddf1d7fea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:45.866915 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4150e3-c040-479f-8b8a-97ddf1d7fea5 admin admin] PATH_INFO: `/v3/projects/3f5f7c3461d9433e93d4eaccd276112a/users/877a2e564f374df5b31e5c71ac42530d/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:45.888914 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4150e3-c040-479f-8b8a-97ddf1d7fea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5f7c3461d9433e93d4eaccd276112a, user_id=877a2e564f374df5b31e5c71ac42530d, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:45.892215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4150e3-c040-479f-8b8a-97ddf1d7fea5 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:46.030695 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-940e7e2b-7256-4da0-9cdc-5f33cdedb75d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c37f287ac53047cfa1457c8abb8ad05d'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:46.031768 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-940e7e2b-7256-4da0-9cdc-5f33cdedb75d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c37f287ac53047cfa1457c8abb8ad05d'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:46.040103 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1012/2023] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:45 2022] PUT /identity/v3/projects/3f5f7c3461d9433e93d4eaccd276112a/users/877a2e564f374df5b31e5c71ac42530d/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:46.042415 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-940e7e2b-7256-4da0-9cdc-5f33cdedb75d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c37f287ac53047cfa1457c8abb8ad05d'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:46.042670 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4150e3-c040-479f-8b8a-97ddf1d7fea5 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:46.042992 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-940e7e2b-7256-4da0-9cdc-5f33cdedb75d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c37f287ac53047cfa1457c8abb8ad05d'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:46.046184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ff4150e3-c040-479f-8b8a-97ddf1d7fea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:46.073100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1012/2024] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:45 2022] DELETE /identity/v3/users/c37f287ac53047cfa1457c8abb8ad05d => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:46.075446 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490c4da-9572-43b4-8c37-65a7e8353a58 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:46.075713 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490c4da-9572-43b4-8c37-65a7e8353a58 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:46.076057 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490c4da-9572-43b4-8c37-65a7e8353a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:46.080188 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:46.120078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-0490c4da-9572-43b4-8c37-65a7e8353a58 None None] MFA Rules not processed for user `877a2e564f374df5b31e5c71ac42530d`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:46.121842 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-0490c4da-9572-43b4-8c37-65a7e8353a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:46.147613 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4150e3-c040-479f-8b8a-97ddf1d7fea5 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:46.217409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1013/2025] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:46.219102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba363d64-6cd3-4533-96d8-9b49b30ec091 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:46.219605 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba363d64-6cd3-4533-96d8-9b49b30ec091 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:46.220023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba363d64-6cd3-4533-96d8-9b49b30ec091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:46.237546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b83fb8-9079-4bc2-8dc5-5d34c6cda600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:46.238110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b83fb8-9079-4bc2-8dc5-5d34c6cda600 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:46.238748 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b83fb8-9079-4bc2-8dc5-5d34c6cda600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:46.239304 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b83fb8-9079-4bc2-8dc5-5d34c6cda600 admin admin] PATH_INFO: `/v3/projects/eafe74436e8d4bceb52a7d80d51a2625/users/217d085cacae4e5f97999777d8c80fe2/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:46.254547 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-ba363d64-6cd3-4533-96d8-9b49b30ec091 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:46.257005 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ba363d64-6cd3-4533-96d8-9b49b30ec091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:46.260944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b83fb8-9079-4bc2-8dc5-5d34c6cda600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eafe74436e8d4bceb52a7d80d51a2625, user_id=217d085cacae4e5f97999777d8c80fe2, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:46.263935 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b83fb8-9079-4bc2-8dc5-5d34c6cda600 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:46.272434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1014/2026] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:46.273624 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba363d64-6cd3-4533-96d8-9b49b30ec091 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:46.275343 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ba363d64-6cd3-4533-96d8-9b49b30ec091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:46.332678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1013/2027] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:46 2022] PUT /identity/v3/projects/eafe74436e8d4bceb52a7d80d51a2625/users/217d085cacae4e5f97999777d8c80fe2/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:46.333256 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b83fb8-9079-4bc2-8dc5-5d34c6cda600 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:46.340275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-07b83fb8-9079-4bc2-8dc5-5d34c6cda600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:46.381277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba363d64-6cd3-4533-96d8-9b49b30ec091 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:46.442965 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b83fb8-9079-4bc2-8dc5-5d34c6cda600 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:46.449782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274936a-c460-468b-9d40-ea40833ad957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:46.450836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274936a-c460-468b-9d40-ea40833ad957 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:46.451278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274936a-c460-468b-9d40-ea40833ad957 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:46.451736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274936a-c460-468b-9d40-ea40833ad957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:46.471148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa963c-ac2f-4e3f-84e9-e9565d0c2117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:46.472444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa963c-ac2f-4e3f-84e9-e9565d0c2117 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:46.472892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa963c-ac2f-4e3f-84e9-e9565d0c2117 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:46.473611 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa963c-ac2f-4e3f-84e9-e9565d0c2117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:46.526029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:46.562612 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274936a-c460-468b-9d40-ea40833ad957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:46.564273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274936a-c460-468b-9d40-ea40833ad957 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:46.579700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1014/2028] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:46.582382 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e6cab-550d-4d2f-8a65-ac3e82b9559a None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:46.582744 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e6cab-550d-4d2f-8a65-ac3e82b9559a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:46.583061 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e6cab-550d-4d2f-8a65-ac3e82b9559a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:46.593216 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa963c-ac2f-4e3f-84e9-e9565d0c2117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:46.593216 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa963c-ac2f-4e3f-84e9-e9565d0c2117 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:46.607945 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1015/2029] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:46.645129 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-456e6cab-550d-4d2f-8a65-ac3e82b9559a None None] MFA Rules not processed for user `217d085cacae4e5f97999777d8c80fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:46.646734 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-456e6cab-550d-4d2f-8a65-ac3e82b9559a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:46.791681 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1015/2030] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:47.289228 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa963c-ac2f-4e3f-84e9-e9565d0c2117 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:47.291007 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-71fa963c-ac2f-4e3f-84e9-e9565d0c2117 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:47.309212 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa963c-ac2f-4e3f-84e9-e9565d0c2117 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:47.314276 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969f375-d29e-4dc6-8b2a-09f92a1bf4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:47.315376 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969f375-d29e-4dc6-8b2a-09f92a1bf4ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:47.315831 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969f375-d29e-4dc6-8b2a-09f92a1bf4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:47.316152 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969f375-d29e-4dc6-8b2a-09f92a1bf4ae admin admin] PATH_INFO: `/v3/projects/40ca488c78074df397046582ea263b70` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:47.317394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969f375-d29e-4dc6-8b2a-09f92a1bf4ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=40ca488c78074df397046582ea263b70)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:47.319624 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969f375-d29e-4dc6-8b2a-09f92a1bf4ae admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:47.515303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3969f375-d29e-4dc6-8b2a-09f92a1bf4ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40ca488c78074df397046582ea263b70', 'request_id': 'req-3969f375-d29e-4dc6-8b2a-09f92a1bf4ae'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:47.526626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e6cab-550d-4d2f-8a65-ac3e82b9559a None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:47.530426 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-456e6cab-550d-4d2f-8a65-ac3e82b9559a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:47.548802 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e6cab-550d-4d2f-8a65-ac3e82b9559a None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:47.636002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3969f375-d29e-4dc6-8b2a-09f92a1bf4ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40ca488c78074df397046582ea263b70', 'request_id': 'req-3969f375-d29e-4dc6-8b2a-09f92a1bf4ae'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:47.647694 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ff685-c427-4fbf-960b-5c54a793bdf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:47.648797 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ff685-c427-4fbf-960b-5c54a793bdf5 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:47.649393 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ff685-c427-4fbf-960b-5c54a793bdf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:47.649771 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ff685-c427-4fbf-960b-5c54a793bdf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:47.650653 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3969f375-d29e-4dc6-8b2a-09f92a1bf4ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40ca488c78074df397046582ea263b70', 'request_id': 'req-3969f375-d29e-4dc6-8b2a-09f92a1bf4ae'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:47.681189 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3969f375-d29e-4dc6-8b2a-09f92a1bf4ae admin admin] The token cache is being invalidate because project 40ca488c78074df397046582ea263b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:47.681492 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3969f375-d29e-4dc6-8b2a-09f92a1bf4ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:47.682202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3969f375-d29e-4dc6-8b2a-09f92a1bf4ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:47.685798 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1016/2031] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:47 2022] DELETE /identity/v3/projects/40ca488c78074df397046582ea263b70 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:47.691774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969f375-d29e-4dc6-8b2a-09f92a1bf4ae admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:47.697669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-3969f375-d29e-4dc6-8b2a-09f92a1bf4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:47.803887 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ff685-c427-4fbf-960b-5c54a793bdf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:47.805497 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ff685-c427-4fbf-960b-5c54a793bdf5 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:47.826506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1016/2032] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:47.906767 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969f375-d29e-4dc6-8b2a-09f92a1bf4ae admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:47.926430 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcee76-af17-41ef-af9f-a92f3e8da80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:47.927239 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcee76-af17-41ef-af9f-a92f3e8da80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:47.927706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcee76-af17-41ef-af9f-a92f3e8da80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:47.928045 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcee76-af17-41ef-af9f-a92f3e8da80f admin admin] PATH_INFO: `/v3/users/e32c76a1e08c4bf3abd77ad509167bdd` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:47.933333 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfcee76-af17-41ef-af9f-a92f3e8da80f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32c76a1e08c4bf3abd77ad509167bdd)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:47.942171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfcee76-af17-41ef-af9f-a92f3e8da80f admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:48.016589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:48.226945 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-6cfcee76-af17-41ef-af9f-a92f3e8da80f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32c76a1e08c4bf3abd77ad509167bdd'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:48.351466 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-6cfcee76-af17-41ef-af9f-a92f3e8da80f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32c76a1e08c4bf3abd77ad509167bdd'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:48.352811 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-6cfcee76-af17-41ef-af9f-a92f3e8da80f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32c76a1e08c4bf3abd77ad509167bdd'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:48.366655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-6cfcee76-af17-41ef-af9f-a92f3e8da80f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32c76a1e08c4bf3abd77ad509167bdd'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:48.367782 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-6cfcee76-af17-41ef-af9f-a92f3e8da80f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32c76a1e08c4bf3abd77ad509167bdd'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:48.389803 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1017/2033] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:47 2022] DELETE /identity/v3/users/e32c76a1e08c4bf3abd77ad509167bdd => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:31:48.611160 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:48.974079 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ff685-c427-4fbf-960b-5c54a793bdf5 service cinder] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:48.994869 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ff685-c427-4fbf-960b-5c54a793bdf5 service cinder] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:49.068896 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9386e6-8e4c-4e8f-a800-124c501a21ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:49.069562 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9386e6-8e4c-4e8f-a800-124c501a21ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:49.069841 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9386e6-8e4c-4e8f-a800-124c501a21ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:49.070118 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9386e6-8e4c-4e8f-a800-124c501a21ef admin admin] PATH_INFO: `/v3/projects/902402090b8b410ca1df6dac523388d6` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:49.071364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9386e6-8e4c-4e8f-a800-124c501a21ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=902402090b8b410ca1df6dac523388d6)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:49.073375 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9386e6-8e4c-4e8f-a800-124c501a21ef admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:49.249369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-bb9386e6-8e4c-4e8f-a800-124c501a21ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902402090b8b410ca1df6dac523388d6', 'request_id': 'req-bb9386e6-8e4c-4e8f-a800-124c501a21ef'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:49.316332 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-bb9386e6-8e4c-4e8f-a800-124c501a21ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902402090b8b410ca1df6dac523388d6', 'request_id': 'req-bb9386e6-8e4c-4e8f-a800-124c501a21ef'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:49.323618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-bb9386e6-8e4c-4e8f-a800-124c501a21ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902402090b8b410ca1df6dac523388d6', 'request_id': 'req-bb9386e6-8e4c-4e8f-a800-124c501a21ef'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:49.347717 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-bb9386e6-8e4c-4e8f-a800-124c501a21ef admin admin] The token cache is being invalidate because project 902402090b8b410ca1df6dac523388d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:49.348034 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-bb9386e6-8e4c-4e8f-a800-124c501a21ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:49.348813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-bb9386e6-8e4c-4e8f-a800-124c501a21ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:49.350397 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1017/2034] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:48 2022] DELETE /identity/v3/projects/902402090b8b410ca1df6dac523388d6 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:49.356905 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c7aa9-24a3-463c-a181-505c6a408cd0 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:49.357167 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c7aa9-24a3-463c-a181-505c6a408cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:49.357483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c7aa9-24a3-463c-a181-505c6a408cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:49.380286 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-a98c7aa9-24a3-463c-a181-505c6a408cd0 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:49.381641 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a98c7aa9-24a3-463c-a181-505c6a408cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:49.455882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1018/2035] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:49.470158 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf42df-7db0-4483-b002-fb1068e8c7a8 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:49.470683 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf42df-7db0-4483-b002-fb1068e8c7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:49.471149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf42df-7db0-4483-b002-fb1068e8c7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:49.510857 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-8daf42df-7db0-4483-b002-fb1068e8c7a8 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:49.510857 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-8daf42df-7db0-4483-b002-fb1068e8c7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:49.515093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1018/2036] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:49.517575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c7aa9-24a3-463c-a181-505c6a408cd0 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:49.532834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c7aa9-24a3-463c-a181-505c6a408cd0 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:49.539512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b90de5-9795-4cbc-8d84-cecbd26ca7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:49.540171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b90de5-9795-4cbc-8d84-cecbd26ca7cd admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:49.540452 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b90de5-9795-4cbc-8d84-cecbd26ca7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:49.540757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b90de5-9795-4cbc-8d84-cecbd26ca7cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:49.541425 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b90de5-9795-4cbc-8d84-cecbd26ca7cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:31:49.541727 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b90de5-9795-4cbc-8d84-cecbd26ca7cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:49.548283 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b90de5-9795-4cbc-8d84-cecbd26ca7cd admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:49.565131 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1019/2037] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:31:49.568382 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf42df-7db0-4483-b002-fb1068e8c7a8 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:49.581994 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf42df-7db0-4483-b002-fb1068e8c7a8 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:49.587726 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767e678-7f1d-45f1-be1c-99ba659b9bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:49.589217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767e678-7f1d-45f1-be1c-99ba659b9bab admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:49.589217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767e678-7f1d-45f1-be1c-99ba659b9bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:49.589217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767e678-7f1d-45f1-be1c-99ba659b9bab admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:49.589985 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767e678-7f1d-45f1-be1c-99ba659b9bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:49.592097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767e678-7f1d-45f1-be1c-99ba659b9bab admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:49.724234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b90de5-9795-4cbc-8d84-cecbd26ca7cd admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:49.743064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a2b90de5-9795-4cbc-8d84-cecbd26ca7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:49.743578 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1019/2038] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:49 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:31:49.743656 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b90de5-9795-4cbc-8d84-cecbd26ca7cd admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:49.747780 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767e678-7f1d-45f1-be1c-99ba659b9bab admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:49.838407 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767e678-7f1d-45f1-be1c-99ba659b9bab admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:49.839747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbd8c2-a21c-424c-a7a8-084a9f3cd110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:49.840718 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbd8c2-a21c-424c-a7a8-084a9f3cd110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:49.841339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbd8c2-a21c-424c-a7a8-084a9f3cd110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:49.841755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbd8c2-a21c-424c-a7a8-084a9f3cd110 admin admin] PATH_INFO: `/v3/users/e9a4955474ac404e832880ad13b22d37` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:49.843862 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbd8c2-a21c-424c-a7a8-084a9f3cd110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9a4955474ac404e832880ad13b22d37)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:49.844600 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bf164-19df-42a4-b9e5-742b8d5d73aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:49.845251 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bf164-19df-42a4-b9e5-742b8d5d73aa admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:49.845543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bf164-19df-42a4-b9e5-742b8d5d73aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:49.845953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bf164-19df-42a4-b9e5-742b8d5d73aa admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:49.846756 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bf164-19df-42a4-b9e5-742b8d5d73aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:49.847141 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbd8c2-a21c-424c-a7a8-084a9f3cd110 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:49.848889 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bf164-19df-42a4-b9e5-742b8d5d73aa admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:49.976573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:49.983131 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1020/2039] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:49 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:49.990032 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bf164-19df-42a4-b9e5-742b8d5d73aa admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:50.006988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bf164-19df-42a4-b9e5-742b8d5d73aa admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:50.011928 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152ae5d-b559-41c3-8666-0d6ab5a21a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:50.011928 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152ae5d-b559-41c3-8666-0d6ab5a21a53 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:50.012356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152ae5d-b559-41c3-8666-0d6ab5a21a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:50.012678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152ae5d-b559-41c3-8666-0d6ab5a21a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:50.013658 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152ae5d-b559-41c3-8666-0d6ab5a21a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:50.015570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152ae5d-b559-41c3-8666-0d6ab5a21a53 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:50.030130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1021/2040] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:31:50.036237 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152ae5d-b559-41c3-8666-0d6ab5a21a53 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:50.051196 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152ae5d-b559-41c3-8666-0d6ab5a21a53 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:50.057960 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed501496-254d-478a-84de-df959f4d91a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:50.058703 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed501496-254d-478a-84de-df959f4d91a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:50.058991 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed501496-254d-478a-84de-df959f4d91a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:50.059269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed501496-254d-478a-84de-df959f4d91a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:50.060159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed501496-254d-478a-84de-df959f4d91a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:50.062018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed501496-254d-478a-84de-df959f4d91a0 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:50.082735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1022/2041] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:31:50.089590 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed501496-254d-478a-84de-df959f4d91a0 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:50.115071 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed501496-254d-478a-84de-df959f4d91a0 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:50.129169 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea17061-0182-42c3-8e0f-74644fcb359b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:50.130501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea17061-0182-42c3-8e0f-74644fcb359b admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:50.134360 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:50.134949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea17061-0182-42c3-8e0f-74644fcb359b admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:50.135540 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea17061-0182-42c3-8e0f-74644fcb359b admin admin] PATH_INFO: `/v3/projects/178904b613b548899a222e05ffb970ea/users/9fbdd6c4d635433cbcde1885c20eb287/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:50.139225 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3ebbd8c2-a21c-424c-a7a8-084a9f3cd110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9a4955474ac404e832880ad13b22d37'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:50.162075 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea17061-0182-42c3-8e0f-74644fcb359b admin admin] RBAC: Authorizing `identity:create_grant(project_id=178904b613b548899a222e05ffb970ea, user_id=9fbdd6c4d635433cbcde1885c20eb287, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:50.164756 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea17061-0182-42c3-8e0f-74644fcb359b admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:50.236395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3ebbd8c2-a21c-424c-a7a8-084a9f3cd110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9a4955474ac404e832880ad13b22d37'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:50.237194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3ebbd8c2-a21c-424c-a7a8-084a9f3cd110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9a4955474ac404e832880ad13b22d37'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:50.248052 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3ebbd8c2-a21c-424c-a7a8-084a9f3cd110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9a4955474ac404e832880ad13b22d37'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:50.248787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3ebbd8c2-a21c-424c-a7a8-084a9f3cd110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9a4955474ac404e832880ad13b22d37'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:50.268905 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1020/2042] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:49 2022] DELETE /identity/v3/users/e9a4955474ac404e832880ad13b22d37 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:31:50.273335 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55683b-346c-4c6e-9bf6-0f7949b9631f None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:50.273657 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55683b-346c-4c6e-9bf6-0f7949b9631f None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:50.273934 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55683b-346c-4c6e-9bf6-0f7949b9631f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:50.297155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-9b55683b-346c-4c6e-9bf6-0f7949b9631f None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:50.298753 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-9b55683b-346c-4c6e-9bf6-0f7949b9631f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:50.302581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1023/2043] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:50 2022] PUT /identity/v3/projects/178904b613b548899a222e05ffb970ea/users/9fbdd6c4d635433cbcde1885c20eb287/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:31:50.308737 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cf385-f922-4986-95ff-5f513076a64d None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:50.309512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cf385-f922-4986-95ff-5f513076a64d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:50.309930 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cf385-f922-4986-95ff-5f513076a64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:50.337166 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-937cf385-f922-4986-95ff-5f513076a64d None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:50.338462 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-937cf385-f922-4986-95ff-5f513076a64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:50.393724 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1021/2044] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:31:50.407013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55683b-346c-4c6e-9bf6-0f7949b9631f None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:50.408565 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-9b55683b-346c-4c6e-9bf6-0f7949b9631f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:50.427611 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1024/2045] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:50.440236 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cf385-f922-4986-95ff-5f513076a64d None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:50.442219 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-937cf385-f922-4986-95ff-5f513076a64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:50.532837 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cf385-f922-4986-95ff-5f513076a64d None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:50.533332 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55683b-346c-4c6e-9bf6-0f7949b9631f None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:50.539525 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b54af3-d835-443a-81e8-94ed1619fc9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:50.540537 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b54af3-d835-443a-81e8-94ed1619fc9f service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:50.540985 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b54af3-d835-443a-81e8-94ed1619fc9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:50.541229 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07830b3e-f92a-4c6f-8fcd-b338c6b02e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:50.541432 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b54af3-d835-443a-81e8-94ed1619fc9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:50.542200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07830b3e-f92a-4c6f-8fcd-b338c6b02e14 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:50.542564 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07830b3e-f92a-4c6f-8fcd-b338c6b02e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:50.543029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07830b3e-f92a-4c6f-8fcd-b338c6b02e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:50.561265 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07830b3e-f92a-4c6f-8fcd-b338c6b02e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:50.563123 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07830b3e-f92a-4c6f-8fcd-b338c6b02e14 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:50.563809 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b54af3-d835-443a-81e8-94ed1619fc9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:50.566130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b54af3-d835-443a-81e8-94ed1619fc9f service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:50.580301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1025/2046] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:50.590534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1022/2047] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:31:51.296202 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b54af3-d835-443a-81e8-94ed1619fc9f service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:51.298403 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e5b54af3-d835-443a-81e8-94ed1619fc9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:51.326702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b54af3-d835-443a-81e8-94ed1619fc9f service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:51.344924 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f73966-b39f-47d1-921c-17c1845ce187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:51.345801 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f73966-b39f-47d1-921c-17c1845ce187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:51.346291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f73966-b39f-47d1-921c-17c1845ce187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:51.346737 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f73966-b39f-47d1-921c-17c1845ce187 admin admin] PATH_INFO: `/v3/projects/bf14d644f9614396b432bef8e49f0edb` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:51.351698 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f73966-b39f-47d1-921c-17c1845ce187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf14d644f9614396b432bef8e49f0edb)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:51.354043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f73966-b39f-47d1-921c-17c1845ce187 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:51.360047 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:51.595080 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-49f73966-b39f-47d1-921c-17c1845ce187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf14d644f9614396b432bef8e49f0edb', 'request_id': 'req-49f73966-b39f-47d1-921c-17c1845ce187'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:51.704921 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-49f73966-b39f-47d1-921c-17c1845ce187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf14d644f9614396b432bef8e49f0edb', 'request_id': 'req-49f73966-b39f-47d1-921c-17c1845ce187'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:51.714641 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-49f73966-b39f-47d1-921c-17c1845ce187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf14d644f9614396b432bef8e49f0edb', 'request_id': 'req-49f73966-b39f-47d1-921c-17c1845ce187'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:51.731829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:51.747894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-49f73966-b39f-47d1-921c-17c1845ce187 admin admin] The token cache is being invalidate because project bf14d644f9614396b432bef8e49f0edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:51.748910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-49f73966-b39f-47d1-921c-17c1845ce187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:51.749745 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-49f73966-b39f-47d1-921c-17c1845ce187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:51.752766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1026/2048] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:51 2022] DELETE /identity/v3/projects/bf14d644f9614396b432bef8e49f0edb => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:51.758380 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07830b3e-f92a-4c6f-8fcd-b338c6b02e14 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:51.779413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07830b3e-f92a-4c6f-8fcd-b338c6b02e14 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:51.896883 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20721223-6f61-4f1b-9b9f-ecaf958dc2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:51.897596 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20721223-6f61-4f1b-9b9f-ecaf958dc2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:51.897880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20721223-6f61-4f1b-9b9f-ecaf958dc2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:51.898170 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20721223-6f61-4f1b-9b9f-ecaf958dc2a8 admin admin] PATH_INFO: `/v3/users/25680a66c1554d7d9df8bcb45ca7a346` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:51.899757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20721223-6f61-4f1b-9b9f-ecaf958dc2a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25680a66c1554d7d9df8bcb45ca7a346)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:51.901996 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20721223-6f61-4f1b-9b9f-ecaf958dc2a8 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:52.238072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-20721223-6f61-4f1b-9b9f-ecaf958dc2a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25680a66c1554d7d9df8bcb45ca7a346'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:52.419575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-20721223-6f61-4f1b-9b9f-ecaf958dc2a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25680a66c1554d7d9df8bcb45ca7a346'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:52.420906 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-20721223-6f61-4f1b-9b9f-ecaf958dc2a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25680a66c1554d7d9df8bcb45ca7a346'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:52.430784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-20721223-6f61-4f1b-9b9f-ecaf958dc2a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25680a66c1554d7d9df8bcb45ca7a346'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:52.431629 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-20721223-6f61-4f1b-9b9f-ecaf958dc2a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25680a66c1554d7d9df8bcb45ca7a346'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:52.466665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1023/2049] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:51 2022] DELETE /identity/v3/users/25680a66c1554d7d9df8bcb45ca7a346 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:52.735878 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5341c-580f-447a-a540-331e4bfb0f3c None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:52.736418 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5341c-580f-447a-a540-331e4bfb0f3c None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:52.736418 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5341c-580f-447a-a540-331e4bfb0f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:52.773626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-69c5341c-580f-447a-a540-331e4bfb0f3c None None] MFA Rules not processed for user `9fbdd6c4d635433cbcde1885c20eb287`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:52.775493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-69c5341c-580f-447a-a540-331e4bfb0f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:52.776545 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:52.862341 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1027/2050] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:52.868003 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20721223-6f61-4f1b-9b9f-ecaf958dc2a8 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:52.876144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-20721223-6f61-4f1b-9b9f-ecaf958dc2a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:52.994356 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20721223-6f61-4f1b-9b9f-ecaf958dc2a8 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:53.000137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a111f20-418a-4529-a890-283769222fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:53.001653 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a111f20-418a-4529-a890-283769222fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:53.001653 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a111f20-418a-4529-a890-283769222fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:53.001653 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a111f20-418a-4529-a890-283769222fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:53.002140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a111f20-418a-4529-a890-283769222fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:53.004297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a111f20-418a-4529-a890-283769222fd4 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:53.104473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5341c-580f-447a-a540-331e4bfb0f3c None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:53.104762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1024/2051] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:52 2022] POST /identity/v3/projects => generated 371 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:53.110766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a111f20-418a-4529-a890-283769222fd4 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:53.113868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-69c5341c-580f-447a-a540-331e4bfb0f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:53.157878 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5341c-580f-447a-a540-331e4bfb0f3c None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:53.231866 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a111f20-418a-4529-a890-283769222fd4 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:53.237753 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79358c38-a09f-47a2-b93b-bd595709b852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:53.244809 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79358c38-a09f-47a2-b93b-bd595709b852 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:53.244809 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79358c38-a09f-47a2-b93b-bd595709b852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:53.244809 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79358c38-a09f-47a2-b93b-bd595709b852 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:53.244809 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79358c38-a09f-47a2-b93b-bd595709b852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:53.244809 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79358c38-a09f-47a2-b93b-bd595709b852 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:53.247850 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:53.261129 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59475cf-69cc-4130-ac6e-d1d8f55d011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:53.261869 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59475cf-69cc-4130-ac6e-d1d8f55d011b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:53.262043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59475cf-69cc-4130-ac6e-d1d8f55d011b admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:53.262318 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59475cf-69cc-4130-ac6e-d1d8f55d011b admin admin] PATH_INFO: `/v3/projects/da7d5ffedd4d4fb5abdf5de7e8e7c6a7` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:53.264552 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59475cf-69cc-4130-ac6e-d1d8f55d011b admin admin] RBAC: Authorizing `identity:delete_project(project_id=da7d5ffedd4d4fb5abdf5de7e8e7c6a7)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:53.266693 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59475cf-69cc-4130-ac6e-d1d8f55d011b admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:53.364617 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1025/2052] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:53 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:53.375750 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79358c38-a09f-47a2-b93b-bd595709b852 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:53.389359 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79358c38-a09f-47a2-b93b-bd595709b852 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:53.395656 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0039d-96ac-4115-bbf4-a29efb805580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:53.399749 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0039d-96ac-4115-bbf4-a29efb805580 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:53.399749 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0039d-96ac-4115-bbf4-a29efb805580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:53.399749 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0039d-96ac-4115-bbf4-a29efb805580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:53.399749 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0039d-96ac-4115-bbf4-a29efb805580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:53.399749 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0039d-96ac-4115-bbf4-a29efb805580 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:53.416956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1026/2053] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:53.422293 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0039d-96ac-4115-bbf4-a29efb805580 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:53.452976 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f59475cf-69cc-4130-ac6e-d1d8f55d011b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da7d5ffedd4d4fb5abdf5de7e8e7c6a7', 'request_id': 'req-f59475cf-69cc-4130-ac6e-d1d8f55d011b'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:53.468498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0039d-96ac-4115-bbf4-a29efb805580 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:53.539167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f59475cf-69cc-4130-ac6e-d1d8f55d011b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da7d5ffedd4d4fb5abdf5de7e8e7c6a7', 'request_id': 'req-f59475cf-69cc-4130-ac6e-d1d8f55d011b'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:53.550207 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f59475cf-69cc-4130-ac6e-d1d8f55d011b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da7d5ffedd4d4fb5abdf5de7e8e7c6a7', 'request_id': 'req-f59475cf-69cc-4130-ac6e-d1d8f55d011b'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:53.566324 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f59475cf-69cc-4130-ac6e-d1d8f55d011b admin admin] The token cache is being invalidate because project da7d5ffedd4d4fb5abdf5de7e8e7c6a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:53.566753 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f59475cf-69cc-4130-ac6e-d1d8f55d011b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:53.568009 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f59475cf-69cc-4130-ac6e-d1d8f55d011b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:53.569836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1028/2054] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:53 2022] DELETE /identity/v3/projects/da7d5ffedd4d4fb5abdf5de7e8e7c6a7 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:31:53.576563 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59475cf-69cc-4130-ac6e-d1d8f55d011b admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:53.580409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f59475cf-69cc-4130-ac6e-d1d8f55d011b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:53.594998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42387b3e-d56c-4a1a-b85a-bad9a1f875bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:53.595686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42387b3e-d56c-4a1a-b85a-bad9a1f875bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:53.596037 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42387b3e-d56c-4a1a-b85a-bad9a1f875bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:53.596391 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42387b3e-d56c-4a1a-b85a-bad9a1f875bb admin admin] PATH_INFO: `/v3/projects/8ef9d5c765bf4881a7198ec6b0660db1/users/ab240c44ae7e400783133b772473ebc7/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:53.615951 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42387b3e-d56c-4a1a-b85a-bad9a1f875bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ef9d5c765bf4881a7198ec6b0660db1, user_id=ab240c44ae7e400783133b772473ebc7, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:53.619780 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42387b3e-d56c-4a1a-b85a-bad9a1f875bb admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:53.699542 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59475cf-69cc-4130-ac6e-d1d8f55d011b admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:53.705879 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded921c-cc18-4332-b00f-9317e7d40b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:53.707712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded921c-cc18-4332-b00f-9317e7d40b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:53.708113 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded921c-cc18-4332-b00f-9317e7d40b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:53.708414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded921c-cc18-4332-b00f-9317e7d40b33 admin admin] PATH_INFO: `/v3/users/a7c1ad2910e94024acd11601a46aed28` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:53.711655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded921c-cc18-4332-b00f-9317e7d40b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7c1ad2910e94024acd11601a46aed28)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:53.717581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded921c-cc18-4332-b00f-9317e7d40b33 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:53.795083 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1027/2055] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:53 2022] PUT /identity/v3/projects/8ef9d5c765bf4881a7198ec6b0660db1/users/ab240c44ae7e400783133b772473ebc7/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:31:53.795083 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42387b3e-d56c-4a1a-b85a-bad9a1f875bb admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:53.803327 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-42387b3e-d56c-4a1a-b85a-bad9a1f875bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:53.926670 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42387b3e-d56c-4a1a-b85a-bad9a1f875bb admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:53.933648 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2eaf5f-d9d4-481f-ada6-5f4438cf4aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:53.934388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eaf5f-d9d4-481f-ada6-5f4438cf4aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:53.934998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eaf5f-d9d4-481f-ada6-5f4438cf4aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:53.935249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eaf5f-d9d4-481f-ada6-5f4438cf4aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:53.936029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2eaf5f-d9d4-481f-ada6-5f4438cf4aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:53.938060 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2eaf5f-d9d4-481f-ada6-5f4438cf4aa6 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:53.951915 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1028/2056] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:31:53.958253 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2eaf5f-d9d4-481f-ada6-5f4438cf4aa6 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:53.975193 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2eaf5f-d9d4-481f-ada6-5f4438cf4aa6 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:53.982775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a316979-421b-4384-9a1d-e66da5997ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:53.984089 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a316979-421b-4384-9a1d-e66da5997ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:53.984548 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a316979-421b-4384-9a1d-e66da5997ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:53.985022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a316979-421b-4384-9a1d-e66da5997ff1 admin admin] PATH_INFO: `/v3/projects/8ef9d5c765bf4881a7198ec6b0660db1/users/ab240c44ae7e400783133b772473ebc7/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:53.989225 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a316979-421b-4384-9a1d-e66da5997ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ef9d5c765bf4881a7198ec6b0660db1, user_id=ab240c44ae7e400783133b772473ebc7, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:53.995188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a316979-421b-4384-9a1d-e66da5997ff1 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:54.002969 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-eded921c-cc18-4332-b00f-9317e7d40b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7c1ad2910e94024acd11601a46aed28'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:54.017508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1029/2057] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:53 2022] PUT /identity/v3/projects/8ef9d5c765bf4881a7198ec6b0660db1/users/ab240c44ae7e400783133b772473ebc7/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:54.021434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-eded921c-cc18-4332-b00f-9317e7d40b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7c1ad2910e94024acd11601a46aed28'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:54.146071 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-eded921c-cc18-4332-b00f-9317e7d40b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7c1ad2910e94024acd11601a46aed28'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:54.147846 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-eded921c-cc18-4332-b00f-9317e7d40b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7c1ad2910e94024acd11601a46aed28'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:54.162894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-eded921c-cc18-4332-b00f-9317e7d40b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7c1ad2910e94024acd11601a46aed28'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:54.174389 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1029/2058] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:53 2022] DELETE /identity/v3/users/a7c1ad2910e94024acd11601a46aed28 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:31:54.426434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:55.059629 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a316979-421b-4384-9a1d-e66da5997ff1 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:55.062284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-8a316979-421b-4384-9a1d-e66da5997ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:55.174029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a316979-421b-4384-9a1d-e66da5997ff1 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:55.260320 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2926d9-7833-44d9-9b45-c75da3b061cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:55.261017 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2926d9-7833-44d9-9b45-c75da3b061cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:55.261291 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2926d9-7833-44d9-9b45-c75da3b061cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:55.261607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2926d9-7833-44d9-9b45-c75da3b061cc admin admin] PATH_INFO: `/v3/projects/e2eece3dce0e4106bee1633049c4c926` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:55.263416 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2926d9-7833-44d9-9b45-c75da3b061cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2eece3dce0e4106bee1633049c4c926)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:55.265804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2926d9-7833-44d9-9b45-c75da3b061cc admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:55.453252 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-8c2926d9-7833-44d9-9b45-c75da3b061cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2eece3dce0e4106bee1633049c4c926', 'request_id': 'req-8c2926d9-7833-44d9-9b45-c75da3b061cc'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:55.584442 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-8c2926d9-7833-44d9-9b45-c75da3b061cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2eece3dce0e4106bee1633049c4c926', 'request_id': 'req-8c2926d9-7833-44d9-9b45-c75da3b061cc'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:55.596970 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-8c2926d9-7833-44d9-9b45-c75da3b061cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2eece3dce0e4106bee1633049c4c926', 'request_id': 'req-8c2926d9-7833-44d9-9b45-c75da3b061cc'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:55.624518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-8c2926d9-7833-44d9-9b45-c75da3b061cc admin admin] The token cache is being invalidate because project e2eece3dce0e4106bee1633049c4c926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:31:55.624920 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-8c2926d9-7833-44d9-9b45-c75da3b061cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:55.625852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-8c2926d9-7833-44d9-9b45-c75da3b061cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:55.628797 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1030/2059] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:31:55 2022] DELETE /identity/v3/projects/e2eece3dce0e4106bee1633049c4c926 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:31:55.645245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7302f-b3a5-4a5c-a5ca-b083d562f178 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:55.645931 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7302f-b3a5-4a5c-a5ca-b083d562f178 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:55.647891 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7302f-b3a5-4a5c-a5ca-b083d562f178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:55.692696 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-b1d7302f-b3a5-4a5c-a5ca-b083d562f178 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:55.695814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b1d7302f-b3a5-4a5c-a5ca-b083d562f178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:55.707889 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:55.801043 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1030/2060] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:55.815925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa60e40-3014-48f5-a748-c0ec5b9b3363 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:55.816420 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa60e40-3014-48f5-a748-c0ec5b9b3363 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:55.816906 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa60e40-3014-48f5-a748-c0ec5b9b3363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:55.854389 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767e252-ba54-42cd-a983-4b6891f52e4a None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:55.855724 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767e252-ba54-42cd-a983-4b6891f52e4a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:55.857312 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767e252-ba54-42cd-a983-4b6891f52e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:55.866364 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-3fa60e40-3014-48f5-a748-c0ec5b9b3363 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:55.869017 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-3fa60e40-3014-48f5-a748-c0ec5b9b3363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:55.885119 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1031/2061] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:55.893878 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa60e40-3014-48f5-a748-c0ec5b9b3363 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:55.915444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa60e40-3014-48f5-a748-c0ec5b9b3363 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:55.926275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54108b-b122-4213-b11a-88477936c5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:55.927351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54108b-b122-4213-b11a-88477936c5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:55.927842 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54108b-b122-4213-b11a-88477936c5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:55.928576 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54108b-b122-4213-b11a-88477936c5f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:55.929549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54108b-b122-4213-b11a-88477936c5f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:31:55.929932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54108b-b122-4213-b11a-88477936c5f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:55.935207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54108b-b122-4213-b11a-88477936c5f2 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:55.935481 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-8767e252-ba54-42cd-a983-4b6891f52e4a None None] MFA Rules not processed for user `ab240c44ae7e400783133b772473ebc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:55.936566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-8767e252-ba54-42cd-a983-4b6891f52e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:55.965700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1032/2062] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:31:55.971901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54108b-b122-4213-b11a-88477936c5f2 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:56.002260 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54108b-b122-4213-b11a-88477936c5f2 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:56.019268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd5f4c-cec5-447d-a9b1-ca5d3d840e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:56.022453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd5f4c-cec5-447d-a9b1-ca5d3d840e5c admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:56.022988 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd5f4c-cec5-447d-a9b1-ca5d3d840e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:56.023475 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd5f4c-cec5-447d-a9b1-ca5d3d840e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:56.025791 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd5f4c-cec5-447d-a9b1-ca5d3d840e5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:56.032539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd5f4c-cec5-447d-a9b1-ca5d3d840e5c admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:56.089325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1031/2063] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:56.103380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466eae14-6b24-469d-b85d-34392f8a2228 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:56.103380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466eae14-6b24-469d-b85d-34392f8a2228 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:56.103775 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466eae14-6b24-469d-b85d-34392f8a2228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:56.132492 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-466eae14-6b24-469d-b85d-34392f8a2228 None None] MFA Rules not processed for user `9fbdd6c4d635433cbcde1885c20eb287`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:56.134598 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-466eae14-6b24-469d-b85d-34392f8a2228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:56.211212 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1033/2064] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:31:55 2022] POST /identity/v3/projects => generated 373 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:31:56.218299 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd5f4c-cec5-447d-a9b1-ca5d3d840e5c admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:56.235928 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1032/2065] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:31:56.257045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466eae14-6b24-469d-b85d-34392f8a2228 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:56.260560 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-466eae14-6b24-469d-b85d-34392f8a2228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:56.341963 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd5f4c-cec5-447d-a9b1-ca5d3d840e5c admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:56.351619 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd59a6-e8d0-4000-a231-2a071b8f08d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:56.352366 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd59a6-e8d0-4000-a231-2a071b8f08d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:56.353309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd59a6-e8d0-4000-a231-2a071b8f08d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:56.353628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd59a6-e8d0-4000-a231-2a071b8f08d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:56.354492 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd59a6-e8d0-4000-a231-2a071b8f08d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:56.358196 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd59a6-e8d0-4000-a231-2a071b8f08d0 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:56.426668 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466eae14-6b24-469d-b85d-34392f8a2228 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:56.521620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1034/2066] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:31:56 2022] POST /identity/v3/users => generated 287 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:31:56.526064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd59a6-e8d0-4000-a231-2a071b8f08d0 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:56.541622 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd59a6-e8d0-4000-a231-2a071b8f08d0 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:56.564960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05504b66-6465-406f-961e-2440135f80eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:56.566138 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05504b66-6465-406f-961e-2440135f80eb admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:56.566517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05504b66-6465-406f-961e-2440135f80eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:56.566830 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05504b66-6465-406f-961e-2440135f80eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:56.567651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05504b66-6465-406f-961e-2440135f80eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:56.569488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05504b66-6465-406f-961e-2440135f80eb admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:56.575160 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e91147-12c6-4df8-9e56-0171368c402b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:56.575944 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e91147-12c6-4df8-9e56-0171368c402b service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:56.576903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e91147-12c6-4df8-9e56-0171368c402b service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:56.577292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e91147-12c6-4df8-9e56-0171368c402b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:56.580686 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-73e91147-12c6-4df8-9e56-0171368c402b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:56.592083 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1035/2067] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:56.593290 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05504b66-6465-406f-961e-2440135f80eb admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:56.647826 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05504b66-6465-406f-961e-2440135f80eb admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:56.656262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb421732-5035-468f-b741-93d2b1033337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:56.656951 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb421732-5035-468f-b741-93d2b1033337 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:56.657268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb421732-5035-468f-b741-93d2b1033337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:56.657548 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb421732-5035-468f-b741-93d2b1033337 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:56.658725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb421732-5035-468f-b741-93d2b1033337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:56.661058 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb421732-5035-468f-b741-93d2b1033337 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:56.679603 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1036/2068] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:31:56.684007 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb421732-5035-468f-b741-93d2b1033337 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:56.695127 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb421732-5035-468f-b741-93d2b1033337 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:56.700877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f13e8-b77c-41e6-9c88-ba8304802cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:56.701568 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f13e8-b77c-41e6-9c88-ba8304802cba admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:56.701856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f13e8-b77c-41e6-9c88-ba8304802cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:56.702149 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f13e8-b77c-41e6-9c88-ba8304802cba admin admin] PATH_INFO: `/v3/projects/99f1aab007ad483fa118c294feb908f8/users/3c4095f45fad4d68bb802e30bcc88388/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:56.723862 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f13e8-b77c-41e6-9c88-ba8304802cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f1aab007ad483fa118c294feb908f8, user_id=3c4095f45fad4d68bb802e30bcc88388, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:56.727845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f13e8-b77c-41e6-9c88-ba8304802cba admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:56.738002 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e91147-12c6-4df8-9e56-0171368c402b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:56.740442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e91147-12c6-4df8-9e56-0171368c402b service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:56.753727 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1033/2069] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:31:56.904856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1037/2070] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:31:56 2022] PUT /identity/v3/projects/99f1aab007ad483fa118c294feb908f8/users/3c4095f45fad4d68bb802e30bcc88388/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:31:56.920771 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b4f2b-5b98-49f7-b5c3-3cc3b4f9d41c None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:56.926733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b4f2b-5b98-49f7-b5c3-3cc3b4f9d41c None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:56.926733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b4f2b-5b98-49f7-b5c3-3cc3b4f9d41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:56.996553 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:57.004541 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-940b4f2b-5b98-49f7-b5c3-3cc3b4f9d41c None None] MFA Rules not processed for user `3c4095f45fad4d68bb802e30bcc88388`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:31:57.006227 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-940b4f2b-5b98-49f7-b5c3-3cc3b4f9d41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:57.163137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1034/2071] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:31:57.260819 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f13e8-b77c-41e6-9c88-ba8304802cba admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:57.264090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-026f13e8-b77c-41e6-9c88-ba8304802cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:57.402223 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f13e8-b77c-41e6-9c88-ba8304802cba admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:57.409446 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002251c-7d6a-4577-877b-0762063de0d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:57.411645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002251c-7d6a-4577-877b-0762063de0d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:57.412108 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002251c-7d6a-4577-877b-0762063de0d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:57.412593 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002251c-7d6a-4577-877b-0762063de0d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:57.433070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002251c-7d6a-4577-877b-0762063de0d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:57.436098 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002251c-7d6a-4577-877b-0762063de0d5 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:57.480664 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1038/2072] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:31:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:31:58.831806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:59.567997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b4f2b-5b98-49f7-b5c3-3cc3b4f9d41c None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:31:59.570833 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-940b4f2b-5b98-49f7-b5c3-3cc3b4f9d41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:31:59.658958 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b4f2b-5b98-49f7-b5c3-3cc3b4f9d41c None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:31:59.668384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b88bd6-1040-47ac-ac43-9e870da3ad51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:31:59.670094 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b88bd6-1040-47ac-ac43-9e870da3ad51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:31:59.670575 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b88bd6-1040-47ac-ac43-9e870da3ad51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:31:59.671081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b88bd6-1040-47ac-ac43-9e870da3ad51 admin admin] PATH_INFO: `/v3/users/212e0d6cba494552a244e4af9ab2f613` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:31:59.673157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b88bd6-1040-47ac-ac43-9e870da3ad51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=212e0d6cba494552a244e4af9ab2f613)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:31:59.676948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b88bd6-1040-47ac-ac43-9e870da3ad51 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:31:59.958906 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a0b88bd6-1040-47ac-ac43-9e870da3ad51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '212e0d6cba494552a244e4af9ab2f613'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:31:59.980814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a0b88bd6-1040-47ac-ac43-9e870da3ad51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '212e0d6cba494552a244e4af9ab2f613'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:00.047738 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a0b88bd6-1040-47ac-ac43-9e870da3ad51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '212e0d6cba494552a244e4af9ab2f613'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:00.048604 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a0b88bd6-1040-47ac-ac43-9e870da3ad51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '212e0d6cba494552a244e4af9ab2f613'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:00.058965 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a0b88bd6-1040-47ac-ac43-9e870da3ad51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '212e0d6cba494552a244e4af9ab2f613'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:00.068184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1035/2073] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:31:59 2022] DELETE /identity/v3/users/212e0d6cba494552a244e4af9ab2f613 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:00.073433 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05840561-b675-456c-aeec-5fba50d321a5 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:00.074199 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05840561-b675-456c-aeec-5fba50d321a5 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:00.074199 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05840561-b675-456c-aeec-5fba50d321a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:00.098705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-05840561-b675-456c-aeec-5fba50d321a5 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:00.100055 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-05840561-b675-456c-aeec-5fba50d321a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:00.196222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1039/2074] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:32:00.216554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b88bd6-1040-47ac-ac43-9e870da3ad51 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:00.216554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a0b88bd6-1040-47ac-ac43-9e870da3ad51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:00.304282 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b88bd6-1040-47ac-ac43-9e870da3ad51 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:00.310686 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6edbcd-07f7-4cd1-9f83-2e81b6079e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:00.313704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6edbcd-07f7-4cd1-9f83-2e81b6079e47 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:00.313704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6edbcd-07f7-4cd1-9f83-2e81b6079e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:00.313704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6edbcd-07f7-4cd1-9f83-2e81b6079e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:00.328220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6edbcd-07f7-4cd1-9f83-2e81b6079e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:00.329703 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6edbcd-07f7-4cd1-9f83-2e81b6079e47 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:00.348022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:00.348162 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1036/2075] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:00.904518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05840561-b675-456c-aeec-5fba50d321a5 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:00.906541 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-05840561-b675-456c-aeec-5fba50d321a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:00.929355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05840561-b675-456c-aeec-5fba50d321a5 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:00.940613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c769bb3-0349-4e78-b6a3-8de3857e2987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:00.942702 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c769bb3-0349-4e78-b6a3-8de3857e2987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:00.947751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c769bb3-0349-4e78-b6a3-8de3857e2987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:00.947751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c769bb3-0349-4e78-b6a3-8de3857e2987 admin admin] PATH_INFO: `/v3/projects/dce8a0afd6c64abe9ffbf329c76d3e25` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:00.947751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c769bb3-0349-4e78-b6a3-8de3857e2987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dce8a0afd6c64abe9ffbf329c76d3e25)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:00.952486 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c769bb3-0349-4e78-b6a3-8de3857e2987 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:01.141409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:01.179252 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3c769bb3-0349-4e78-b6a3-8de3857e2987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dce8a0afd6c64abe9ffbf329c76d3e25', 'request_id': 'req-3c769bb3-0349-4e78-b6a3-8de3857e2987'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:01.321985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3c769bb3-0349-4e78-b6a3-8de3857e2987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dce8a0afd6c64abe9ffbf329c76d3e25', 'request_id': 'req-3c769bb3-0349-4e78-b6a3-8de3857e2987'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:01.332244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3c769bb3-0349-4e78-b6a3-8de3857e2987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dce8a0afd6c64abe9ffbf329c76d3e25', 'request_id': 'req-3c769bb3-0349-4e78-b6a3-8de3857e2987'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:01.349450 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3c769bb3-0349-4e78-b6a3-8de3857e2987 admin admin] The token cache is being invalidate because project dce8a0afd6c64abe9ffbf329c76d3e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:32:01.349836 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3c769bb3-0349-4e78-b6a3-8de3857e2987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:01.350974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3c769bb3-0349-4e78-b6a3-8de3857e2987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:01.353937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1040/2076] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:32:00 2022] DELETE /identity/v3/projects/dce8a0afd6c64abe9ffbf329c76d3e25 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:01.361358 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b22737-3b5d-4697-b02f-5de77e89b62c None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:01.368659 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b22737-3b5d-4697-b02f-5de77e89b62c None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:01.368659 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b22737-3b5d-4697-b02f-5de77e89b62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:01.404948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-86b22737-3b5d-4697-b02f-5de77e89b62c None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:01.407254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-86b22737-3b5d-4697-b02f-5de77e89b62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:01.503324 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1037/2077] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:01.513437 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518174a1-f05b-46c7-87e9-17fd85ef0693 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:01.515365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518174a1-f05b-46c7-87e9-17fd85ef0693 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:01.515824 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518174a1-f05b-46c7-87e9-17fd85ef0693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:01.548748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-518174a1-f05b-46c7-87e9-17fd85ef0693 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:01.551019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-518174a1-f05b-46c7-87e9-17fd85ef0693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:01.567664 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1041/2078] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:01.567816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b22737-3b5d-4697-b02f-5de77e89b62c None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:01.587321 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b22737-3b5d-4697-b02f-5de77e89b62c None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:01.600969 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe082ea-bcd4-4102-90dc-ac089c83c3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:01.602509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe082ea-bcd4-4102-90dc-ac089c83c3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:01.603299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe082ea-bcd4-4102-90dc-ac089c83c3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:01.604010 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe082ea-bcd4-4102-90dc-ac089c83c3f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:01.606420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe082ea-bcd4-4102-90dc-ac089c83c3f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:32:01.607383 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe082ea-bcd4-4102-90dc-ac089c83c3f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:01.610959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe082ea-bcd4-4102-90dc-ac089c83c3f6 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:01.632784 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1038/2079] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:32:01.638830 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518174a1-f05b-46c7-87e9-17fd85ef0693 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:01.653061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518174a1-f05b-46c7-87e9-17fd85ef0693 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:01.662621 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee9ba0-cafc-434d-99dc-a07c59996a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:01.664524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee9ba0-cafc-434d-99dc-a07c59996a3b admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:01.665031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee9ba0-cafc-434d-99dc-a07c59996a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:01.665477 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee9ba0-cafc-434d-99dc-a07c59996a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:01.666706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee9ba0-cafc-434d-99dc-a07c59996a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:01.670795 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee9ba0-cafc-434d-99dc-a07c59996a3b admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:01.885980 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1042/2080] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:32:01 2022] POST /identity/v3/projects => generated 383 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:01.893314 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe082ea-bcd4-4102-90dc-ac089c83c3f6 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:01.911654 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe082ea-bcd4-4102-90dc-ac089c83c3f6 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:02.018678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5422c4-8610-4d87-a796-a78161aaa0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:02.019412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5422c4-8610-4d87-a796-a78161aaa0fa admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:02.026808 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5422c4-8610-4d87-a796-a78161aaa0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:02.026808 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5422c4-8610-4d87-a796-a78161aaa0fa admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:02.026808 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5422c4-8610-4d87-a796-a78161aaa0fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:02.026808 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5422c4-8610-4d87-a796-a78161aaa0fa admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:02.195970 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1039/2081] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:32:01 2022] POST /identity/v3/users => generated 292 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:02.201457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee9ba0-cafc-434d-99dc-a07c59996a3b admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:02.234359 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee9ba0-cafc-434d-99dc-a07c59996a3b admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:02.240869 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ddefe9-144b-4b63-b499-610bbe6db167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:02.241796 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddefe9-144b-4b63-b499-610bbe6db167 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:02.242243 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddefe9-144b-4b63-b499-610bbe6db167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:02.242747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddefe9-144b-4b63-b499-610bbe6db167 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:02.243898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ddefe9-144b-4b63-b499-610bbe6db167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:02.246241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ddefe9-144b-4b63-b499-610bbe6db167 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:02.270196 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1043/2082] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:02.271337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5422c4-8610-4d87-a796-a78161aaa0fa admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:02.284596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5422c4-8610-4d87-a796-a78161aaa0fa admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:02.297516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:02.307042 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7696e-0b77-4742-ad73-fd387444c0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:02.308106 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7696e-0b77-4742-ad73-fd387444c0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:02.308508 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7696e-0b77-4742-ad73-fd387444c0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:02.308985 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7696e-0b77-4742-ad73-fd387444c0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:02.310510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7696e-0b77-4742-ad73-fd387444c0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:02.313405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7696e-0b77-4742-ad73-fd387444c0c4 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:02.337487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1040/2083] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:32:02.345267 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ddefe9-144b-4b63-b499-610bbe6db167 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:02.358186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ddefe9-144b-4b63-b499-610bbe6db167 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:02.364888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859504c5-0f4f-4cc7-802b-8bc78bc7e59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:02.367192 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859504c5-0f4f-4cc7-802b-8bc78bc7e59a admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:02.367772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859504c5-0f4f-4cc7-802b-8bc78bc7e59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:02.368323 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859504c5-0f4f-4cc7-802b-8bc78bc7e59a admin admin] PATH_INFO: `/v3/projects/651d269788c64c03bb344014aee66146/users/1f4e2ec94f454ebcb1fdf76419da6ff0/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:02.418527 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859504c5-0f4f-4cc7-802b-8bc78bc7e59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=651d269788c64c03bb344014aee66146, user_id=1f4e2ec94f454ebcb1fdf76419da6ff0, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:02.424871 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859504c5-0f4f-4cc7-802b-8bc78bc7e59a admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:02.588942 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1044/2084] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:32:02 2022] PUT /identity/v3/projects/651d269788c64c03bb344014aee66146/users/1f4e2ec94f454ebcb1fdf76419da6ff0/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:02.591242 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3449af4-3c1f-4956-8290-cb82f37a903d None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:02.591932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3449af4-3c1f-4956-8290-cb82f37a903d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:02.594387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3449af4-3c1f-4956-8290-cb82f37a903d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:02.654899 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-e3449af4-3c1f-4956-8290-cb82f37a903d None None] MFA Rules not processed for user `1f4e2ec94f454ebcb1fdf76419da6ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:02.654899 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e3449af4-3c1f-4956-8290-cb82f37a903d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:02.672800 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:02.819815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1041/2085] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:02.838433 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859504c5-0f4f-4cc7-802b-8bc78bc7e59a admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:02.840435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-859504c5-0f4f-4cc7-802b-8bc78bc7e59a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:03.007539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859504c5-0f4f-4cc7-802b-8bc78bc7e59a admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:03.015784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e286a35-9c49-44bc-abf9-725166345b36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:03.017054 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e286a35-9c49-44bc-abf9-725166345b36 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:03.017737 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e286a35-9c49-44bc-abf9-725166345b36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:03.018236 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e286a35-9c49-44bc-abf9-725166345b36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:03.034524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e286a35-9c49-44bc-abf9-725166345b36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:03.037575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e286a35-9c49-44bc-abf9-725166345b36 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:03.055578 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1045/2086] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:04.186743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:04.882272 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:05.059810 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:06.597068 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:06.787738 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3449af4-3c1f-4956-8290-cb82f37a903d None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:06.790392 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e3449af4-3c1f-4956-8290-cb82f37a903d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:06.925881 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e286a35-9c49-44bc-abf9-725166345b36 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:06.927966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-7e286a35-9c49-44bc-abf9-725166345b36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:06.939961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3449af4-3c1f-4956-8290-cb82f37a903d None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:06.948724 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90764e11-b846-4e99-981b-30daabbeb6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:06.950878 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90764e11-b846-4e99-981b-30daabbeb6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:06.951379 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90764e11-b846-4e99-981b-30daabbeb6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:06.952086 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90764e11-b846-4e99-981b-30daabbeb6dd admin admin] PATH_INFO: `/v3/users/217d085cacae4e5f97999777d8c80fe2` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:06.953041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e286a35-9c49-44bc-abf9-725166345b36 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:06.954149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90764e11-b846-4e99-981b-30daabbeb6dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=217d085cacae4e5f97999777d8c80fe2)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:06.957717 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90764e11-b846-4e99-981b-30daabbeb6dd admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:06.961528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5d974-fe49-47c5-8f88-ef37314259ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:06.962329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5d974-fe49-47c5-8f88-ef37314259ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:06.963094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5d974-fe49-47c5-8f88-ef37314259ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:06.963553 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5d974-fe49-47c5-8f88-ef37314259ac admin admin] PATH_INFO: `/v3/users/3c4095f45fad4d68bb802e30bcc88388` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:06.965848 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5d974-fe49-47c5-8f88-ef37314259ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c4095f45fad4d68bb802e30bcc88388)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:06.983346 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5d974-fe49-47c5-8f88-ef37314259ac admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:07.180008 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:07.243621 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-90764e11-b846-4e99-981b-30daabbeb6dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '217d085cacae4e5f97999777d8c80fe2'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:07.260078 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-90764e11-b846-4e99-981b-30daabbeb6dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '217d085cacae4e5f97999777d8c80fe2'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:07.329772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2ee5d974-fe49-47c5-8f88-ef37314259ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c4095f45fad4d68bb802e30bcc88388'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:07.355635 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-90764e11-b846-4e99-981b-30daabbeb6dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '217d085cacae4e5f97999777d8c80fe2'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:07.356505 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-90764e11-b846-4e99-981b-30daabbeb6dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '217d085cacae4e5f97999777d8c80fe2'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:07.367036 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-90764e11-b846-4e99-981b-30daabbeb6dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '217d085cacae4e5f97999777d8c80fe2'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:07.375464 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1042/2087] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:32:06 2022] DELETE /identity/v3/users/217d085cacae4e5f97999777d8c80fe2 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:32:07.380453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381d740-7e57-4182-b769-3512616324b6 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:07.380722 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381d740-7e57-4182-b769-3512616324b6 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:07.380998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381d740-7e57-4182-b769-3512616324b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:07.403256 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-d381d740-7e57-4182-b769-3512616324b6 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:07.405324 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-d381d740-7e57-4182-b769-3512616324b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:07.465136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2ee5d974-fe49-47c5-8f88-ef37314259ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c4095f45fad4d68bb802e30bcc88388'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:07.466360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2ee5d974-fe49-47c5-8f88-ef37314259ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c4095f45fad4d68bb802e30bcc88388'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:07.480681 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2ee5d974-fe49-47c5-8f88-ef37314259ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c4095f45fad4d68bb802e30bcc88388'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:07.481702 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2ee5d974-fe49-47c5-8f88-ef37314259ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c4095f45fad4d68bb802e30bcc88388'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:07.500457 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1043/2088] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:32:07.511789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1046/2089] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:32:06 2022] DELETE /identity/v3/users/3c4095f45fad4d68bb802e30bcc88388 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:07.518022 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381d740-7e57-4182-b769-3512616324b6 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:07.518401 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a463f-bbc3-4d12-a46d-5dba570856e5 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:07.518642 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a463f-bbc3-4d12-a46d-5dba570856e5 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:07.518983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a463f-bbc3-4d12-a46d-5dba570856e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:07.519970 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-d381d740-7e57-4182-b769-3512616324b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:07.553308 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-6a3a463f-bbc3-4d12-a46d-5dba570856e5 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:07.553768 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-6a3a463f-bbc3-4d12-a46d-5dba570856e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:07.590641 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381d740-7e57-4182-b769-3512616324b6 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:07.655114 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1047/2090] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:32:07.659988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f39489-52dd-4fda-84b7-51952181e9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:07.660634 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f39489-52dd-4fda-84b7-51952181e9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:07.661026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f39489-52dd-4fda-84b7-51952181e9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:07.662014 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f39489-52dd-4fda-84b7-51952181e9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:07.669539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a463f-bbc3-4d12-a46d-5dba570856e5 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:07.674155 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f39489-52dd-4fda-84b7-51952181e9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:07.675665 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f39489-52dd-4fda-84b7-51952181e9b9 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:07.679313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a463f-bbc3-4d12-a46d-5dba570856e5 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:07.683543 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71ed5f-2254-42db-b556-236c85fca903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:07.684214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71ed5f-2254-42db-b556-236c85fca903 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:07.685068 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71ed5f-2254-42db-b556-236c85fca903 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:07.685514 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71ed5f-2254-42db-b556-236c85fca903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:07.686972 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1044/2091] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:07.695990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71ed5f-2254-42db-b556-236c85fca903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:07.697964 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71ed5f-2254-42db-b556-236c85fca903 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:07.710843 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1048/2092] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:32:07.938429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f39489-52dd-4fda-84b7-51952181e9b9 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:07.939968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-41f39489-52dd-4fda-84b7-51952181e9b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:07.956080 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f39489-52dd-4fda-84b7-51952181e9b9 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:07.961057 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ec924-dd0f-44f0-9ac4-975101169961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:07.961701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ec924-dd0f-44f0-9ac4-975101169961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:07.961975 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ec924-dd0f-44f0-9ac4-975101169961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:07.962437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ec924-dd0f-44f0-9ac4-975101169961 admin admin] PATH_INFO: `/v3/users/1f4e2ec94f454ebcb1fdf76419da6ff0` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:07.963739 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ec924-dd0f-44f0-9ac4-975101169961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f4e2ec94f454ebcb1fdf76419da6ff0)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:07.965831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ec924-dd0f-44f0-9ac4-975101169961 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:08.251983 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ae9ec924-dd0f-44f0-9ac4-975101169961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f4e2ec94f454ebcb1fdf76419da6ff0'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:08.277327 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ae9ec924-dd0f-44f0-9ac4-975101169961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f4e2ec94f454ebcb1fdf76419da6ff0'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:08.400054 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ae9ec924-dd0f-44f0-9ac4-975101169961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f4e2ec94f454ebcb1fdf76419da6ff0'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:08.410356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ae9ec924-dd0f-44f0-9ac4-975101169961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f4e2ec94f454ebcb1fdf76419da6ff0'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:08.411908 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71ed5f-2254-42db-b556-236c85fca903 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:08.414013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-7f71ed5f-2254-42db-b556-236c85fca903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:08.422011 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ae9ec924-dd0f-44f0-9ac4-975101169961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f4e2ec94f454ebcb1fdf76419da6ff0'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:08.435864 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1045/2093] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:32:07 2022] DELETE /identity/v3/users/1f4e2ec94f454ebcb1fdf76419da6ff0 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:08.438322 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ec924-dd0f-44f0-9ac4-975101169961 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:08.441290 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ae9ec924-dd0f-44f0-9ac4-975101169961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:08.451940 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71ed5f-2254-42db-b556-236c85fca903 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:08.538120 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0fc96-8ca0-436b-92aa-6d1254195ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:08.539193 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0fc96-8ca0-436b-92aa-6d1254195ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:08.539693 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0fc96-8ca0-436b-92aa-6d1254195ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:08.540189 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0fc96-8ca0-436b-92aa-6d1254195ace admin admin] PATH_INFO: `/v3/projects/eafe74436e8d4bceb52a7d80d51a2625` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:08.542370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0fc96-8ca0-436b-92aa-6d1254195ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=eafe74436e8d4bceb52a7d80d51a2625)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:08.546976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0fc96-8ca0-436b-92aa-6d1254195ace admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:08.553332 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ec924-dd0f-44f0-9ac4-975101169961 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:08.558693 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42796cf3-295a-4530-a013-e24fea8713b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:08.560028 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42796cf3-295a-4530-a013-e24fea8713b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:08.560312 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42796cf3-295a-4530-a013-e24fea8713b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:08.560586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42796cf3-295a-4530-a013-e24fea8713b5 admin admin] PATH_INFO: `/v3/projects/99f1aab007ad483fa118c294feb908f8` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:08.561829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42796cf3-295a-4530-a013-e24fea8713b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f1aab007ad483fa118c294feb908f8)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:08.563819 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42796cf3-295a-4530-a013-e24fea8713b5 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:08.594214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:08.675681 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2fb0fc96-8ca0-436b-92aa-6d1254195ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eafe74436e8d4bceb52a7d80d51a2625', 'request_id': 'req-2fb0fc96-8ca0-436b-92aa-6d1254195ace'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:08.717734 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-42796cf3-295a-4530-a013-e24fea8713b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f1aab007ad483fa118c294feb908f8', 'request_id': 'req-42796cf3-295a-4530-a013-e24fea8713b5'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:08.773178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2fb0fc96-8ca0-436b-92aa-6d1254195ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eafe74436e8d4bceb52a7d80d51a2625', 'request_id': 'req-2fb0fc96-8ca0-436b-92aa-6d1254195ace'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:08.781356 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2fb0fc96-8ca0-436b-92aa-6d1254195ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eafe74436e8d4bceb52a7d80d51a2625', 'request_id': 'req-2fb0fc96-8ca0-436b-92aa-6d1254195ace'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:08.794571 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2fb0fc96-8ca0-436b-92aa-6d1254195ace admin admin] The token cache is being invalidate because project eafe74436e8d4bceb52a7d80d51a2625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:32:08.794844 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2fb0fc96-8ca0-436b-92aa-6d1254195ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:08.795471 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2fb0fc96-8ca0-436b-92aa-6d1254195ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:08.796960 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1049/2094] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:32:08 2022] DELETE /identity/v3/projects/eafe74436e8d4bceb52a7d80d51a2625 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:08.798514 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cf339-bfc8-49a6-a1ff-2a59416c4a5c None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:08.798829 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cf339-bfc8-49a6-a1ff-2a59416c4a5c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:08.799122 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cf339-bfc8-49a6-a1ff-2a59416c4a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:08.820837 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-141cf339-bfc8-49a6-a1ff-2a59416c4a5c None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:08.823093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-141cf339-bfc8-49a6-a1ff-2a59416c4a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:08.847519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-42796cf3-295a-4530-a013-e24fea8713b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f1aab007ad483fa118c294feb908f8', 'request_id': 'req-42796cf3-295a-4530-a013-e24fea8713b5'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:08.855161 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-42796cf3-295a-4530-a013-e24fea8713b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f1aab007ad483fa118c294feb908f8', 'request_id': 'req-42796cf3-295a-4530-a013-e24fea8713b5'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:08.876251 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-42796cf3-295a-4530-a013-e24fea8713b5 admin admin] The token cache is being invalidate because project 99f1aab007ad483fa118c294feb908f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:32:08.876768 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-42796cf3-295a-4530-a013-e24fea8713b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:08.877932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-42796cf3-295a-4530-a013-e24fea8713b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:08.880933 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1046/2095] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:32:08 2022] DELETE /identity/v3/projects/99f1aab007ad483fa118c294feb908f8 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:08.883283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb440b5-4795-42f6-8b55-11eb62ab4f56 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:08.883785 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb440b5-4795-42f6-8b55-11eb62ab4f56 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:08.884346 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb440b5-4795-42f6-8b55-11eb62ab4f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:08.915172 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1050/2096] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:08.915748 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-ccb440b5-4795-42f6-8b55-11eb62ab4f56 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:08.916974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c9454-7450-4a41-a66d-4b9fd6642957 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:08.917159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ccb440b5-4795-42f6-8b55-11eb62ab4f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:08.917438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c9454-7450-4a41-a66d-4b9fd6642957 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:08.918028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c9454-7450-4a41-a66d-4b9fd6642957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:08.927631 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1047/2097] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:08.939609 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb440b5-4795-42f6-8b55-11eb62ab4f56 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:08.941297 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ccb440b5-4795-42f6-8b55-11eb62ab4f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:08.952442 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-6b3c9454-7450-4a41-a66d-4b9fd6642957 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:08.954658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-6b3c9454-7450-4a41-a66d-4b9fd6642957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:08.958091 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:08.977983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1051/2098] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:08.987233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd7530-1412-4d32-8f05-1865ebbc0bf9 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:08.987233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd7530-1412-4d32-8f05-1865ebbc0bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:08.987233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd7530-1412-4d32-8f05-1865ebbc0bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:09.008535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-44bd7530-1412-4d32-8f05-1865ebbc0bf9 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:09.010064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-44bd7530-1412-4d32-8f05-1865ebbc0bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:09.020031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1052/2099] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:09.021458 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c605d2a-1af2-405f-87c9-56acf7945eea None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:09.021748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c605d2a-1af2-405f-87c9-56acf7945eea None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:09.022258 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c605d2a-1af2-405f-87c9-56acf7945eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:09.031164 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb440b5-4795-42f6-8b55-11eb62ab4f56 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:09.037483 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bce14-dd13-46c4-8daf-b6e200671534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:09.038564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bce14-dd13-46c4-8daf-b6e200671534 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:09.039945 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bce14-dd13-46c4-8daf-b6e200671534 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:09.039945 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bce14-dd13-46c4-8daf-b6e200671534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:09.050568 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-7c605d2a-1af2-405f-87c9-56acf7945eea None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:09.052728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-7c605d2a-1af2-405f-87c9-56acf7945eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:09.058531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bce14-dd13-46c4-8daf-b6e200671534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:09.061499 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bce14-dd13-46c4-8daf-b6e200671534 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:09.071383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1053/2100] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:09.071383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c605d2a-1af2-405f-87c9-56acf7945eea None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:09.079475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1048/2101] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:09.081356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bce14-dd13-46c4-8daf-b6e200671534 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:09.082452 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c605d2a-1af2-405f-87c9-56acf7945eea None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:09.088409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2cf40-4a92-47b9-b01e-0ef312b760b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:09.089276 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2cf40-4a92-47b9-b01e-0ef312b760b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:09.089884 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2cf40-4a92-47b9-b01e-0ef312b760b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:09.090198 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2cf40-4a92-47b9-b01e-0ef312b760b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:09.092069 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2cf40-4a92-47b9-b01e-0ef312b760b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:32:09.094799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2cf40-4a92-47b9-b01e-0ef312b760b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:09.094799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2cf40-4a92-47b9-b01e-0ef312b760b8 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:09.098424 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bce14-dd13-46c4-8daf-b6e200671534 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:09.106571 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162369c-29d1-482c-a0ca-916641bebba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:09.107949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162369c-29d1-482c-a0ca-916641bebba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:09.108548 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162369c-29d1-482c-a0ca-916641bebba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:09.109154 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162369c-29d1-482c-a0ca-916641bebba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:09.110349 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162369c-29d1-482c-a0ca-916641bebba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:32:09.110762 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162369c-29d1-482c-a0ca-916641bebba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:09.112711 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162369c-29d1-482c-a0ca-916641bebba1 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:09.131568 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1054/2102] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:32:09.138755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2cf40-4a92-47b9-b01e-0ef312b760b8 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:09.141336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1049/2103] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:32:09.146992 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162369c-29d1-482c-a0ca-916641bebba1 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:09.159453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2cf40-4a92-47b9-b01e-0ef312b760b8 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:09.161724 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162369c-29d1-482c-a0ca-916641bebba1 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:09.165620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57b04a-3eaf-4a29-a815-d0b25699d4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:09.169340 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57b04a-3eaf-4a29-a815-d0b25699d4c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:09.169340 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57b04a-3eaf-4a29-a815-d0b25699d4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:09.169340 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57b04a-3eaf-4a29-a815-d0b25699d4c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:09.169340 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57b04a-3eaf-4a29-a815-d0b25699d4c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:09.170389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57b04a-3eaf-4a29-a815-d0b25699d4c0 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:09.170613 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b468070-d3ef-4971-a797-8fdcc85917bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:09.180703 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b468070-d3ef-4971-a797-8fdcc85917bc admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:09.180703 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b468070-d3ef-4971-a797-8fdcc85917bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:09.180703 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b468070-d3ef-4971-a797-8fdcc85917bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:09.180703 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b468070-d3ef-4971-a797-8fdcc85917bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:09.180703 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b468070-d3ef-4971-a797-8fdcc85917bc admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:09.331528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1050/2104] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:32:09 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:09.331771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1055/2105] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:32:09 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:09.333137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b468070-d3ef-4971-a797-8fdcc85917bc admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:09.334640 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57b04a-3eaf-4a29-a815-d0b25699d4c0 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:09.427799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b468070-d3ef-4971-a797-8fdcc85917bc admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:09.457823 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57b04a-3eaf-4a29-a815-d0b25699d4c0 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:09.470789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a7961-7b80-45f8-be6d-2f6663e8d179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:09.471741 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a7961-7b80-45f8-be6d-2f6663e8d179 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:09.472425 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a7961-7b80-45f8-be6d-2f6663e8d179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:09.472804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a7961-7b80-45f8-be6d-2f6663e8d179 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:09.473555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a7961-7b80-45f8-be6d-2f6663e8d179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:09.477068 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a7961-7b80-45f8-be6d-2f6663e8d179 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:09.535618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5becd-0aad-4009-8a35-b1dfb64825bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:09.536695 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5becd-0aad-4009-8a35-b1dfb64825bb admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:09.537345 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5becd-0aad-4009-8a35-b1dfb64825bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:09.537847 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5becd-0aad-4009-8a35-b1dfb64825bb admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:09.539298 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5becd-0aad-4009-8a35-b1dfb64825bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:09.543324 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5becd-0aad-4009-8a35-b1dfb64825bb admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:09.581717 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1056/2106] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:32:09 2022] POST /identity/v3/users => generated 291 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:09.590315 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a7961-7b80-45f8-be6d-2f6663e8d179 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:09.605385 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a7961-7b80-45f8-be6d-2f6663e8d179 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:09.611936 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898eb8d-f9c9-476b-b96c-22190fe74ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:09.618264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898eb8d-f9c9-476b-b96c-22190fe74ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:09.618264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898eb8d-f9c9-476b-b96c-22190fe74ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:09.618264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898eb8d-f9c9-476b-b96c-22190fe74ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:09.618264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898eb8d-f9c9-476b-b96c-22190fe74ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:09.618264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898eb8d-f9c9-476b-b96c-22190fe74ee0 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:09.633169 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1057/2107] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:09.634551 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898eb8d-f9c9-476b-b96c-22190fe74ee0 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:09.645699 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898eb8d-f9c9-476b-b96c-22190fe74ee0 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:09.651228 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c43b8-33f7-4011-9b18-4ccc31ae53a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:09.651921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c43b8-33f7-4011-9b18-4ccc31ae53a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:09.652247 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c43b8-33f7-4011-9b18-4ccc31ae53a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:09.652584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c43b8-33f7-4011-9b18-4ccc31ae53a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:09.653396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c43b8-33f7-4011-9b18-4ccc31ae53a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:09.655746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c43b8-33f7-4011-9b18-4ccc31ae53a4 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:09.669194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1058/2108] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:09.675619 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c43b8-33f7-4011-9b18-4ccc31ae53a4 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:09.691402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c43b8-33f7-4011-9b18-4ccc31ae53a4 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:09.695817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1051/2109] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:32:09 2022] POST /identity/v3/users => generated 287 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:09.701714 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5becd-0aad-4009-8a35-b1dfb64825bb admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:09.702819 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512219b-a646-4362-9eec-fd8d5ba09ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:09.703850 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512219b-a646-4362-9eec-fd8d5ba09ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:09.704355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512219b-a646-4362-9eec-fd8d5ba09ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:09.704850 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512219b-a646-4362-9eec-fd8d5ba09ab0 admin admin] PATH_INFO: `/v3/projects/c89cfcb5df874931b60aefec254d8426/users/949150e0c45f4e858a73c31a015566b7/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:09.733854 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5becd-0aad-4009-8a35-b1dfb64825bb admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:09.746656 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512219b-a646-4362-9eec-fd8d5ba09ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89cfcb5df874931b60aefec254d8426, user_id=949150e0c45f4e858a73c31a015566b7, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:09.747345 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ddc6e-0f5b-42ab-ac51-fe9e817b647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:09.747345 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ddc6e-0f5b-42ab-ac51-fe9e817b647e admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:09.747564 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512219b-a646-4362-9eec-fd8d5ba09ab0 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:09.747652 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ddc6e-0f5b-42ab-ac51-fe9e817b647e admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:09.747652 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ddc6e-0f5b-42ab-ac51-fe9e817b647e admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:09.749257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ddc6e-0f5b-42ab-ac51-fe9e817b647e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:09.754027 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ddc6e-0f5b-42ab-ac51-fe9e817b647e admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:09.777580 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1052/2110] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:09.779158 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ddc6e-0f5b-42ab-ac51-fe9e817b647e admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:09.783302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f77ddc6e-0f5b-42ab-ac51-fe9e817b647e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:09.806437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ddc6e-0f5b-42ab-ac51-fe9e817b647e admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:09.815777 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a99fc-2dc2-45b4-b674-8b1234b1e66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:09.816804 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a99fc-2dc2-45b4-b674-8b1234b1e66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:09.817280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a99fc-2dc2-45b4-b674-8b1234b1e66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:09.817748 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a99fc-2dc2-45b4-b674-8b1234b1e66a admin admin] PATH_INFO: `/v3/projects/651d269788c64c03bb344014aee66146` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:09.819809 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a99fc-2dc2-45b4-b674-8b1234b1e66a admin admin] RBAC: Authorizing `identity:delete_project(project_id=651d269788c64c03bb344014aee66146)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:09.823646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a99fc-2dc2-45b4-b674-8b1234b1e66a admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:09.897254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1059/2111] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:32:09 2022] PUT /identity/v3/projects/c89cfcb5df874931b60aefec254d8426/users/949150e0c45f4e858a73c31a015566b7/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:09.898768 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512219b-a646-4362-9eec-fd8d5ba09ab0 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:10.011229 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512219b-a646-4362-9eec-fd8d5ba09ab0 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:10.013799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c68a99fc-2dc2-45b4-b674-8b1234b1e66a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '651d269788c64c03bb344014aee66146', 'request_id': 'req-c68a99fc-2dc2-45b4-b674-8b1234b1e66a'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:10.105373 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa831aa-dc7f-4950-8b99-612aff152fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:10.105373 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa831aa-dc7f-4950-8b99-612aff152fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:10.105827 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa831aa-dc7f-4950-8b99-612aff152fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:10.105827 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa831aa-dc7f-4950-8b99-612aff152fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:10.107649 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa831aa-dc7f-4950-8b99-612aff152fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:10.110041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa831aa-dc7f-4950-8b99-612aff152fc6 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:10.130787 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1060/2112] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:10.133271 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10476e24-e00a-4545-8edf-fc7ab90ee9a9 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:10.133474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10476e24-e00a-4545-8edf-fc7ab90ee9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:10.134193 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10476e24-e00a-4545-8edf-fc7ab90ee9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:10.178819 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-10476e24-e00a-4545-8edf-fc7ab90ee9a9 None None] MFA Rules not processed for user `949150e0c45f4e858a73c31a015566b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:10.180915 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-10476e24-e00a-4545-8edf-fc7ab90ee9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:10.184884 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c68a99fc-2dc2-45b4-b674-8b1234b1e66a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '651d269788c64c03bb344014aee66146', 'request_id': 'req-c68a99fc-2dc2-45b4-b674-8b1234b1e66a'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:10.194045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c68a99fc-2dc2-45b4-b674-8b1234b1e66a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '651d269788c64c03bb344014aee66146', 'request_id': 'req-c68a99fc-2dc2-45b4-b674-8b1234b1e66a'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:10.219082 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c68a99fc-2dc2-45b4-b674-8b1234b1e66a admin admin] The token cache is being invalidate because project 651d269788c64c03bb344014aee66146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:32:10.227228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c68a99fc-2dc2-45b4-b674-8b1234b1e66a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:10.227228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c68a99fc-2dc2-45b4-b674-8b1234b1e66a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:10.227228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1053/2113] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:32:09 2022] DELETE /identity/v3/projects/651d269788c64c03bb344014aee66146 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:10.227228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a99fc-2dc2-45b4-b674-8b1234b1e66a admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:10.227228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-c68a99fc-2dc2-45b4-b674-8b1234b1e66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:10.241958 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a99fc-2dc2-45b4-b674-8b1234b1e66a admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:10.249835 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98970483-0e30-49b3-b228-4c2bdd9df5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:10.252267 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98970483-0e30-49b3-b228-4c2bdd9df5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:10.259630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98970483-0e30-49b3-b228-4c2bdd9df5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:10.259630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98970483-0e30-49b3-b228-4c2bdd9df5a1 admin admin] PATH_INFO: `/v3/projects/ae427eb3d1104f8fbbeb393c63750389/users/120a45619f0541ec894de20149a95882/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:10.279110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:10.287472 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1061/2114] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:10.289053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c706c19-edae-4d63-b907-0d4d52e3be73 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:10.289418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c706c19-edae-4d63-b907-0d4d52e3be73 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:10.289700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c706c19-edae-4d63-b907-0d4d52e3be73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:10.298516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98970483-0e30-49b3-b228-4c2bdd9df5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae427eb3d1104f8fbbeb393c63750389, user_id=120a45619f0541ec894de20149a95882, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:10.303330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98970483-0e30-49b3-b228-4c2bdd9df5a1 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:10.314783 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-2c706c19-edae-4d63-b907-0d4d52e3be73 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:10.316182 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-2c706c19-edae-4d63-b907-0d4d52e3be73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:10.324769 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1062/2115] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:10.325601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c706c19-edae-4d63-b907-0d4d52e3be73 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:10.327133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-2c706c19-edae-4d63-b907-0d4d52e3be73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:10.340010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c706c19-edae-4d63-b907-0d4d52e3be73 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:10.348674 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5d92b-ac4c-4b00-8b44-a029731a786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:10.348924 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5d92b-ac4c-4b00-8b44-a029731a786c admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:10.349198 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5d92b-ac4c-4b00-8b44-a029731a786c admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:10.355842 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5d92b-ac4c-4b00-8b44-a029731a786c admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:10.355842 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5d92b-ac4c-4b00-8b44-a029731a786c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:10.355842 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5d92b-ac4c-4b00-8b44-a029731a786c admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:10.397103 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1054/2116] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:32:10 2022] PUT /identity/v3/projects/ae427eb3d1104f8fbbeb393c63750389/users/120a45619f0541ec894de20149a95882/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:10.398080 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3cc39-a61e-4198-870f-ad9b1aabc565 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:10.398366 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3cc39-a61e-4198-870f-ad9b1aabc565 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:10.398677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3cc39-a61e-4198-870f-ad9b1aabc565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:10.433311 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-51d3cc39-a61e-4198-870f-ad9b1aabc565 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:10.434639 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-51d3cc39-a61e-4198-870f-ad9b1aabc565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:10.529582 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1055/2117] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:10.529582 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827f50d-90a1-4ed9-85cc-95201dd52132 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:10.529582 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827f50d-90a1-4ed9-85cc-95201dd52132 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:10.529582 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827f50d-90a1-4ed9-85cc-95201dd52132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:10.560400 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-6827f50d-90a1-4ed9-85cc-95201dd52132 None None] MFA Rules not processed for user `120a45619f0541ec894de20149a95882`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:10.561669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6827f50d-90a1-4ed9-85cc-95201dd52132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:10.598687 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1063/2118] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:32:10 2022] POST /identity/v3/projects => generated 381 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:10.598687 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5d92b-ac4c-4b00-8b44-a029731a786c admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:10.644096 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1056/2119] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:10.644732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827f50d-90a1-4ed9-85cc-95201dd52132 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:10.657481 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827f50d-90a1-4ed9-85cc-95201dd52132 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:10.688145 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5d92b-ac4c-4b00-8b44-a029731a786c admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:10.696509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a8a74-126d-4465-b923-9c3944adc472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:10.697555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a8a74-126d-4465-b923-9c3944adc472 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:10.697982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a8a74-126d-4465-b923-9c3944adc472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:10.698264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a8a74-126d-4465-b923-9c3944adc472 admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:10.699254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a8a74-126d-4465-b923-9c3944adc472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:32:10.699550 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a8a74-126d-4465-b923-9c3944adc472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:10.701918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a8a74-126d-4465-b923-9c3944adc472 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:10.707648 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:10.734660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1064/2120] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:32:10.734660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a8a74-126d-4465-b923-9c3944adc472 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:10.751386 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a8a74-126d-4465-b923-9c3944adc472 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:10.758171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf72d18-8e35-4ffb-a25d-7bda20aa1a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:10.759273 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf72d18-8e35-4ffb-a25d-7bda20aa1a64 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:10.759733 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf72d18-8e35-4ffb-a25d-7bda20aa1a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:10.760184 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf72d18-8e35-4ffb-a25d-7bda20aa1a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:10.761067 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf72d18-8e35-4ffb-a25d-7bda20aa1a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:10.762044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1abef-c0d4-402f-809a-0a73cfa92869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:10.763385 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1abef-c0d4-402f-809a-0a73cfa92869 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:10.763743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1abef-c0d4-402f-809a-0a73cfa92869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:10.764090 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1abef-c0d4-402f-809a-0a73cfa92869 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:10.764379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf72d18-8e35-4ffb-a25d-7bda20aa1a64 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:10.764875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1abef-c0d4-402f-809a-0a73cfa92869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:10.767368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1abef-c0d4-402f-809a-0a73cfa92869 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:10.995260 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1057/2121] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:32:10 2022] POST /identity/v3/users => generated 291 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:10.996367 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1abef-c0d4-402f-809a-0a73cfa92869 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:11.000832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1065/2122] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:32:10 2022] POST /identity/v3/projects => generated 371 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:11.002117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf72d18-8e35-4ffb-a25d-7bda20aa1a64 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:11.013929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1abef-c0d4-402f-809a-0a73cfa92869 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:11.092308 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd6e2b-d767-4067-9304-7b08c0dfc074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:11.092308 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd6e2b-d767-4067-9304-7b08c0dfc074 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:11.092308 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd6e2b-d767-4067-9304-7b08c0dfc074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:11.092308 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd6e2b-d767-4067-9304-7b08c0dfc074 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:11.092611 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd6e2b-d767-4067-9304-7b08c0dfc074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:11.093734 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd6e2b-d767-4067-9304-7b08c0dfc074 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:11.094579 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf72d18-8e35-4ffb-a25d-7bda20aa1a64 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:11.101303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb89e22-f5c7-4d29-9b68-28cee78da49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:11.102758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb89e22-f5c7-4d29-9b68-28cee78da49c admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:11.102758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb89e22-f5c7-4d29-9b68-28cee78da49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:11.103236 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb89e22-f5c7-4d29-9b68-28cee78da49c admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:11.104090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb89e22-f5c7-4d29-9b68-28cee78da49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:11.107389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb89e22-f5c7-4d29-9b68-28cee78da49c admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:11.122851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1066/2123] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:11.124029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb89e22-f5c7-4d29-9b68-28cee78da49c admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:11.136663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb89e22-f5c7-4d29-9b68-28cee78da49c admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:11.145732 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc6b97-52f6-4290-bb83-f808a2a65129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:11.146542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc6b97-52f6-4290-bb83-f808a2a65129 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:11.146880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc6b97-52f6-4290-bb83-f808a2a65129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:11.147162 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc6b97-52f6-4290-bb83-f808a2a65129 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:11.157324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc6b97-52f6-4290-bb83-f808a2a65129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:11.157324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc6b97-52f6-4290-bb83-f808a2a65129 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:11.195605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1058/2124] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:32:10 2022] POST /identity/v3/projects => generated 371 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:11.197147 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd6e2b-d767-4067-9304-7b08c0dfc074 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:11.267799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1067/2125] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:32:11 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:11.269553 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc6b97-52f6-4290-bb83-f808a2a65129 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:11.288013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc6b97-52f6-4290-bb83-f808a2a65129 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:11.294544 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd6e2b-d767-4067-9304-7b08c0dfc074 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:11.298554 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ec193-75eb-440d-857c-5866feaa1104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:11.299756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ec193-75eb-440d-857c-5866feaa1104 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:11.300237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ec193-75eb-440d-857c-5866feaa1104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:11.300386 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1da0e2-536a-4bfb-8dd0-b5467a3884a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:11.300702 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ec193-75eb-440d-857c-5866feaa1104 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:11.301343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1da0e2-536a-4bfb-8dd0-b5467a3884a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:11.301764 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1da0e2-536a-4bfb-8dd0-b5467a3884a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:11.301876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ec193-75eb-440d-857c-5866feaa1104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:11.302279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1da0e2-536a-4bfb-8dd0-b5467a3884a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:11.303167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1da0e2-536a-4bfb-8dd0-b5467a3884a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:11.304884 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ec193-75eb-440d-857c-5866feaa1104 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:11.305250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1da0e2-536a-4bfb-8dd0-b5467a3884a8 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:11.318536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1059/2126] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:11.319487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1da0e2-536a-4bfb-8dd0-b5467a3884a8 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:11.331000 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1da0e2-536a-4bfb-8dd0-b5467a3884a8 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:11.337506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236d7a0-5fc6-46cc-b9e3-93b1b72d03ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:11.338139 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236d7a0-5fc6-46cc-b9e3-93b1b72d03ff admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:11.338422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236d7a0-5fc6-46cc-b9e3-93b1b72d03ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:11.338800 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236d7a0-5fc6-46cc-b9e3-93b1b72d03ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:11.339536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236d7a0-5fc6-46cc-b9e3-93b1b72d03ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:11.341998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236d7a0-5fc6-46cc-b9e3-93b1b72d03ff admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:11.353274 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1060/2127] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:11.355294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236d7a0-5fc6-46cc-b9e3-93b1b72d03ff admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:11.371084 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236d7a0-5fc6-46cc-b9e3-93b1b72d03ff admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:11.376833 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609a734-2072-46d0-80f5-187fa32e3748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:11.377504 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609a734-2072-46d0-80f5-187fa32e3748 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:11.377789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609a734-2072-46d0-80f5-187fa32e3748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:11.378072 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609a734-2072-46d0-80f5-187fa32e3748 admin admin] PATH_INFO: `/v3/projects/9d1a5a8758c640baa5e9453762129765/users/f33729d4ea5348218f43ff0a640504cc/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:11.394196 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1068/2128] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:32:11 2022] POST /identity/v3/users => generated 286 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:11.395686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ec193-75eb-440d-857c-5866feaa1104 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:11.399445 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609a734-2072-46d0-80f5-187fa32e3748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1a5a8758c640baa5e9453762129765, user_id=f33729d4ea5348218f43ff0a640504cc, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:11.402880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609a734-2072-46d0-80f5-187fa32e3748 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:11.410224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ec193-75eb-440d-857c-5866feaa1104 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:11.415974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6eeaa7-9fe1-4147-bb2d-34a02a7bf0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:11.416660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eeaa7-9fe1-4147-bb2d-34a02a7bf0fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:11.416934 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eeaa7-9fe1-4147-bb2d-34a02a7bf0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:11.417205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eeaa7-9fe1-4147-bb2d-34a02a7bf0fa admin admin] PATH_INFO: `/v3/projects/d284a5df51554d3a8592619894772fe1/users/2eed5f74a7b0474e930ace3d5eaaa7bc/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:11.436040 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6eeaa7-9fe1-4147-bb2d-34a02a7bf0fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d284a5df51554d3a8592619894772fe1, user_id=2eed5f74a7b0474e930ace3d5eaaa7bc, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:11.439156 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6eeaa7-9fe1-4147-bb2d-34a02a7bf0fa admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:11.528090 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1061/2129] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:32:11 2022] PUT /identity/v3/projects/9d1a5a8758c640baa5e9453762129765/users/f33729d4ea5348218f43ff0a640504cc/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:11.529123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609a734-2072-46d0-80f5-187fa32e3748 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:11.566862 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1069/2130] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:32:11 2022] PUT /identity/v3/projects/d284a5df51554d3a8592619894772fe1/users/2eed5f74a7b0474e930ace3d5eaaa7bc/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:11.571633 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bef84-8a3e-445d-8eda-c660290579de None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:11.572097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bef84-8a3e-445d-8eda-c660290579de None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:11.572634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bef84-8a3e-445d-8eda-c660290579de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:11.614426 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-582bef84-8a3e-445d-8eda-c660290579de None None] MFA Rules not processed for user `f33729d4ea5348218f43ff0a640504cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:11.616041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-582bef84-8a3e-445d-8eda-c660290579de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:11.646311 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609a734-2072-46d0-80f5-187fa32e3748 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:11.702075 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1070/2131] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:11.702075 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bef84-8a3e-445d-8eda-c660290579de None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:11.730643 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95138777-7352-4935-8054-0659e48d7c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:11.732953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95138777-7352-4935-8054-0659e48d7c7c admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:11.733450 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95138777-7352-4935-8054-0659e48d7c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:11.733965 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95138777-7352-4935-8054-0659e48d7c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:11.735206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95138777-7352-4935-8054-0659e48d7c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:11.738408 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95138777-7352-4935-8054-0659e48d7c7c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:11.764987 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1062/2132] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:11.766738 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95138777-7352-4935-8054-0659e48d7c7c admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:11.788254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95138777-7352-4935-8054-0659e48d7c7c admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:11.800074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e0b82-90fe-4c8d-860a-4de81670d3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:11.801330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e0b82-90fe-4c8d-860a-4de81670d3ff admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:11.801584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bef84-8a3e-445d-8eda-c660290579de None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:11.802074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e0b82-90fe-4c8d-860a-4de81670d3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:11.802853 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e0b82-90fe-4c8d-860a-4de81670d3ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:11.804319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e0b82-90fe-4c8d-860a-4de81670d3ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:11.807152 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e8d1d-8094-4a64-a4fb-3f40c94dba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:11.807940 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e8d1d-8094-4a64-a4fb-3f40c94dba58 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:11.808297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e8d1d-8094-4a64-a4fb-3f40c94dba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:11.808502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e0b82-90fe-4c8d-860a-4de81670d3ff admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:11.808707 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e8d1d-8094-4a64-a4fb-3f40c94dba58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:11.809507 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e8d1d-8094-4a64-a4fb-3f40c94dba58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:11.811439 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e8d1d-8094-4a64-a4fb-3f40c94dba58 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:11.837377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1071/2133] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:11.838684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e8d1d-8094-4a64-a4fb-3f40c94dba58 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:11.852976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e8d1d-8094-4a64-a4fb-3f40c94dba58 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:11.862159 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a319b-c827-4758-ac36-ddbbb56e8385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:11.863882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a319b-c827-4758-ac36-ddbbb56e8385 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:11.864151 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a319b-c827-4758-ac36-ddbbb56e8385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:11.864429 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a319b-c827-4758-ac36-ddbbb56e8385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:11.865140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a319b-c827-4758-ac36-ddbbb56e8385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:11.868080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a319b-c827-4758-ac36-ddbbb56e8385 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:11.884519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1072/2134] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:11.885961 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a319b-c827-4758-ac36-ddbbb56e8385 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:11.911873 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a319b-c827-4758-ac36-ddbbb56e8385 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:11.929665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3914a1-3c9e-4664-b6e9-893482c7a038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:11.931952 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3914a1-3c9e-4664-b6e9-893482c7a038 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:11.944683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3914a1-3c9e-4664-b6e9-893482c7a038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:11.944683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3914a1-3c9e-4664-b6e9-893482c7a038 admin admin] PATH_INFO: `/v3/projects/d284a5df51554d3a8592619894772fe1/users/2eed5f74a7b0474e930ace3d5eaaa7bc/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:11.944683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3914a1-3c9e-4664-b6e9-893482c7a038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d284a5df51554d3a8592619894772fe1, user_id=2eed5f74a7b0474e930ace3d5eaaa7bc, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:11.957596 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3914a1-3c9e-4664-b6e9-893482c7a038 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:12.000464 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1073/2135] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:32:11 2022] PUT /identity/v3/projects/d284a5df51554d3a8592619894772fe1/users/2eed5f74a7b0474e930ace3d5eaaa7bc/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:12.002171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3914a1-3c9e-4664-b6e9-893482c7a038 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:12.099593 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1063/2136] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:32:11 2022] POST /identity/v3/projects => generated 383 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:12.103743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e51c44-e4a6-4ab4-94af-bf3032b86525 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:12.104460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e51c44-e4a6-4ab4-94af-bf3032b86525 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:12.104997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e51c44-e4a6-4ab4-94af-bf3032b86525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:12.142924 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3914a1-3c9e-4664-b6e9-893482c7a038 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:12.190759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-d2e51c44-e4a6-4ab4-94af-bf3032b86525 None None] MFA Rules not processed for user `2eed5f74a7b0474e930ace3d5eaaa7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:12.192373 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-d2e51c44-e4a6-4ab4-94af-bf3032b86525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:12.289088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2732647-0cb3-4400-9443-aaec798d9a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:12.289937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2732647-0cb3-4400-9443-aaec798d9a55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:12.290294 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2732647-0cb3-4400-9443-aaec798d9a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:12.290668 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2732647-0cb3-4400-9443-aaec798d9a55 admin admin] PATH_INFO: `/v3/projects/46a7ec946ad64676ab7b82e4e78fd134/users/d3edeaea235147aba9e754d51a7d3a4f/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:12.315394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2732647-0cb3-4400-9443-aaec798d9a55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46a7ec946ad64676ab7b82e4e78fd134, user_id=d3edeaea235147aba9e754d51a7d3a4f, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:12.318532 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2732647-0cb3-4400-9443-aaec798d9a55 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:12.330808 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1064/2137] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:12.334831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e51c44-e4a6-4ab4-94af-bf3032b86525 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:12.353064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e51c44-e4a6-4ab4-94af-bf3032b86525 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:12.359116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d88b95-aa8e-4969-b7ad-eb5c32306bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:12.359775 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d88b95-aa8e-4969-b7ad-eb5c32306bcf admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:12.360102 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d88b95-aa8e-4969-b7ad-eb5c32306bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:12.360490 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d88b95-aa8e-4969-b7ad-eb5c32306bcf admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:12.361195 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d88b95-aa8e-4969-b7ad-eb5c32306bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:12.363573 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d88b95-aa8e-4969-b7ad-eb5c32306bcf admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:12.594921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1074/2138] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:32:11 2022] PUT /identity/v3/projects/46a7ec946ad64676ab7b82e4e78fd134/users/d3edeaea235147aba9e754d51a7d3a4f/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:12.596837 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2732647-0cb3-4400-9443-aaec798d9a55 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:12.601195 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f2732647-0cb3-4400-9443-aaec798d9a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:12.621372 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1065/2139] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:32:12 2022] POST /identity/v3/users => generated 298 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:12.629684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da9a47-eaea-4b46-9d75-5e2ddd8a5035 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:12.629684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da9a47-eaea-4b46-9d75-5e2ddd8a5035 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:12.629684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da9a47-eaea-4b46-9d75-5e2ddd8a5035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:12.671416 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-50da9a47-eaea-4b46-9d75-5e2ddd8a5035 None None] MFA Rules not processed for user `d3edeaea235147aba9e754d51a7d3a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:12.673115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-50da9a47-eaea-4b46-9d75-5e2ddd8a5035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:12.717627 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2732647-0cb3-4400-9443-aaec798d9a55 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:12.725122 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46060a9d-b53b-46ad-8a12-688a60945cca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:12.726369 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46060a9d-b53b-46ad-8a12-688a60945cca service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:12.727038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46060a9d-b53b-46ad-8a12-688a60945cca service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:12.727609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46060a9d-b53b-46ad-8a12-688a60945cca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:12.771461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1066/2140] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:12.773195 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da9a47-eaea-4b46-9d75-5e2ddd8a5035 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:12.850374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46060a9d-b53b-46ad-8a12-688a60945cca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:12.850374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46060a9d-b53b-46ad-8a12-688a60945cca service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:12.858821 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1075/2141] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:12.866013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da9a47-eaea-4b46-9d75-5e2ddd8a5035 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:12.874385 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffde3f-3c74-46e4-b0a9-8ad1b01523ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:12.879979 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffde3f-3c74-46e4-b0a9-8ad1b01523ef admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:12.879979 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffde3f-3c74-46e4-b0a9-8ad1b01523ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:12.879979 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffde3f-3c74-46e4-b0a9-8ad1b01523ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:12.879979 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffde3f-3c74-46e4-b0a9-8ad1b01523ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:12.879979 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffde3f-3c74-46e4-b0a9-8ad1b01523ef admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:12.896613 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1067/2142] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:12.902437 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46060a9d-b53b-46ad-8a12-688a60945cca service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:12.917055 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46060a9d-b53b-46ad-8a12-688a60945cca service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:12.925849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d8e5c-42e8-47da-918c-7bf2c3522e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:12.926543 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d8e5c-42e8-47da-918c-7bf2c3522e0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:12.927680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d8e5c-42e8-47da-918c-7bf2c3522e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:12.927973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d8e5c-42e8-47da-918c-7bf2c3522e0a admin admin] PATH_INFO: `/v3/projects/69f94df7be614f6385f14875bacbd425/users/76c397a2e5a44190bfcc391e641b465a/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:12.949256 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d8e5c-42e8-47da-918c-7bf2c3522e0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f94df7be614f6385f14875bacbd425, user_id=76c397a2e5a44190bfcc391e641b465a, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:12.954618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d8e5c-42e8-47da-918c-7bf2c3522e0a admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:13.081579 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffde3f-3c74-46e4-b0a9-8ad1b01523ef admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:13.095728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1076/2143] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:32:12 2022] PUT /identity/v3/projects/69f94df7be614f6385f14875bacbd425/users/76c397a2e5a44190bfcc391e641b465a/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:32:13.100260 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d8e5c-42e8-47da-918c-7bf2c3522e0a admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:13.103880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffde3f-3c74-46e4-b0a9-8ad1b01523ef admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:13.200688 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a19f9-20d2-4b2d-bf20-353ca360a3b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:13.201453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a19f9-20d2-4b2d-bf20-353ca360a3b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:13.201938 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a19f9-20d2-4b2d-bf20-353ca360a3b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:13.202210 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a19f9-20d2-4b2d-bf20-353ca360a3b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:13.229669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d8e5c-42e8-47da-918c-7bf2c3522e0a admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:13.238809 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48d4ba-8137-4e8e-bb76-c788e43997ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:13.239597 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48d4ba-8137-4e8e-bb76-c788e43997ae admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:13.240213 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48d4ba-8137-4e8e-bb76-c788e43997ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:13.240356 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48d4ba-8137-4e8e-bb76-c788e43997ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:13.241186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48d4ba-8137-4e8e-bb76-c788e43997ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:13.245809 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48d4ba-8137-4e8e-bb76-c788e43997ae admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:13.256747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1077/2144] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:13.265063 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48d4ba-8137-4e8e-bb76-c788e43997ae admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:13.280831 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48d4ba-8137-4e8e-bb76-c788e43997ae admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:13.285246 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5904f71-bf28-4fd0-87ad-79a100f81cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:13.286022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5904f71-bf28-4fd0-87ad-79a100f81cad admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:13.286745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5904f71-bf28-4fd0-87ad-79a100f81cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:13.296511 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5904f71-bf28-4fd0-87ad-79a100f81cad admin admin] PATH_INFO: `/v3/projects/69f94df7be614f6385f14875bacbd425/users/76c397a2e5a44190bfcc391e641b465a/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:13.296511 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5904f71-bf28-4fd0-87ad-79a100f81cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f94df7be614f6385f14875bacbd425, user_id=76c397a2e5a44190bfcc391e641b465a, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:13.296511 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5904f71-bf28-4fd0-87ad-79a100f81cad admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:13.308113 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1078/2145] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:32:13 2022] PUT /identity/v3/projects/69f94df7be614f6385f14875bacbd425/users/76c397a2e5a44190bfcc391e641b465a/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:32:13.319691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a19f9-20d2-4b2d-bf20-353ca360a3b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:13.322803 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a19f9-20d2-4b2d-bf20-353ca360a3b0 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:13.339784 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1068/2146] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:13.352497 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb83a4e-f4ce-40bd-8978-50349e57a2bd None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:13.353216 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb83a4e-f4ce-40bd-8978-50349e57a2bd None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:13.353902 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb83a4e-f4ce-40bd-8978-50349e57a2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:13.419711 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a19f9-20d2-4b2d-bf20-353ca360a3b0 service cinder] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:13.439429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a19f9-20d2-4b2d-bf20-353ca360a3b0 service cinder] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:13.485559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-eeb83a4e-f4ce-40bd-8978-50349e57a2bd None None] MFA Rules not processed for user `76c397a2e5a44190bfcc391e641b465a`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:13.488925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-eeb83a4e-f4ce-40bd-8978-50349e57a2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:13.591349 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6568897-9ddb-4807-a2ec-ad9079aa527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:13.591349 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6568897-9ddb-4807-a2ec-ad9079aa527e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:13.591349 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6568897-9ddb-4807-a2ec-ad9079aa527e admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:13.591349 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6568897-9ddb-4807-a2ec-ad9079aa527e admin admin] PATH_INFO: `/v3/users/d3edeaea235147aba9e754d51a7d3a4f` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:13.592099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6568897-9ddb-4807-a2ec-ad9079aa527e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3edeaea235147aba9e754d51a7d3a4f)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:13.592099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6568897-9ddb-4807-a2ec-ad9079aa527e admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:13.683661 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1079/2147] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:13.694657 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb83a4e-f4ce-40bd-8978-50349e57a2bd None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:13.788401 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb83a4e-f4ce-40bd-8978-50349e57a2bd None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:13.793362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40a7c3-f706-41f4-b750-d3041f2fad3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:13.794162 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40a7c3-f706-41f4-b750-d3041f2fad3d service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:13.794703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40a7c3-f706-41f4-b750-d3041f2fad3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:13.795123 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40a7c3-f706-41f4-b750-d3041f2fad3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:13.897806 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40a7c3-f706-41f4-b750-d3041f2fad3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:13.900659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40a7c3-f706-41f4-b750-d3041f2fad3d service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:13.917956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1080/2148] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:32:14.087917 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f6568897-9ddb-4807-a2ec-ad9079aa527e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3edeaea235147aba9e754d51a7d3a4f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:14.103172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f6568897-9ddb-4807-a2ec-ad9079aa527e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3edeaea235147aba9e754d51a7d3a4f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:14.349147 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f6568897-9ddb-4807-a2ec-ad9079aa527e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3edeaea235147aba9e754d51a7d3a4f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:14.349147 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f6568897-9ddb-4807-a2ec-ad9079aa527e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3edeaea235147aba9e754d51a7d3a4f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:14.368204 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-f6568897-9ddb-4807-a2ec-ad9079aa527e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3edeaea235147aba9e754d51a7d3a4f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:14.380004 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1069/2149] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:32:13 2022] DELETE /identity/v3/users/d3edeaea235147aba9e754d51a7d3a4f => generated 0 bytes in 964 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:32:14.386103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3c952-92ee-46f7-bcbb-b02d2edef1cf None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:14.386777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3c952-92ee-46f7-bcbb-b02d2edef1cf None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:14.388010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3c952-92ee-46f7-bcbb-b02d2edef1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:14.418374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-bea3c952-92ee-46f7-bcbb-b02d2edef1cf None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:14.419903 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-bea3c952-92ee-46f7-bcbb-b02d2edef1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:14.504217 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1081/2150] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:14.515332 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6568897-9ddb-4807-a2ec-ad9079aa527e admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:14.516788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f6568897-9ddb-4807-a2ec-ad9079aa527e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:14.595267 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6568897-9ddb-4807-a2ec-ad9079aa527e admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:14.599657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d59bb7-2353-4926-9d1e-51a5aa60c065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:14.600301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d59bb7-2353-4926-9d1e-51a5aa60c065 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:14.600559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d59bb7-2353-4926-9d1e-51a5aa60c065 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:14.600864 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d59bb7-2353-4926-9d1e-51a5aa60c065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:14.613419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d59bb7-2353-4926-9d1e-51a5aa60c065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:14.617620 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d59bb7-2353-4926-9d1e-51a5aa60c065 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:14.635433 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1070/2151] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:14.656676 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:15.422385 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:15.427813 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3c952-92ee-46f7-bcbb-b02d2edef1cf None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:15.427813 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-bea3c952-92ee-46f7-bcbb-b02d2edef1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:15.433253 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d59bb7-2353-4926-9d1e-51a5aa60c065 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:15.435769 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b5d59bb7-2353-4926-9d1e-51a5aa60c065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:15.441334 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3c952-92ee-46f7-bcbb-b02d2edef1cf None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:15.450739 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9b728-7358-4cbf-ab3c-ce89e2dd32d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:15.451841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9b728-7358-4cbf-ab3c-ce89e2dd32d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:15.452308 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9b728-7358-4cbf-ab3c-ce89e2dd32d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:15.452678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9b728-7358-4cbf-ab3c-ce89e2dd32d2 admin admin] PATH_INFO: `/v3/users/120a45619f0541ec894de20149a95882` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:15.454665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9b728-7358-4cbf-ab3c-ce89e2dd32d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=120a45619f0541ec894de20149a95882)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:15.458955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9b728-7358-4cbf-ab3c-ce89e2dd32d2 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:15.468092 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d59bb7-2353-4926-9d1e-51a5aa60c065 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:15.484990 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6847d8-0c9b-4187-9d45-b250261c595c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:15.487187 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6847d8-0c9b-4187-9d45-b250261c595c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:15.487748 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6847d8-0c9b-4187-9d45-b250261c595c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:15.488182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6847d8-0c9b-4187-9d45-b250261c595c admin admin] PATH_INFO: `/v3/projects/46a7ec946ad64676ab7b82e4e78fd134` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:15.490814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6847d8-0c9b-4187-9d45-b250261c595c admin admin] RBAC: Authorizing `identity:delete_project(project_id=46a7ec946ad64676ab7b82e4e78fd134)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:15.496405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6847d8-0c9b-4187-9d45-b250261c595c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:15.790260 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-aea9b728-7358-4cbf-ab3c-ce89e2dd32d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '120a45619f0541ec894de20149a95882'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:15.790916 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-2e6847d8-0c9b-4187-9d45-b250261c595c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46a7ec946ad64676ab7b82e4e78fd134', 'request_id': 'req-2e6847d8-0c9b-4187-9d45-b250261c595c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:15.916184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-2e6847d8-0c9b-4187-9d45-b250261c595c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46a7ec946ad64676ab7b82e4e78fd134', 'request_id': 'req-2e6847d8-0c9b-4187-9d45-b250261c595c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:15.924742 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-2e6847d8-0c9b-4187-9d45-b250261c595c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46a7ec946ad64676ab7b82e4e78fd134', 'request_id': 'req-2e6847d8-0c9b-4187-9d45-b250261c595c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:15.939600 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-2e6847d8-0c9b-4187-9d45-b250261c595c admin admin] The token cache is being invalidate because project 46a7ec946ad64676ab7b82e4e78fd134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:32:15.939907 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-2e6847d8-0c9b-4187-9d45-b250261c595c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:15.940542 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-2e6847d8-0c9b-4187-9d45-b250261c595c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:15.942063 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1071/2152] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:32:15 2022] DELETE /identity/v3/projects/46a7ec946ad64676ab7b82e4e78fd134 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:15.949686 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02a3c0-1d4c-4d3f-b0d1-10329a96d06b None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:15.950726 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02a3c0-1d4c-4d3f-b0d1-10329a96d06b None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:15.951236 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02a3c0-1d4c-4d3f-b0d1-10329a96d06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:15.985903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-3d02a3c0-1d4c-4d3f-b0d1-10329a96d06b None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:15.988095 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-3d02a3c0-1d4c-4d3f-b0d1-10329a96d06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:16.059055 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-aea9b728-7358-4cbf-ab3c-ce89e2dd32d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '120a45619f0541ec894de20149a95882'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:16.059885 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-aea9b728-7358-4cbf-ab3c-ce89e2dd32d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '120a45619f0541ec894de20149a95882'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:16.087187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-aea9b728-7358-4cbf-ab3c-ce89e2dd32d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '120a45619f0541ec894de20149a95882'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:16.088832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-aea9b728-7358-4cbf-ab3c-ce89e2dd32d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '120a45619f0541ec894de20149a95882'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:16.100552 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1072/2153] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:32:16.114397 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f684-e300-4b2e-a4e9-19822325ab18 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:16.115137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f684-e300-4b2e-a4e9-19822325ab18 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:16.115670 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f684-e300-4b2e-a4e9-19822325ab18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:16.129690 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1082/2154] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:32:15 2022] DELETE /identity/v3/users/120a45619f0541ec894de20149a95882 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:16.138300 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b6fb9-7e8c-42de-8b71-9d3ba9e3060a None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:16.138612 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b6fb9-7e8c-42de-8b71-9d3ba9e3060a None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:16.138904 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b6fb9-7e8c-42de-8b71-9d3ba9e3060a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:16.155739 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-6664f684-e300-4b2e-a4e9-19822325ab18 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:16.157081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6664f684-e300-4b2e-a4e9-19822325ab18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:16.164484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-b73b6fb9-7e8c-42de-8b71-9d3ba9e3060a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:16.166484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b73b6fb9-7e8c-42de-8b71-9d3ba9e3060a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:16.277755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1083/2155] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:32:16.279257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1073/2156] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:16.284735 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b6fb9-7e8c-42de-8b71-9d3ba9e3060a None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:16.290885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664f684-e300-4b2e-a4e9-19822325ab18 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:16.293368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6664f684-e300-4b2e-a4e9-19822325ab18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:16.298147 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b6fb9-7e8c-42de-8b71-9d3ba9e3060a None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:16.305232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fc307-34ed-4b06-b342-98436bc37a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:16.306048 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fc307-34ed-4b06-b342-98436bc37a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:16.306376 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fc307-34ed-4b06-b342-98436bc37a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:16.306688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fc307-34ed-4b06-b342-98436bc37a17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:16.315368 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fc307-34ed-4b06-b342-98436bc37a17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:32:16.315368 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fc307-34ed-4b06-b342-98436bc37a17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:16.315368 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fc307-34ed-4b06-b342-98436bc37a17 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:16.327065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1084/2157] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:32:16.334779 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fc307-34ed-4b06-b342-98436bc37a17 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:16.355048 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fc307-34ed-4b06-b342-98436bc37a17 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:16.362826 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccac73-e6df-4d48-950f-4644824b1cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:16.363471 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccac73-e6df-4d48-950f-4644824b1cab admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:16.363747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccac73-e6df-4d48-950f-4644824b1cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:16.364046 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccac73-e6df-4d48-950f-4644824b1cab admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:16.364693 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccac73-e6df-4d48-950f-4644824b1cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:16.366828 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccac73-e6df-4d48-950f-4644824b1cab admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:16.409776 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664f684-e300-4b2e-a4e9-19822325ab18 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:16.417060 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ff659-f137-4310-98fd-04ab5e4f7a88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:16.418159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ff659-f137-4310-98fd-04ab5e4f7a88 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:16.418695 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ff659-f137-4310-98fd-04ab5e4f7a88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:16.419173 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ff659-f137-4310-98fd-04ab5e4f7a88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:16.441509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ff659-f137-4310-98fd-04ab5e4f7a88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:16.441509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ff659-f137-4310-98fd-04ab5e4f7a88 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:16.457607 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1074/2158] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:16.544056 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1085/2159] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:32:16 2022] POST /identity/v3/projects => generated 397 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:16.548627 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ff659-f137-4310-98fd-04ab5e4f7a88 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:16.560258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ff659-f137-4310-98fd-04ab5e4f7a88 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:16.576737 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:16.674952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29c17f-663e-4e47-8ab9-7391f27d35ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:16.675743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29c17f-663e-4e47-8ab9-7391f27d35ec admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:16.676184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29c17f-663e-4e47-8ab9-7391f27d35ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:16.676525 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29c17f-663e-4e47-8ab9-7391f27d35ec admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:16.677276 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29c17f-663e-4e47-8ab9-7391f27d35ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:16.679550 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29c17f-663e-4e47-8ab9-7391f27d35ec admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:16.785139 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1075/2160] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:32:16 2022] POST /identity/v3/users => generated 299 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:32:16.791711 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccac73-e6df-4d48-950f-4644824b1cab admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:16.826965 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccac73-e6df-4d48-950f-4644824b1cab admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:16.833475 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b7980-3b4a-4729-b161-ce8efe0e14a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:16.834773 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b7980-3b4a-4729-b161-ce8efe0e14a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:16.835365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b7980-3b4a-4729-b161-ce8efe0e14a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:16.836477 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b7980-3b4a-4729-b161-ce8efe0e14a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:16.837979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b7980-3b4a-4729-b161-ce8efe0e14a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:16.840325 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b7980-3b4a-4729-b161-ce8efe0e14a0 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:16.874622 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1086/2161] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:16.881401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29c17f-663e-4e47-8ab9-7391f27d35ec admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:16.901240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29c17f-663e-4e47-8ab9-7391f27d35ec admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:16.911774 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072df5d-7149-41f7-bbdf-113c4d558357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:16.914913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072df5d-7149-41f7-bbdf-113c4d558357 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:16.915793 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072df5d-7149-41f7-bbdf-113c4d558357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:16.916565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072df5d-7149-41f7-bbdf-113c4d558357 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:16.918339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072df5d-7149-41f7-bbdf-113c4d558357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:16.920600 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072df5d-7149-41f7-bbdf-113c4d558357 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:16.945958 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1076/2162] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:16.950436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b7980-3b4a-4729-b161-ce8efe0e14a0 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:16.984406 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b7980-3b4a-4729-b161-ce8efe0e14a0 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:16.992915 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead47bda-36e5-417f-ba04-260b181c831f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:16.993819 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead47bda-36e5-417f-ba04-260b181c831f admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:16.994279 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead47bda-36e5-417f-ba04-260b181c831f admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:16.994713 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead47bda-36e5-417f-ba04-260b181c831f admin admin] PATH_INFO: `/v3/projects/4a061248563b46a7881e6018c6348959/users/b20a4198beb243669be6fef30759b8cc/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:17.057561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead47bda-36e5-417f-ba04-260b181c831f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a061248563b46a7881e6018c6348959, user_id=b20a4198beb243669be6fef30759b8cc, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:17.075489 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead47bda-36e5-417f-ba04-260b181c831f admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:17.143852 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072df5d-7149-41f7-bbdf-113c4d558357 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:17.152143 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-9072df5d-7149-41f7-bbdf-113c4d558357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:17.211515 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1087/2163] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:32:16 2022] PUT /identity/v3/projects/4a061248563b46a7881e6018c6348959/users/b20a4198beb243669be6fef30759b8cc/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:17.213489 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:17.216489 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead47bda-36e5-417f-ba04-260b181c831f admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:17.218540 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ead47bda-36e5-417f-ba04-260b181c831f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:17.336668 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072df5d-7149-41f7-bbdf-113c4d558357 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:17.381226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead47bda-36e5-417f-ba04-260b181c831f admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:17.391355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fd354-073c-4adc-a5f1-6019791a486e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:17.392805 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fd354-073c-4adc-a5f1-6019791a486e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:17.393678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fd354-073c-4adc-a5f1-6019791a486e admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:17.394246 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fd354-073c-4adc-a5f1-6019791a486e admin admin] PATH_INFO: `/v3/projects/ae427eb3d1104f8fbbeb393c63750389` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:17.396177 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fd354-073c-4adc-a5f1-6019791a486e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae427eb3d1104f8fbbeb393c63750389)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:17.398739 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fd354-073c-4adc-a5f1-6019791a486e admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:17.441857 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa51f87-c34e-4f33-95a1-83a127360d80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:17.444936 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa51f87-c34e-4f33-95a1-83a127360d80 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:17.445684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa51f87-c34e-4f33-95a1-83a127360d80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:17.446289 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa51f87-c34e-4f33-95a1-83a127360d80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:17.450552 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-caa51f87-c34e-4f33-95a1-83a127360d80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:17.534375 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa51f87-c34e-4f33-95a1-83a127360d80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:17.540809 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa51f87-c34e-4f33-95a1-83a127360d80 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:17.556142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1077/2164] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:17.558661 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0f8bb-715e-4411-a395-f94a0cdcc801 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:17.559215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0f8bb-715e-4411-a395-f94a0cdcc801 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:17.559807 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0f8bb-715e-4411-a395-f94a0cdcc801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:17.596804 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-4cd0f8bb-715e-4411-a395-f94a0cdcc801 None None] MFA Rules not processed for user `b20a4198beb243669be6fef30759b8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:17.598009 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4cd0f8bb-715e-4411-a395-f94a0cdcc801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:17.640124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e33fd354-073c-4adc-a5f1-6019791a486e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae427eb3d1104f8fbbeb393c63750389', 'request_id': 'req-e33fd354-073c-4adc-a5f1-6019791a486e'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:17.699489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1078/2165] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:17 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:17.734137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e33fd354-073c-4adc-a5f1-6019791a486e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae427eb3d1104f8fbbeb393c63750389', 'request_id': 'req-e33fd354-073c-4adc-a5f1-6019791a486e'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:17.744891 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e33fd354-073c-4adc-a5f1-6019791a486e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae427eb3d1104f8fbbeb393c63750389', 'request_id': 'req-e33fd354-073c-4adc-a5f1-6019791a486e'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:17.759875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e33fd354-073c-4adc-a5f1-6019791a486e admin admin] The token cache is being invalidate because project ae427eb3d1104f8fbbeb393c63750389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:32:17.760261 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e33fd354-073c-4adc-a5f1-6019791a486e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:17.761116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e33fd354-073c-4adc-a5f1-6019791a486e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:17.762961 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1088/2166] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:32:17 2022] DELETE /identity/v3/projects/ae427eb3d1104f8fbbeb393c63750389 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:17.767598 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0f8bb-715e-4411-a395-f94a0cdcc801 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:17.780417 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0f8bb-715e-4411-a395-f94a0cdcc801 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:17.847194 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:17.869900 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb7f6c-8a9c-4635-a001-69c625c7eb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:17.871030 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb7f6c-8a9c-4635-a001-69c625c7eb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:17.872461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb7f6c-8a9c-4635-a001-69c625c7eb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:17.872461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb7f6c-8a9c-4635-a001-69c625c7eb77 admin admin] PATH_INFO: `/v3/users/2eed5f74a7b0474e930ace3d5eaaa7bc` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:17.874210 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb7f6c-8a9c-4635-a001-69c625c7eb77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eed5f74a7b0474e930ace3d5eaaa7bc)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:17.878120 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb7f6c-8a9c-4635-a001-69c625c7eb77 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:18.111082 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ecfb7f6c-8a9c-4635-a001-69c625c7eb77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eed5f74a7b0474e930ace3d5eaaa7bc'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:18.136866 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ecfb7f6c-8a9c-4635-a001-69c625c7eb77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eed5f74a7b0474e930ace3d5eaaa7bc'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:18.235968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ecfb7f6c-8a9c-4635-a001-69c625c7eb77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eed5f74a7b0474e930ace3d5eaaa7bc'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:18.236674 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ecfb7f6c-8a9c-4635-a001-69c625c7eb77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eed5f74a7b0474e930ace3d5eaaa7bc'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:18.248502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ecfb7f6c-8a9c-4635-a001-69c625c7eb77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eed5f74a7b0474e930ace3d5eaaa7bc'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:18.258228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1079/2167] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:32:17 2022] DELETE /identity/v3/users/2eed5f74a7b0474e930ace3d5eaaa7bc => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:32:18.358556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:18.676399 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:18.869433 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fd354-073c-4adc-a5f1-6019791a486e admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:18.871512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-e33fd354-073c-4adc-a5f1-6019791a486e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:18.958156 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fd354-073c-4adc-a5f1-6019791a486e admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:19.026548 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cb7fd-44f1-4922-9e1b-b259e9f8d908 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:19.027251 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cb7fd-44f1-4922-9e1b-b259e9f8d908 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:19.027689 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cb7fd-44f1-4922-9e1b-b259e9f8d908 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:19.028088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cb7fd-44f1-4922-9e1b-b259e9f8d908 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:19.030766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-708cb7fd-44f1-4922-9e1b-b259e9f8d908 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:19.094909 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb7f6c-8a9c-4635-a001-69c625c7eb77 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:19.096671 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ecfb7f6c-8a9c-4635-a001-69c625c7eb77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:19.148643 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cb7fd-44f1-4922-9e1b-b259e9f8d908 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:19.158203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cb7fd-44f1-4922-9e1b-b259e9f8d908 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:19.183282 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1089/2168] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:18 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:19.268536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb7f6c-8a9c-4635-a001-69c625c7eb77 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:19.275356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225fd37-205e-4a0a-9cf8-58162fb45844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:19.276206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225fd37-205e-4a0a-9cf8-58162fb45844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:19.276559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225fd37-205e-4a0a-9cf8-58162fb45844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:19.276838 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225fd37-205e-4a0a-9cf8-58162fb45844 admin admin] PATH_INFO: `/v3/projects/d284a5df51554d3a8592619894772fe1` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:19.278766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225fd37-205e-4a0a-9cf8-58162fb45844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d284a5df51554d3a8592619894772fe1)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:19.281060 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225fd37-205e-4a0a-9cf8-58162fb45844 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:19.462951 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-8225fd37-205e-4a0a-9cf8-58162fb45844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd284a5df51554d3a8592619894772fe1', 'request_id': 'req-8225fd37-205e-4a0a-9cf8-58162fb45844'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:19.578733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-8225fd37-205e-4a0a-9cf8-58162fb45844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd284a5df51554d3a8592619894772fe1', 'request_id': 'req-8225fd37-205e-4a0a-9cf8-58162fb45844'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:19.591296 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-8225fd37-205e-4a0a-9cf8-58162fb45844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd284a5df51554d3a8592619894772fe1', 'request_id': 'req-8225fd37-205e-4a0a-9cf8-58162fb45844'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:19.614577 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-8225fd37-205e-4a0a-9cf8-58162fb45844 admin admin] The token cache is being invalidate because project d284a5df51554d3a8592619894772fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:32:19.615667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-8225fd37-205e-4a0a-9cf8-58162fb45844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:19.616910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-8225fd37-205e-4a0a-9cf8-58162fb45844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:19.619481 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1080/2169] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:32:19 2022] DELETE /identity/v3/projects/d284a5df51554d3a8592619894772fe1 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:19.627804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d278dfe-b64e-48ea-a1d6-32b39e27224b None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:19.628386 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d278dfe-b64e-48ea-a1d6-32b39e27224b None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:19.629594 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d278dfe-b64e-48ea-a1d6-32b39e27224b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:19.661076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-0d278dfe-b64e-48ea-a1d6-32b39e27224b None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:19.663473 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-0d278dfe-b64e-48ea-a1d6-32b39e27224b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:19.759440 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1090/2170] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:19.772455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e5896-fd81-4339-9260-97f831161585 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:19.772896 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e5896-fd81-4339-9260-97f831161585 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:19.773249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e5896-fd81-4339-9260-97f831161585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:19.795440 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-871e5896-fd81-4339-9260-97f831161585 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:19.796896 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-871e5896-fd81-4339-9260-97f831161585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:19.820682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1081/2171] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:19.830696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d278dfe-b64e-48ea-a1d6-32b39e27224b None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:19.844017 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d278dfe-b64e-48ea-a1d6-32b39e27224b None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:19.849744 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639a4e4-8c58-4f01-83e1-1852d13f58d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:19.850838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639a4e4-8c58-4f01-83e1-1852d13f58d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:19.851139 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639a4e4-8c58-4f01-83e1-1852d13f58d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:19.851440 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639a4e4-8c58-4f01-83e1-1852d13f58d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:19.852113 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639a4e4-8c58-4f01-83e1-1852d13f58d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:32:19.852422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639a4e4-8c58-4f01-83e1-1852d13f58d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:19.854300 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639a4e4-8c58-4f01-83e1-1852d13f58d3 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:19.876038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1091/2172] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:32:19.883571 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e5896-fd81-4339-9260-97f831161585 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:19.905866 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e5896-fd81-4339-9260-97f831161585 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:19.911533 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44555241-7c9b-4746-9429-20c083fef904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:19.912207 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44555241-7c9b-4746-9429-20c083fef904 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:19.912487 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44555241-7c9b-4746-9429-20c083fef904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:19.912818 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44555241-7c9b-4746-9429-20c083fef904 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:19.913597 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44555241-7c9b-4746-9429-20c083fef904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:19.915536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44555241-7c9b-4746-9429-20c083fef904 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:20.046638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1082/2173] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:32:19 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:20.054623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639a4e4-8c58-4f01-83e1-1852d13f58d3 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:20.068676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639a4e4-8c58-4f01-83e1-1852d13f58d3 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:20.152481 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fe495-8fde-449a-b33c-9512cc826468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:20.153344 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fe495-8fde-449a-b33c-9512cc826468 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:20.153751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fe495-8fde-449a-b33c-9512cc826468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:20.154129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fe495-8fde-449a-b33c-9512cc826468 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:20.154982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5fe495-8fde-449a-b33c-9512cc826468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:20.157190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5fe495-8fde-449a-b33c-9512cc826468 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:20.183368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44555241-7c9b-4746-9429-20c083fef904 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:20.189542 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-44555241-7c9b-4746-9429-20c083fef904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:20.263302 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1092/2174] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:32:20 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:32:20.267640 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fe495-8fde-449a-b33c-9512cc826468 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:20.277537 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44555241-7c9b-4746-9429-20c083fef904 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:20.279756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fe495-8fde-449a-b33c-9512cc826468 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:20.285989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d601c-2ba6-4b18-8857-c40ce3876aae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:20.286965 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d601c-2ba6-4b18-8857-c40ce3876aae service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:20.287296 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d601c-2ba6-4b18-8857-c40ce3876aae service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:20.287852 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d601c-2ba6-4b18-8857-c40ce3876aae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:20.289007 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee06b5-5fae-453a-91f7-1e11a2f93338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:20.289737 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee06b5-5fae-453a-91f7-1e11a2f93338 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:20.290040 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee06b5-5fae-453a-91f7-1e11a2f93338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:20.290310 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee06b5-5fae-453a-91f7-1e11a2f93338 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:20.290940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a49d601c-2ba6-4b18-8857-c40ce3876aae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:20.291470 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee06b5-5fae-453a-91f7-1e11a2f93338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:20.293954 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee06b5-5fae-453a-91f7-1e11a2f93338 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:20.307043 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1093/2175] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:20.311369 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee06b5-5fae-453a-91f7-1e11a2f93338 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:20.325442 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee06b5-5fae-453a-91f7-1e11a2f93338 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:20.332098 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2ac18-db8f-452b-92a0-2fc6592cc2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:20.332881 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2ac18-db8f-452b-92a0-2fc6592cc2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:20.333236 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2ac18-db8f-452b-92a0-2fc6592cc2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:20.333568 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2ac18-db8f-452b-92a0-2fc6592cc2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:20.334366 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2ac18-db8f-452b-92a0-2fc6592cc2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:20.336488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2ac18-db8f-452b-92a0-2fc6592cc2a3 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:20.349099 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1094/2176] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:32:20.355401 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2ac18-db8f-452b-92a0-2fc6592cc2a3 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:20.371382 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2ac18-db8f-452b-92a0-2fc6592cc2a3 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:20.379687 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834087d-2164-49ad-8a72-55fb1762af8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:20.380762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834087d-2164-49ad-8a72-55fb1762af8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:20.381265 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834087d-2164-49ad-8a72-55fb1762af8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:20.381688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834087d-2164-49ad-8a72-55fb1762af8a admin admin] PATH_INFO: `/v3/projects/24a70c049c054dc0968c7511546a145e/users/34fcc73e470e4b4aabec3539c84e7739/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:20.393205 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:20.408643 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834087d-2164-49ad-8a72-55fb1762af8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a70c049c054dc0968c7511546a145e, user_id=34fcc73e470e4b4aabec3539c84e7739, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:20.410932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d601c-2ba6-4b18-8857-c40ce3876aae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:20.412055 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834087d-2164-49ad-8a72-55fb1762af8a admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:20.412451 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d601c-2ba6-4b18-8857-c40ce3876aae service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:20.425002 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1083/2177] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:32:20.529198 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1095/2178] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:32:20 2022] PUT /identity/v3/projects/24a70c049c054dc0968c7511546a145e/users/34fcc73e470e4b4aabec3539c84e7739/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:32:20.547109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3ab7e-9bc5-441e-96a8-71ad36f067e8 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:20.547513 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3ab7e-9bc5-441e-96a8-71ad36f067e8 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:20.548108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3ab7e-9bc5-441e-96a8-71ad36f067e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:20.596107 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-a9c3ab7e-9bc5-441e-96a8-71ad36f067e8 None None] MFA Rules not processed for user `34fcc73e470e4b4aabec3539c84e7739`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:20.597361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a9c3ab7e-9bc5-441e-96a8-71ad36f067e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:20.712672 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1084/2179] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:20.719533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834087d-2164-49ad-8a72-55fb1762af8a admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:20.857512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834087d-2164-49ad-8a72-55fb1762af8a admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:20.864039 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e97531-f78f-4d12-bd59-7e8ba7a4afcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:20.864039 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e97531-f78f-4d12-bd59-7e8ba7a4afcd admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:20.864408 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e97531-f78f-4d12-bd59-7e8ba7a4afcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:20.864664 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e97531-f78f-4d12-bd59-7e8ba7a4afcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:20.865430 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e97531-f78f-4d12-bd59-7e8ba7a4afcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:20.867649 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e97531-f78f-4d12-bd59-7e8ba7a4afcd admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:20.923749 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:21.188315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3ab7e-9bc5-441e-96a8-71ad36f067e8 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:21.204473 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1096/2180] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:32:20 2022] POST /identity/v3/projects => generated 375 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:21.210530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3ab7e-9bc5-441e-96a8-71ad36f067e8 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:21.341157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3acd58-c23b-42b5-8ee0-c78bafd7690e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:21.342368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3acd58-c23b-42b5-8ee0-c78bafd7690e admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:21.343159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3acd58-c23b-42b5-8ee0-c78bafd7690e admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:21.343810 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3acd58-c23b-42b5-8ee0-c78bafd7690e admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:21.345098 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3acd58-c23b-42b5-8ee0-c78bafd7690e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:21.352272 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3acd58-c23b-42b5-8ee0-c78bafd7690e admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:21.492266 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1085/2181] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:32:21 2022] POST /identity/v3/users => generated 294 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:21.497304 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e97531-f78f-4d12-bd59-7e8ba7a4afcd admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:21.513932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e97531-f78f-4d12-bd59-7e8ba7a4afcd admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:21.518961 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e328ef1-eaec-4e92-830b-df39ce66f960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:21.519641 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e328ef1-eaec-4e92-830b-df39ce66f960 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:21.519963 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e328ef1-eaec-4e92-830b-df39ce66f960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:21.520233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e328ef1-eaec-4e92-830b-df39ce66f960 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:21.520905 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e328ef1-eaec-4e92-830b-df39ce66f960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:21.522565 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e328ef1-eaec-4e92-830b-df39ce66f960 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:21.535843 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1097/2182] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:21.540458 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3acd58-c23b-42b5-8ee0-c78bafd7690e admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:21.551665 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3acd58-c23b-42b5-8ee0-c78bafd7690e admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:21.556917 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5335c7f-2264-4414-99d9-22486813b349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:21.557610 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5335c7f-2264-4414-99d9-22486813b349 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:21.557911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5335c7f-2264-4414-99d9-22486813b349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:21.558181 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5335c7f-2264-4414-99d9-22486813b349 admin admin] PATH_INFO: `/v3/projects/4f36267a21e348d1a33a140401e8f1ee/users/90a340386a5247ea9b691648f1053709/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:21.576066 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5335c7f-2264-4414-99d9-22486813b349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f36267a21e348d1a33a140401e8f1ee, user_id=90a340386a5247ea9b691648f1053709, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:21.579191 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5335c7f-2264-4414-99d9-22486813b349 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:21.665978 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1086/2183] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:32:21 2022] PUT /identity/v3/projects/4f36267a21e348d1a33a140401e8f1ee/users/90a340386a5247ea9b691648f1053709/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:32:21.671542 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e328ef1-eaec-4e92-830b-df39ce66f960 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:21.683864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e328ef1-eaec-4e92-830b-df39ce66f960 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:21.779353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b1bf7-e70f-42f8-a1ee-40b4209e68ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:21.780964 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b1bf7-e70f-42f8-a1ee-40b4209e68ac admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:21.781111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b1bf7-e70f-42f8-a1ee-40b4209e68ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:21.781469 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b1bf7-e70f-42f8-a1ee-40b4209e68ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:21.782756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b1bf7-e70f-42f8-a1ee-40b4209e68ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:21.786020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b1bf7-e70f-42f8-a1ee-40b4209e68ac admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:21.806777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1098/2184] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:21.812556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5335c7f-2264-4414-99d9-22486813b349 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:21.826903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5335c7f-2264-4414-99d9-22486813b349 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:21.834406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac118c46-1641-42f8-b461-7262d35612fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:21.835632 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac118c46-1641-42f8-b461-7262d35612fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:21.836164 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac118c46-1641-42f8-b461-7262d35612fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:21.836620 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac118c46-1641-42f8-b461-7262d35612fe admin admin] PATH_INFO: `/v3/projects/4f36267a21e348d1a33a140401e8f1ee/users/90a340386a5247ea9b691648f1053709/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:21.839327 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac118c46-1641-42f8-b461-7262d35612fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f36267a21e348d1a33a140401e8f1ee, user_id=90a340386a5247ea9b691648f1053709, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:21.843073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac118c46-1641-42f8-b461-7262d35612fe admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:21.863730 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1087/2185] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:32:21 2022] PUT /identity/v3/projects/4f36267a21e348d1a33a140401e8f1ee/users/90a340386a5247ea9b691648f1053709/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:21.883606 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ecd5e-2e0a-4abb-8508-b303bb0f8a70 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:21.884180 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ecd5e-2e0a-4abb-8508-b303bb0f8a70 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:21.884529 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ecd5e-2e0a-4abb-8508-b303bb0f8a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:21.931613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-d52ecd5e-2e0a-4abb-8508-b303bb0f8a70 None None] MFA Rules not processed for user `90a340386a5247ea9b691648f1053709`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:21.932969 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d52ecd5e-2e0a-4abb-8508-b303bb0f8a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:22.042705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1099/2186] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:22.056646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac118c46-1641-42f8-b461-7262d35612fe admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:22.162876 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac118c46-1641-42f8-b461-7262d35612fe admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:22.167189 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aab6aa-24cc-4803-8429-3c4aaaaaf523 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:22.167827 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aab6aa-24cc-4803-8429-3c4aaaaaf523 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:22.168115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aab6aa-24cc-4803-8429-3c4aaaaaf523 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:22.168385 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aab6aa-24cc-4803-8429-3c4aaaaaf523 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:22.260257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aab6aa-24cc-4803-8429-3c4aaaaaf523 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:22.261775 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aab6aa-24cc-4803-8429-3c4aaaaaf523 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:22.272621 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1088/2187] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:22.395366 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:22.575800 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:23.579567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:23.607406 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ecd5e-2e0a-4abb-8508-b303bb0f8a70 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:23.609615 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d52ecd5e-2e0a-4abb-8508-b303bb0f8a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:23.643323 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ecd5e-2e0a-4abb-8508-b303bb0f8a70 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:23.653932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41393e-96f5-4426-abe1-b6a7928c4037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:23.654957 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41393e-96f5-4426-abe1-b6a7928c4037 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:23.655370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41393e-96f5-4426-abe1-b6a7928c4037 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:23.655745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41393e-96f5-4426-abe1-b6a7928c4037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:23.658401 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ea41393e-96f5-4426-abe1-b6a7928c4037 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:23.779927 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41393e-96f5-4426-abe1-b6a7928c4037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:23.782471 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41393e-96f5-4426-abe1-b6a7928c4037 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:23.798807 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1100/2188] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:23.889144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:25.140122 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:25.347611 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:25.563258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:26.518945 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aab6aa-24cc-4803-8429-3c4aaaaaf523 service cinder] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:26.542495 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aab6aa-24cc-4803-8429-3c4aaaaaf523 service cinder] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:26.549724 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3f73f-0b14-44db-9a98-9601701000e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:26.550367 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3f73f-0b14-44db-9a98-9601701000e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:26.550676 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3f73f-0b14-44db-9a98-9601701000e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:26.550957 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3f73f-0b14-44db-9a98-9601701000e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:26.560494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:26.565300 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3f73f-0b14-44db-9a98-9601701000e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:26.567041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3f73f-0b14-44db-9a98-9601701000e7 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:26.589908 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1089/2189] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:26.634534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:27.768639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:27.795384 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41393e-96f5-4426-abe1-b6a7928c4037 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:27.797160 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ea41393e-96f5-4426-abe1-b6a7928c4037 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:27.895346 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41393e-96f5-4426-abe1-b6a7928c4037 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:27.901160 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85402a0-460e-4385-9d02-0fbae345d8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:27.902011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85402a0-460e-4385-9d02-0fbae345d8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:27.902490 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85402a0-460e-4385-9d02-0fbae345d8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:27.903066 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85402a0-460e-4385-9d02-0fbae345d8e9 admin admin] PATH_INFO: `/v3/users/949150e0c45f4e858a73c31a015566b7` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:27.906131 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85402a0-460e-4385-9d02-0fbae345d8e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=949150e0c45f4e858a73c31a015566b7)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:27.908340 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85402a0-460e-4385-9d02-0fbae345d8e9 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:28.274198 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:28.294303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f85402a0-460e-4385-9d02-0fbae345d8e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '949150e0c45f4e858a73c31a015566b7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:28.379771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f85402a0-460e-4385-9d02-0fbae345d8e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '949150e0c45f4e858a73c31a015566b7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:28.383101 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f85402a0-460e-4385-9d02-0fbae345d8e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '949150e0c45f4e858a73c31a015566b7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:28.401514 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f85402a0-460e-4385-9d02-0fbae345d8e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '949150e0c45f4e858a73c31a015566b7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:28.403687 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f85402a0-460e-4385-9d02-0fbae345d8e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '949150e0c45f4e858a73c31a015566b7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:28.440070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1101/2190] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:32:27 2022] DELETE /identity/v3/users/949150e0c45f4e858a73c31a015566b7 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:28.447039 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71452684-1092-42f0-8c31-6a83cb39bfb7 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:28.447958 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71452684-1092-42f0-8c31-6a83cb39bfb7 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:28.448903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71452684-1092-42f0-8c31-6a83cb39bfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:28.504916 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-71452684-1092-42f0-8c31-6a83cb39bfb7 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:28.507870 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-71452684-1092-42f0-8c31-6a83cb39bfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:28.654204 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1090/2191] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:28.673281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85402a0-460e-4385-9d02-0fbae345d8e9 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:28.676562 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f85402a0-460e-4385-9d02-0fbae345d8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:28.800029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85402a0-460e-4385-9d02-0fbae345d8e9 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:28.805049 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b628a43-5696-4d31-a2df-27c8f14061f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:28.805623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b628a43-5696-4d31-a2df-27c8f14061f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:28.805906 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b628a43-5696-4d31-a2df-27c8f14061f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:28.806265 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b628a43-5696-4d31-a2df-27c8f14061f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:28.819101 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b628a43-5696-4d31-a2df-27c8f14061f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:28.820825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b628a43-5696-4d31-a2df-27c8f14061f1 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:28.833899 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1102/2192] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:29.567365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71452684-1092-42f0-8c31-6a83cb39bfb7 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:29.567365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-71452684-1092-42f0-8c31-6a83cb39bfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:29.599684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71452684-1092-42f0-8c31-6a83cb39bfb7 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:29.622001 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebaad4-8b89-4a65-99f9-e9415ec9e459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:29.629278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebaad4-8b89-4a65-99f9-e9415ec9e459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:29.629928 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebaad4-8b89-4a65-99f9-e9415ec9e459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:29.630603 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebaad4-8b89-4a65-99f9-e9415ec9e459 admin admin] PATH_INFO: `/v3/projects/c89cfcb5df874931b60aefec254d8426` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:29.635870 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebaad4-8b89-4a65-99f9-e9415ec9e459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89cfcb5df874931b60aefec254d8426)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:29.641577 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebaad4-8b89-4a65-99f9-e9415ec9e459 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:29.721203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b628a43-5696-4d31-a2df-27c8f14061f1 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:29.724388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-6b628a43-5696-4d31-a2df-27c8f14061f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:29.743387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b628a43-5696-4d31-a2df-27c8f14061f1 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:29.756549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8dbbd-6613-4487-a33d-d7ee6e21689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:29.758155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8dbbd-6613-4487-a33d-d7ee6e21689c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:29.758817 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8dbbd-6613-4487-a33d-d7ee6e21689c admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:29.760618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8dbbd-6613-4487-a33d-d7ee6e21689c admin admin] PATH_INFO: `/v3/users/b20a4198beb243669be6fef30759b8cc` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:29.764492 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8dbbd-6613-4487-a33d-d7ee6e21689c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20a4198beb243669be6fef30759b8cc)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:29.768169 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8dbbd-6613-4487-a33d-d7ee6e21689c admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:29.820020 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5aebaad4-8b89-4a65-99f9-e9415ec9e459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89cfcb5df874931b60aefec254d8426', 'request_id': 'req-5aebaad4-8b89-4a65-99f9-e9415ec9e459'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:29.978903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5aebaad4-8b89-4a65-99f9-e9415ec9e459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89cfcb5df874931b60aefec254d8426', 'request_id': 'req-5aebaad4-8b89-4a65-99f9-e9415ec9e459'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:29.990919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5aebaad4-8b89-4a65-99f9-e9415ec9e459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89cfcb5df874931b60aefec254d8426', 'request_id': 'req-5aebaad4-8b89-4a65-99f9-e9415ec9e459'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:30.014873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5aebaad4-8b89-4a65-99f9-e9415ec9e459 admin admin] The token cache is being invalidate because project c89cfcb5df874931b60aefec254d8426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:32:30.015374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5aebaad4-8b89-4a65-99f9-e9415ec9e459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:30.017107 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5aebaad4-8b89-4a65-99f9-e9415ec9e459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:30.019932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1091/2193] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:32:29 2022] DELETE /identity/v3/projects/c89cfcb5df874931b60aefec254d8426 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:32:30.026065 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebaad4-8b89-4a65-99f9-e9415ec9e459 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:30.029333 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-5aebaad4-8b89-4a65-99f9-e9415ec9e459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:30.112884 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-54f8dbbd-6613-4487-a33d-d7ee6e21689c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20a4198beb243669be6fef30759b8cc'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:30.154656 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebaad4-8b89-4a65-99f9-e9415ec9e459 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:30.163265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32974386-853f-4207-8a06-6caa137f588a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:30.167729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32974386-853f-4207-8a06-6caa137f588a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:30.167729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32974386-853f-4207-8a06-6caa137f588a admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:30.167729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32974386-853f-4207-8a06-6caa137f588a admin admin] PATH_INFO: `/v3/users/f33729d4ea5348218f43ff0a640504cc` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:30.167729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32974386-853f-4207-8a06-6caa137f588a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f33729d4ea5348218f43ff0a640504cc)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:30.171125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32974386-853f-4207-8a06-6caa137f588a admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:30.214537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-54f8dbbd-6613-4487-a33d-d7ee6e21689c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20a4198beb243669be6fef30759b8cc'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:30.216029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-54f8dbbd-6613-4487-a33d-d7ee6e21689c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20a4198beb243669be6fef30759b8cc'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:30.265182 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-54f8dbbd-6613-4487-a33d-d7ee6e21689c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20a4198beb243669be6fef30759b8cc'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:30.266536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-54f8dbbd-6613-4487-a33d-d7ee6e21689c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20a4198beb243669be6fef30759b8cc'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:30.307704 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1103/2194] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:32:29 2022] DELETE /identity/v3/users/b20a4198beb243669be6fef30759b8cc => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:32:30.311036 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c5980-b211-4a60-9357-584fcbe3d9f3 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:30.311485 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c5980-b211-4a60-9357-584fcbe3d9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:30.311917 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c5980-b211-4a60-9357-584fcbe3d9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:30.345555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-060c5980-b211-4a60-9357-584fcbe3d9f3 None None] MFA Rules not processed for user `67b89827871f45738162611b31a23509`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:30.348386 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-060c5980-b211-4a60-9357-584fcbe3d9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:30.488792 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1104/2195] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:30.490321 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0622efa-f7e0-403a-9548-b6a33fc396bd None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:30.490857 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0622efa-f7e0-403a-9548-b6a33fc396bd None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:30.491268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0622efa-f7e0-403a-9548-b6a33fc396bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:30.513661 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-32974386-853f-4207-8a06-6caa137f588a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f33729d4ea5348218f43ff0a640504cc'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:30.549645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-d0622efa-f7e0-403a-9548-b6a33fc396bd None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:30.551733 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d0622efa-f7e0-403a-9548-b6a33fc396bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:30.569794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-32974386-853f-4207-8a06-6caa137f588a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f33729d4ea5348218f43ff0a640504cc'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:30.625876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:30.664356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-32974386-853f-4207-8a06-6caa137f588a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f33729d4ea5348218f43ff0a640504cc'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:30.665330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-32974386-853f-4207-8a06-6caa137f588a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f33729d4ea5348218f43ff0a640504cc'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:30.679297 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-32974386-853f-4207-8a06-6caa137f588a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f33729d4ea5348218f43ff0a640504cc'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:30.692128 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1092/2196] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:32:30 2022] DELETE /identity/v3/users/f33729d4ea5348218f43ff0a640504cc => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:32:30.725080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1105/2197] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:30.748637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32974386-853f-4207-8a06-6caa137f588a admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:30.753302 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-32974386-853f-4207-8a06-6caa137f588a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:30.918137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32974386-853f-4207-8a06-6caa137f588a admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:30.924625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec0490-b213-4620-a747-0a41ddbc4dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:30.925466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec0490-b213-4620-a747-0a41ddbc4dba service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:30.925916 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec0490-b213-4620-a747-0a41ddbc4dba service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:30.926252 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec0490-b213-4620-a747-0a41ddbc4dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:31.155494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec0490-b213-4620-a747-0a41ddbc4dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:31.157364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec0490-b213-4620-a747-0a41ddbc4dba service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:31.187441 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1093/2198] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:31.448081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:32.005800 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0622efa-f7e0-403a-9548-b6a33fc396bd None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:32.008254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d0622efa-f7e0-403a-9548-b6a33fc396bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:32.038080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0622efa-f7e0-403a-9548-b6a33fc396bd None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:32.049266 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d7794-f071-4578-844c-3e0f7cbfeeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:32.049869 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d7794-f071-4578-844c-3e0f7cbfeeca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:32.050337 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d7794-f071-4578-844c-3e0f7cbfeeca admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:32.050859 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d7794-f071-4578-844c-3e0f7cbfeeca admin admin] PATH_INFO: `/v3/projects/9d1a5a8758c640baa5e9453762129765` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:32.053848 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d7794-f071-4578-844c-3e0f7cbfeeca admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d1a5a8758c640baa5e9453762129765)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:32.058688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d7794-f071-4578-844c-3e0f7cbfeeca admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:32.446118 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec0490-b213-4620-a747-0a41ddbc4dba service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:32.448386 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-71ec0490-b213-4620-a747-0a41ddbc4dba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:32.510455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec0490-b213-4620-a747-0a41ddbc4dba service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:32.514508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-644d7794-f071-4578-844c-3e0f7cbfeeca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d1a5a8758c640baa5e9453762129765', 'request_id': 'req-644d7794-f071-4578-844c-3e0f7cbfeeca'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:32.653503 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576579f2-8f63-4997-bec5-04dd0bf2b576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:32.654734 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576579f2-8f63-4997-bec5-04dd0bf2b576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:32.655385 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576579f2-8f63-4997-bec5-04dd0bf2b576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:32.655790 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576579f2-8f63-4997-bec5-04dd0bf2b576 admin admin] PATH_INFO: `/v3/projects/4a061248563b46a7881e6018c6348959` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:32.658295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576579f2-8f63-4997-bec5-04dd0bf2b576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a061248563b46a7881e6018c6348959)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:32.662341 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576579f2-8f63-4997-bec5-04dd0bf2b576 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:32.728948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-644d7794-f071-4578-844c-3e0f7cbfeeca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d1a5a8758c640baa5e9453762129765', 'request_id': 'req-644d7794-f071-4578-844c-3e0f7cbfeeca'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:32.742470 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-644d7794-f071-4578-844c-3e0f7cbfeeca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d1a5a8758c640baa5e9453762129765', 'request_id': 'req-644d7794-f071-4578-844c-3e0f7cbfeeca'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:32.770305 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-644d7794-f071-4578-844c-3e0f7cbfeeca admin admin] The token cache is being invalidate because project 9d1a5a8758c640baa5e9453762129765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:32:32.771188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-644d7794-f071-4578-844c-3e0f7cbfeeca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:32.772846 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-644d7794-f071-4578-844c-3e0f7cbfeeca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:32.776101 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1106/2199] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:32:32 2022] DELETE /identity/v3/projects/9d1a5a8758c640baa5e9453762129765 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:32:32.783410 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d7794-f071-4578-844c-3e0f7cbfeeca admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:32.786498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-644d7794-f071-4578-844c-3e0f7cbfeeca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:32.812918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d7794-f071-4578-844c-3e0f7cbfeeca admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:32.820264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a0678-b987-4dc2-a45b-398d3728ddb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:32.820928 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0678-b987-4dc2-a45b-398d3728ddb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:32.822294 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0678-b987-4dc2-a45b-398d3728ddb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:32.822294 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0678-b987-4dc2-a45b-398d3728ddb3 admin admin] PATH_INFO: `/v3/users/76c397a2e5a44190bfcc391e641b465a` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:32.828178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a0678-b987-4dc2-a45b-398d3728ddb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76c397a2e5a44190bfcc391e641b465a)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:32.828178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a0678-b987-4dc2-a45b-398d3728ddb3 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:32.943273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-576579f2-8f63-4997-bec5-04dd0bf2b576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a061248563b46a7881e6018c6348959', 'request_id': 'req-576579f2-8f63-4997-bec5-04dd0bf2b576'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:33.098212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-576579f2-8f63-4997-bec5-04dd0bf2b576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a061248563b46a7881e6018c6348959', 'request_id': 'req-576579f2-8f63-4997-bec5-04dd0bf2b576'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:33.099309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:33.105788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-576579f2-8f63-4997-bec5-04dd0bf2b576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a061248563b46a7881e6018c6348959', 'request_id': 'req-576579f2-8f63-4997-bec5-04dd0bf2b576'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:33.121099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-576579f2-8f63-4997-bec5-04dd0bf2b576 admin admin] The token cache is being invalidate because project 4a061248563b46a7881e6018c6348959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:32:33.121473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-576579f2-8f63-4997-bec5-04dd0bf2b576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:33.122440 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-576579f2-8f63-4997-bec5-04dd0bf2b576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:33.124114 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1094/2200] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:32:32 2022] DELETE /identity/v3/projects/4a061248563b46a7881e6018c6348959 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:32:33.161157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-c85a0678-b987-4dc2-a45b-398d3728ddb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76c397a2e5a44190bfcc391e641b465a'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:33.288931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-c85a0678-b987-4dc2-a45b-398d3728ddb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76c397a2e5a44190bfcc391e641b465a'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:33.290546 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-c85a0678-b987-4dc2-a45b-398d3728ddb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76c397a2e5a44190bfcc391e641b465a'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:33.307130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-c85a0678-b987-4dc2-a45b-398d3728ddb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76c397a2e5a44190bfcc391e641b465a'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:33.308937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-c85a0678-b987-4dc2-a45b-398d3728ddb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76c397a2e5a44190bfcc391e641b465a'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:33.370729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1107/2201] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:32:32 2022] DELETE /identity/v3/users/76c397a2e5a44190bfcc391e641b465a => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:34.223590 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576579f2-8f63-4997-bec5-04dd0bf2b576 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:34.225899 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-576579f2-8f63-4997-bec5-04dd0bf2b576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:34.392622 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576579f2-8f63-4997-bec5-04dd0bf2b576 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:34.514728 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b597a1-0cda-459f-bce4-f3781c590a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:34.515408 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b597a1-0cda-459f-bce4-f3781c590a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:34.515686 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b597a1-0cda-459f-bce4-f3781c590a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:34.515978 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b597a1-0cda-459f-bce4-f3781c590a3f admin admin] PATH_INFO: `/v3/projects/69f94df7be614f6385f14875bacbd425` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:34.517599 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b597a1-0cda-459f-bce4-f3781c590a3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=69f94df7be614f6385f14875bacbd425)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:34.519729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b597a1-0cda-459f-bce4-f3781c590a3f admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:34.779771 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c1b597a1-0cda-459f-bce4-f3781c590a3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69f94df7be614f6385f14875bacbd425', 'request_id': 'req-c1b597a1-0cda-459f-bce4-f3781c590a3f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:35.006179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c1b597a1-0cda-459f-bce4-f3781c590a3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69f94df7be614f6385f14875bacbd425', 'request_id': 'req-c1b597a1-0cda-459f-bce4-f3781c590a3f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:35.032905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c1b597a1-0cda-459f-bce4-f3781c590a3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69f94df7be614f6385f14875bacbd425', 'request_id': 'req-c1b597a1-0cda-459f-bce4-f3781c590a3f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:35.058099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c1b597a1-0cda-459f-bce4-f3781c590a3f admin admin] The token cache is being invalidate because project 69f94df7be614f6385f14875bacbd425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:32:35.058382 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c1b597a1-0cda-459f-bce4-f3781c590a3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:35.060023 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c1b597a1-0cda-459f-bce4-f3781c590a3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:35.062619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1095/2202] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:32:34 2022] DELETE /identity/v3/projects/69f94df7be614f6385f14875bacbd425 => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:35.071480 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaddcac-73a6-4ae6-b2b1-8d34d311e36f None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:35.072318 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaddcac-73a6-4ae6-b2b1-8d34d311e36f None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:35.072318 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaddcac-73a6-4ae6-b2b1-8d34d311e36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:35.102440 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-ddaddcac-73a6-4ae6-b2b1-8d34d311e36f None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:35.103784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ddaddcac-73a6-4ae6-b2b1-8d34d311e36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:35.211420 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1108/2203] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:32:35.221062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113618a4-47ae-492a-a490-391fec721491 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:35.222117 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113618a4-47ae-492a-a490-391fec721491 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:35.222909 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113618a4-47ae-492a-a490-391fec721491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:35.257391 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-113618a4-47ae-492a-a490-391fec721491 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:35.258869 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-113618a4-47ae-492a-a490-391fec721491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:35.269090 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1096/2204] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:35.274289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaddcac-73a6-4ae6-b2b1-8d34d311e36f None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:35.285378 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaddcac-73a6-4ae6-b2b1-8d34d311e36f None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:35.294961 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d5643-9afb-4660-89a9-27c59a977e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:35.305930 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d5643-9afb-4660-89a9-27c59a977e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:35.305930 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d5643-9afb-4660-89a9-27c59a977e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:35.305930 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d5643-9afb-4660-89a9-27c59a977e93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:35.305930 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d5643-9afb-4660-89a9-27c59a977e93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:32:35.305930 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d5643-9afb-4660-89a9-27c59a977e93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:35.305930 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d5643-9afb-4660-89a9-27c59a977e93 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:35.335349 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1109/2205] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:32:35.336207 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113618a4-47ae-492a-a490-391fec721491 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:35.350306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113618a4-47ae-492a-a490-391fec721491 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:35.355885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925bbb6-8df2-454d-aa09-471425716aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:35.356591 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925bbb6-8df2-454d-aa09-471425716aab admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:35.356987 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925bbb6-8df2-454d-aa09-471425716aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:35.357531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925bbb6-8df2-454d-aa09-471425716aab admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:35.358350 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925bbb6-8df2-454d-aa09-471425716aab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:35.360545 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925bbb6-8df2-454d-aa09-471425716aab admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:35.608364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1097/2206] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:32:35 2022] POST /identity/v3/projects => generated 371 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:35.614286 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d5643-9afb-4660-89a9-27c59a977e93 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:35.665034 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d5643-9afb-4660-89a9-27c59a977e93 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:35.809884 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf68e6-87df-42df-aa5c-7d12088b15ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:35.811435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf68e6-87df-42df-aa5c-7d12088b15ba admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:35.812017 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf68e6-87df-42df-aa5c-7d12088b15ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:35.812576 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf68e6-87df-42df-aa5c-7d12088b15ba admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:35.813849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf68e6-87df-42df-aa5c-7d12088b15ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:35.817479 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf68e6-87df-42df-aa5c-7d12088b15ba admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:35.982490 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925bbb6-8df2-454d-aa09-471425716aab admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:35.983905 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1110/2207] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:32:35 2022] POST /identity/v3/users => generated 286 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:36.009811 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925bbb6-8df2-454d-aa09-471425716aab admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:36.021062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582362f-3c19-42bb-a964-825d5f9d3034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:36.022547 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582362f-3c19-42bb-a964-825d5f9d3034 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:36.023282 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582362f-3c19-42bb-a964-825d5f9d3034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:36.023787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582362f-3c19-42bb-a964-825d5f9d3034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:36.025193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582362f-3c19-42bb-a964-825d5f9d3034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:36.028621 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582362f-3c19-42bb-a964-825d5f9d3034 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:36.055685 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1098/2208] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:32:36.060381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf68e6-87df-42df-aa5c-7d12088b15ba admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:36.077887 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf68e6-87df-42df-aa5c-7d12088b15ba admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:36.085670 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a241fe-126b-4004-ac1d-ac9f4d92feed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:36.086789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a241fe-126b-4004-ac1d-ac9f4d92feed admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:36.087593 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a241fe-126b-4004-ac1d-ac9f4d92feed admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:36.088187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a241fe-126b-4004-ac1d-ac9f4d92feed admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:36.089439 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a241fe-126b-4004-ac1d-ac9f4d92feed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:36.092519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a241fe-126b-4004-ac1d-ac9f4d92feed admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:36.111957 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1111/2209] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:36.118886 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582362f-3c19-42bb-a964-825d5f9d3034 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:36.142314 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582362f-3c19-42bb-a964-825d5f9d3034 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:36.152216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8447c-bd2f-459f-9f9a-3c9e2e987e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:36.153161 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8447c-bd2f-459f-9f9a-3c9e2e987e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:36.153442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8447c-bd2f-459f-9f9a-3c9e2e987e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:36.153905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8447c-bd2f-459f-9f9a-3c9e2e987e86 admin admin] PATH_INFO: `/v3/projects/fcf8637049864e26a8af15e6fd3e1f1f/users/ef68150915d34826ab861dfbe6d4e3dc/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:36.187140 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8447c-bd2f-459f-9f9a-3c9e2e987e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf8637049864e26a8af15e6fd3e1f1f, user_id=ef68150915d34826ab861dfbe6d4e3dc, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:36.191744 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8447c-bd2f-459f-9f9a-3c9e2e987e86 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:36.401998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1099/2210] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:32:36 2022] PUT /identity/v3/projects/fcf8637049864e26a8af15e6fd3e1f1f/users/ef68150915d34826ab861dfbe6d4e3dc/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:36.411065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be26d1-7411-4b4f-bb4f-96421a07bd3b None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:36.411497 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be26d1-7411-4b4f-bb4f-96421a07bd3b None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:36.412124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be26d1-7411-4b4f-bb4f-96421a07bd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:36.440752 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-a2be26d1-7411-4b4f-bb4f-96421a07bd3b None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:36.443213 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a2be26d1-7411-4b4f-bb4f-96421a07bd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:36.572072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1112/2211] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:36.586657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:36.592750 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8447c-bd2f-459f-9f9a-3c9e2e987e86 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:36.595817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-2bb8447c-bd2f-459f-9f9a-3c9e2e987e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:36.722977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8447c-bd2f-459f-9f9a-3c9e2e987e86 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:36.728439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9f569-5e44-49d1-9423-e294cf6f4766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:36.729681 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9f569-5e44-49d1-9423-e294cf6f4766 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:36.730228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9f569-5e44-49d1-9423-e294cf6f4766 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:36.731296 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9f569-5e44-49d1-9423-e294cf6f4766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:36.747936 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9f569-5e44-49d1-9423-e294cf6f4766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:36.752423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9f569-5e44-49d1-9423-e294cf6f4766 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:36.777320 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1100/2212] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:38.135809 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:39.311707 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f525067-6ea7-4ed6-8890-2f6b8bff7807 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:39.312770 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f525067-6ea7-4ed6-8890-2f6b8bff7807 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:39.313071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f525067-6ea7-4ed6-8890-2f6b8bff7807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:39.342780 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-1f525067-6ea7-4ed6-8890-2f6b8bff7807 None None] MFA Rules not processed for user `1541fedac9514a2eb65e8da0cc609fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:39.348169 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-1f525067-6ea7-4ed6-8890-2f6b8bff7807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:39.428729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1113/2213] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:32:40.601619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc8507-97bd-41f6-8109-2f8fbe5693cc None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:40.603529 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc8507-97bd-41f6-8109-2f8fbe5693cc None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:40.604369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc8507-97bd-41f6-8109-2f8fbe5693cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:40.670844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-88fc8507-97bd-41f6-8109-2f8fbe5693cc None None] MFA Rules not processed for user `ef68150915d34826ab861dfbe6d4e3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:40.673186 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-88fc8507-97bd-41f6-8109-2f8fbe5693cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:40.918929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1101/2214] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:41.030268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f525067-6ea7-4ed6-8890-2f6b8bff7807 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:41.033264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-1f525067-6ea7-4ed6-8890-2f6b8bff7807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:41.182093 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f525067-6ea7-4ed6-8890-2f6b8bff7807 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:41.191739 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8918abc-a1c9-4cc6-ac89-b7baa4789a9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:41.192459 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8918abc-a1c9-4cc6-ac89-b7baa4789a9b service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:41.192797 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8918abc-a1c9-4cc6-ac89-b7baa4789a9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:41.194358 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8918abc-a1c9-4cc6-ac89-b7baa4789a9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:41.220611 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8918abc-a1c9-4cc6-ac89-b7baa4789a9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:41.222790 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8918abc-a1c9-4cc6-ac89-b7baa4789a9b service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:41.240031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1114/2215] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:32:41.285165 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:42.790854 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:43.048167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc8507-97bd-41f6-8109-2f8fbe5693cc None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:43.052070 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-88fc8507-97bd-41f6-8109-2f8fbe5693cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:43.084566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc8507-97bd-41f6-8109-2f8fbe5693cc None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:43.112291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb6a93-e6db-4d07-a03c-55d122c15673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:43.112291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb6a93-e6db-4d07-a03c-55d122c15673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:43.112291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb6a93-e6db-4d07-a03c-55d122c15673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:43.112291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb6a93-e6db-4d07-a03c-55d122c15673 admin admin] PATH_INFO: `/v3/users/877a2e564f374df5b31e5c71ac42530d` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:43.114770 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb6a93-e6db-4d07-a03c-55d122c15673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=877a2e564f374df5b31e5c71ac42530d)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:43.118859 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb6a93-e6db-4d07-a03c-55d122c15673 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:44.043986 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-84fb6a93-e6db-4d07-a03c-55d122c15673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '877a2e564f374df5b31e5c71ac42530d'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:44.070206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-84fb6a93-e6db-4d07-a03c-55d122c15673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '877a2e564f374df5b31e5c71ac42530d'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:44.265253 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-84fb6a93-e6db-4d07-a03c-55d122c15673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '877a2e564f374df5b31e5c71ac42530d'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:44.266336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-84fb6a93-e6db-4d07-a03c-55d122c15673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '877a2e564f374df5b31e5c71ac42530d'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:44.285660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-84fb6a93-e6db-4d07-a03c-55d122c15673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '877a2e564f374df5b31e5c71ac42530d'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:44.294300 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1102/2216] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:32:43 2022] DELETE /identity/v3/users/877a2e564f374df5b31e5c71ac42530d => generated 0 bytes in 1247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:44.301740 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652945-ffe8-41d3-8c28-397fe9576e9c None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:44.301740 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652945-ffe8-41d3-8c28-397fe9576e9c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:44.301740 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652945-ffe8-41d3-8c28-397fe9576e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:44.328999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-e1652945-ffe8-41d3-8c28-397fe9576e9c None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:44.330777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-e1652945-ffe8-41d3-8c28-397fe9576e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:44.413258 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1115/2217] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:44.424975 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb6a93-e6db-4d07-a03c-55d122c15673 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:44.426759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-84fb6a93-e6db-4d07-a03c-55d122c15673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:44.453010 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:44.549312 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb6a93-e6db-4d07-a03c-55d122c15673 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:44.553036 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e179ee-36fc-4dd1-9f15-4ac9a664ae2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:44.553799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e179ee-36fc-4dd1-9f15-4ac9a664ae2f service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:44.554068 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e179ee-36fc-4dd1-9f15-4ac9a664ae2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:44.554347 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e179ee-36fc-4dd1-9f15-4ac9a664ae2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:44.570333 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e179ee-36fc-4dd1-9f15-4ac9a664ae2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:44.573497 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e179ee-36fc-4dd1-9f15-4ac9a664ae2f service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:44.593552 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1103/2218] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:45.105408 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e1de9-bfe5-4e3a-a4d4-961fdf191515 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:45.106179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e1de9-bfe5-4e3a-a4d4-961fdf191515 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:45.106464 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e1de9-bfe5-4e3a-a4d4-961fdf191515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:45.147073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-9f6e1de9-bfe5-4e3a-a4d4-961fdf191515 None None] MFA Rules not processed for user `ef68150915d34826ab861dfbe6d4e3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:45.148605 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-9f6e1de9-bfe5-4e3a-a4d4-961fdf191515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:45.263202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1116/2219] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:45.887998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e179ee-36fc-4dd1-9f15-4ac9a664ae2f service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:45.889513 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-c9e179ee-36fc-4dd1-9f15-4ac9a664ae2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:45.913385 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e179ee-36fc-4dd1-9f15-4ac9a664ae2f service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:45.922442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3c066-ff03-4306-8522-84bcc0eb786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:45.923189 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3c066-ff03-4306-8522-84bcc0eb786d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:45.923456 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3c066-ff03-4306-8522-84bcc0eb786d admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:45.923926 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3c066-ff03-4306-8522-84bcc0eb786d admin admin] PATH_INFO: `/v3/projects/3f5f7c3461d9433e93d4eaccd276112a` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:45.930482 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3c066-ff03-4306-8522-84bcc0eb786d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f5f7c3461d9433e93d4eaccd276112a)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:45.932975 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3c066-ff03-4306-8522-84bcc0eb786d admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:46.215555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-fcc3c066-ff03-4306-8522-84bcc0eb786d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f5f7c3461d9433e93d4eaccd276112a', 'request_id': 'req-fcc3c066-ff03-4306-8522-84bcc0eb786d'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:46.344970 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-fcc3c066-ff03-4306-8522-84bcc0eb786d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f5f7c3461d9433e93d4eaccd276112a', 'request_id': 'req-fcc3c066-ff03-4306-8522-84bcc0eb786d'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:46.356059 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-fcc3c066-ff03-4306-8522-84bcc0eb786d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f5f7c3461d9433e93d4eaccd276112a', 'request_id': 'req-fcc3c066-ff03-4306-8522-84bcc0eb786d'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:46.396860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-fcc3c066-ff03-4306-8522-84bcc0eb786d admin admin] The token cache is being invalidate because project 3f5f7c3461d9433e93d4eaccd276112a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:32:46.396860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-fcc3c066-ff03-4306-8522-84bcc0eb786d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:46.399210 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-fcc3c066-ff03-4306-8522-84bcc0eb786d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:46.402726 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1104/2220] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:32:45 2022] DELETE /identity/v3/projects/3f5f7c3461d9433e93d4eaccd276112a => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:46.413009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca5f8b-6218-430d-95db-dd85cd2d4797 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:46.419689 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca5f8b-6218-430d-95db-dd85cd2d4797 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:46.419689 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca5f8b-6218-430d-95db-dd85cd2d4797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:46.508683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-6dca5f8b-6218-430d-95db-dd85cd2d4797 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:46.509977 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-6dca5f8b-6218-430d-95db-dd85cd2d4797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:46.614617 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1117/2221] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:46.626259 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c3f40-03fb-4db7-9fda-9d6aca4e4f64 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:46.626259 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c3f40-03fb-4db7-9fda-9d6aca4e4f64 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:46.626259 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c3f40-03fb-4db7-9fda-9d6aca4e4f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:46.690782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-276c3f40-03fb-4db7-9fda-9d6aca4e4f64 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:46.692861 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-276c3f40-03fb-4db7-9fda-9d6aca4e4f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:46.710208 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1105/2222] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:46.717652 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca5f8b-6218-430d-95db-dd85cd2d4797 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:46.730031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca5f8b-6218-430d-95db-dd85cd2d4797 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:46.736091 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae679226-cc1b-4f50-aaf4-2800d58687d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:46.736751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae679226-cc1b-4f50-aaf4-2800d58687d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:46.737122 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae679226-cc1b-4f50-aaf4-2800d58687d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:46.737588 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae679226-cc1b-4f50-aaf4-2800d58687d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:46.738265 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae679226-cc1b-4f50-aaf4-2800d58687d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:32:46.738559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae679226-cc1b-4f50-aaf4-2800d58687d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:46.740475 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae679226-cc1b-4f50-aaf4-2800d58687d5 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:46.756050 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1118/2223] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:32:46.763158 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c3f40-03fb-4db7-9fda-9d6aca4e4f64 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:46.774642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c3f40-03fb-4db7-9fda-9d6aca4e4f64 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:46.780526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffc3d0-911a-45a1-b204-fce9bae32893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:46.785237 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffc3d0-911a-45a1-b204-fce9bae32893 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:46.785237 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffc3d0-911a-45a1-b204-fce9bae32893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:46.785237 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffc3d0-911a-45a1-b204-fce9bae32893 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:46.785237 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffc3d0-911a-45a1-b204-fce9bae32893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:46.788488 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffc3d0-911a-45a1-b204-fce9bae32893 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:46.943807 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1106/2224] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:32:46 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:32:46.949429 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae679226-cc1b-4f50-aaf4-2800d58687d5 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:46.970185 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae679226-cc1b-4f50-aaf4-2800d58687d5 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:47.129854 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596b62f-0ef3-4768-8911-3b8804041785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:47.136367 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596b62f-0ef3-4768-8911-3b8804041785 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:47.136367 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596b62f-0ef3-4768-8911-3b8804041785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:47.136367 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596b62f-0ef3-4768-8911-3b8804041785 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:47.136367 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596b62f-0ef3-4768-8911-3b8804041785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:47.143875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596b62f-0ef3-4768-8911-3b8804041785 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:47.339181 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1119/2225] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:32:46 2022] POST /identity/v3/users => generated 287 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:47.346776 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffc3d0-911a-45a1-b204-fce9bae32893 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:47.375504 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffc3d0-911a-45a1-b204-fce9bae32893 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:47.390839 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673ef6f-b0d7-46fb-a83b-f076be60fa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:47.392463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ef6f-b0d7-46fb-a83b-f076be60fa25 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:47.393244 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ef6f-b0d7-46fb-a83b-f076be60fa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:47.393932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ef6f-b0d7-46fb-a83b-f076be60fa25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:47.395951 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673ef6f-b0d7-46fb-a83b-f076be60fa25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:47.399076 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673ef6f-b0d7-46fb-a83b-f076be60fa25 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:47.417343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1107/2226] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:47.423250 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596b62f-0ef3-4768-8911-3b8804041785 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:47.461940 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596b62f-0ef3-4768-8911-3b8804041785 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:47.484211 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9347d-bebe-49c4-81e0-da21c904e28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:47.485152 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9347d-bebe-49c4-81e0-da21c904e28e admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:47.485723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9347d-bebe-49c4-81e0-da21c904e28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:47.486074 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9347d-bebe-49c4-81e0-da21c904e28e admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:47.486850 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9347d-bebe-49c4-81e0-da21c904e28e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:47.492151 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9347d-bebe-49c4-81e0-da21c904e28e admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:47.506158 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1120/2227] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:47.511575 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673ef6f-b0d7-46fb-a83b-f076be60fa25 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:47.538683 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673ef6f-b0d7-46fb-a83b-f076be60fa25 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:47.546345 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a96a0-ba7f-4d06-a496-888938769f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:47.547400 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a96a0-ba7f-4d06-a496-888938769f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:47.548007 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a96a0-ba7f-4d06-a496-888938769f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:47.548497 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a96a0-ba7f-4d06-a496-888938769f33 admin admin] PATH_INFO: `/v3/projects/9cb4651121bb4a908147a675515b8f1d/users/39a11b66e3564a0a8bf369242b4318eb/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:47.573643 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a96a0-ba7f-4d06-a496-888938769f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb4651121bb4a908147a675515b8f1d, user_id=39a11b66e3564a0a8bf369242b4318eb, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:47.579120 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a96a0-ba7f-4d06-a496-888938769f33 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:47.695515 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1108/2228] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:32:47 2022] PUT /identity/v3/projects/9cb4651121bb4a908147a675515b8f1d/users/39a11b66e3564a0a8bf369242b4318eb/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:47.709108 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7114e3b-c75a-4cbd-b5cc-f6f5fc499a18 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:47.709648 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7114e3b-c75a-4cbd-b5cc-f6f5fc499a18 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:47.710128 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7114e3b-c75a-4cbd-b5cc-f6f5fc499a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:47.759608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-b7114e3b-c75a-4cbd-b5cc-f6f5fc499a18 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:47.761846 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b7114e3b-c75a-4cbd-b5cc-f6f5fc499a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:47.821208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:47.902041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1121/2229] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:47.911350 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a96a0-ba7f-4d06-a496-888938769f33 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:47.914397 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-481a96a0-ba7f-4d06-a496-888938769f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:47.996796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a96a0-ba7f-4d06-a496-888938769f33 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:47.999574 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989de7b-beaf-4cf0-8175-3ece48726532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:48.000622 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989de7b-beaf-4cf0-8175-3ece48726532 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:48.001051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989de7b-beaf-4cf0-8175-3ece48726532 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:48.001571 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989de7b-beaf-4cf0-8175-3ece48726532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:48.038369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989de7b-beaf-4cf0-8175-3ece48726532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:48.040965 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989de7b-beaf-4cf0-8175-3ece48726532 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:48.066049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1109/2230] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:49.268659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7114e3b-c75a-4cbd-b5cc-f6f5fc499a18 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:49.272573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b7114e3b-c75a-4cbd-b5cc-f6f5fc499a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:49.289630 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7114e3b-c75a-4cbd-b5cc-f6f5fc499a18 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:49.296849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4b474-3be0-432c-9329-0c36f0833f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:49.298027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4b474-3be0-432c-9329-0c36f0833f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:49.298541 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4b474-3be0-432c-9329-0c36f0833f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:49.299176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4b474-3be0-432c-9329-0c36f0833f6f admin admin] PATH_INFO: `/v3/users/34fcc73e470e4b4aabec3539c84e7739` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:49.301074 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4b474-3be0-432c-9329-0c36f0833f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=34fcc73e470e4b4aabec3539c84e7739)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:49.304200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4b474-3be0-432c-9329-0c36f0833f6f admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:49.466381 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:49.677266 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bfe4b474-3be0-432c-9329-0c36f0833f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34fcc73e470e4b4aabec3539c84e7739'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:49.756353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bfe4b474-3be0-432c-9329-0c36f0833f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34fcc73e470e4b4aabec3539c84e7739'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:49.757048 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bfe4b474-3be0-432c-9329-0c36f0833f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34fcc73e470e4b4aabec3539c84e7739'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:49.771721 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bfe4b474-3be0-432c-9329-0c36f0833f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34fcc73e470e4b4aabec3539c84e7739'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:49.772940 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bfe4b474-3be0-432c-9329-0c36f0833f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34fcc73e470e4b4aabec3539c84e7739'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:49.808138 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1122/2231] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:32:49 2022] DELETE /identity/v3/users/34fcc73e470e4b4aabec3539c84e7739 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:49.810102 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5cc13-dc2e-42d7-9a34-fe0c97e1b8d0 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:49.810639 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5cc13-dc2e-42d7-9a34-fe0c97e1b8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:49.811229 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5cc13-dc2e-42d7-9a34-fe0c97e1b8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:49.904820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-4fa5cc13-dc2e-42d7-9a34-fe0c97e1b8d0 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:49.913162 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4fa5cc13-dc2e-42d7-9a34-fe0c97e1b8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:50.106010 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1110/2232] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:32:50.119900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4b474-3be0-432c-9329-0c36f0833f6f admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:50.135433 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-bfe4b474-3be0-432c-9329-0c36f0833f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:50.279201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4b474-3be0-432c-9329-0c36f0833f6f admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:50.290240 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b87eb-0954-4b35-b77e-21fc24cf60b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:50.292097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b87eb-0954-4b35-b77e-21fc24cf60b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:50.296616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b87eb-0954-4b35-b77e-21fc24cf60b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:50.296616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b87eb-0954-4b35-b77e-21fc24cf60b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:50.314986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b87eb-0954-4b35-b77e-21fc24cf60b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:50.318004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b87eb-0954-4b35-b77e-21fc24cf60b8 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:50.344644 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1123/2233] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:32:50.915772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:51.145816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5cc13-dc2e-42d7-9a34-fe0c97e1b8d0 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:51.164894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4fa5cc13-dc2e-42d7-9a34-fe0c97e1b8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:51.187268 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5cc13-dc2e-42d7-9a34-fe0c97e1b8d0 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:51.195523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283d7c9-7389-421d-ab17-a3d713120d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:51.196797 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283d7c9-7389-421d-ab17-a3d713120d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:51.197340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283d7c9-7389-421d-ab17-a3d713120d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:51.198614 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283d7c9-7389-421d-ab17-a3d713120d9a admin admin] PATH_INFO: `/v3/projects/24a70c049c054dc0968c7511546a145e` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:51.201146 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283d7c9-7389-421d-ab17-a3d713120d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a70c049c054dc0968c7511546a145e)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:51.204481 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283d7c9-7389-421d-ab17-a3d713120d9a admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:51.444787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c283d7c9-7389-421d-ab17-a3d713120d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a70c049c054dc0968c7511546a145e', 'request_id': 'req-c283d7c9-7389-421d-ab17-a3d713120d9a'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:51.612981 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c283d7c9-7389-421d-ab17-a3d713120d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a70c049c054dc0968c7511546a145e', 'request_id': 'req-c283d7c9-7389-421d-ab17-a3d713120d9a'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:51.631970 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c283d7c9-7389-421d-ab17-a3d713120d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a70c049c054dc0968c7511546a145e', 'request_id': 'req-c283d7c9-7389-421d-ab17-a3d713120d9a'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:51.667175 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c283d7c9-7389-421d-ab17-a3d713120d9a admin admin] The token cache is being invalidate because project 24a70c049c054dc0968c7511546a145e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:32:51.667478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c283d7c9-7389-421d-ab17-a3d713120d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:51.668868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c283d7c9-7389-421d-ab17-a3d713120d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:51.670851 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1111/2234] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:32:51 2022] DELETE /identity/v3/projects/24a70c049c054dc0968c7511546a145e => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:51.675720 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b87eb-0954-4b35-b77e-21fc24cf60b8 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:51.703057 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b87eb-0954-4b35-b77e-21fc24cf60b8 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:51.851789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4b54f-865a-445c-8d12-a7d720de7d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:51.852779 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4b54f-865a-445c-8d12-a7d720de7d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:51.853216 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4b54f-865a-445c-8d12-a7d720de7d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:51.853643 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4b54f-865a-445c-8d12-a7d720de7d40 admin admin] PATH_INFO: `/v3/users/90a340386a5247ea9b691648f1053709` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:51.855135 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4b54f-865a-445c-8d12-a7d720de7d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a340386a5247ea9b691648f1053709)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:51.857339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4b54f-865a-445c-8d12-a7d720de7d40 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:52.224896 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2ad4b54f-865a-445c-8d12-a7d720de7d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a340386a5247ea9b691648f1053709'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:52.297947 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:52.350571 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2ad4b54f-865a-445c-8d12-a7d720de7d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a340386a5247ea9b691648f1053709'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:52.351863 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2ad4b54f-865a-445c-8d12-a7d720de7d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a340386a5247ea9b691648f1053709'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:52.369081 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2ad4b54f-865a-445c-8d12-a7d720de7d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a340386a5247ea9b691648f1053709'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:52.370449 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2ad4b54f-865a-445c-8d12-a7d720de7d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a340386a5247ea9b691648f1053709'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:52.406375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1124/2235] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:32:51 2022] DELETE /identity/v3/users/90a340386a5247ea9b691648f1053709 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:53.615990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:54.568380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283d7c9-7389-421d-ab17-a3d713120d9a admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:54.570886 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-c283d7c9-7389-421d-ab17-a3d713120d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:54.624860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283d7c9-7389-421d-ab17-a3d713120d9a admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:54.737126 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f941fc-7acf-4805-9a6b-a00f9c14c653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:54.738646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f941fc-7acf-4805-9a6b-a00f9c14c653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:54.739108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f941fc-7acf-4805-9a6b-a00f9c14c653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:54.739471 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f941fc-7acf-4805-9a6b-a00f9c14c653 admin admin] PATH_INFO: `/v3/projects/4f36267a21e348d1a33a140401e8f1ee` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:54.741244 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f941fc-7acf-4805-9a6b-a00f9c14c653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f36267a21e348d1a33a140401e8f1ee)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:54.743888 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f941fc-7acf-4805-9a6b-a00f9c14c653 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:54.956330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-73f941fc-7acf-4805-9a6b-a00f9c14c653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f36267a21e348d1a33a140401e8f1ee', 'request_id': 'req-73f941fc-7acf-4805-9a6b-a00f9c14c653'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:55.129998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-73f941fc-7acf-4805-9a6b-a00f9c14c653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f36267a21e348d1a33a140401e8f1ee', 'request_id': 'req-73f941fc-7acf-4805-9a6b-a00f9c14c653'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:55.142840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-73f941fc-7acf-4805-9a6b-a00f9c14c653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f36267a21e348d1a33a140401e8f1ee', 'request_id': 'req-73f941fc-7acf-4805-9a6b-a00f9c14c653'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:55.171957 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-73f941fc-7acf-4805-9a6b-a00f9c14c653 admin admin] The token cache is being invalidate because project 4f36267a21e348d1a33a140401e8f1ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:32:55.172453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-73f941fc-7acf-4805-9a6b-a00f9c14c653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:55.174898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-73f941fc-7acf-4805-9a6b-a00f9c14c653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:55.177153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1112/2236] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:32:54 2022] DELETE /identity/v3/projects/4f36267a21e348d1a33a140401e8f1ee => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:55.184597 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b0219-6c5a-4382-8545-2a504bf09204 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:55.185518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b0219-6c5a-4382-8545-2a504bf09204 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:55.185978 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b0219-6c5a-4382-8545-2a504bf09204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:55.209285 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-fe0b0219-6c5a-4382-8545-2a504bf09204 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:55.211683 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-fe0b0219-6c5a-4382-8545-2a504bf09204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:55.295501 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1125/2237] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:55.303657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2966b1-c6e3-40ec-8def-7310bf19ceec None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:55.303993 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2966b1-c6e3-40ec-8def-7310bf19ceec None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:55.304243 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2966b1-c6e3-40ec-8def-7310bf19ceec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:55.326353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-7e2966b1-c6e3-40ec-8def-7310bf19ceec None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:55.327640 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-7e2966b1-c6e3-40ec-8def-7310bf19ceec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:55.335933 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1113/2238] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:55.342445 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b0219-6c5a-4382-8545-2a504bf09204 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:55.353178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b0219-6c5a-4382-8545-2a504bf09204 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:55.359489 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d6105-3e6a-49f4-8eeb-2eeeb2ed6c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:55.360262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d6105-3e6a-49f4-8eeb-2eeeb2ed6c9b admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:55.360465 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d6105-3e6a-49f4-8eeb-2eeeb2ed6c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:55.360793 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d6105-3e6a-49f4-8eeb-2eeeb2ed6c9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:55.361744 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d6105-3e6a-49f4-8eeb-2eeeb2ed6c9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:32:55.361865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d6105-3e6a-49f4-8eeb-2eeeb2ed6c9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:55.363579 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d6105-3e6a-49f4-8eeb-2eeeb2ed6c9b admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:55.368406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:55.387419 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1126/2239] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:32:55.391220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2966b1-c6e3-40ec-8def-7310bf19ceec None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:55.405403 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2966b1-c6e3-40ec-8def-7310bf19ceec None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:55.413014 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc838a-3a67-485b-afc8-77ec9e4b948c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:55.414013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc838a-3a67-485b-afc8-77ec9e4b948c admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:55.414291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc838a-3a67-485b-afc8-77ec9e4b948c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:55.414579 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc838a-3a67-485b-afc8-77ec9e4b948c admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:55.415418 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc838a-3a67-485b-afc8-77ec9e4b948c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:55.417697 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc838a-3a67-485b-afc8-77ec9e4b948c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:55.576576 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1114/2240] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:32:55 2022] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:55.589668 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d6105-3e6a-49f4-8eeb-2eeeb2ed6c9b admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:55.593029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d6105-3e6a-49f4-8eeb-2eeeb2ed6c9b admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:55.735504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3250a83-8052-44bc-85c7-c51f2e431fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:55.736498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3250a83-8052-44bc-85c7-c51f2e431fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:55.736875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3250a83-8052-44bc-85c7-c51f2e431fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:55.737318 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3250a83-8052-44bc-85c7-c51f2e431fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:55.738816 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3250a83-8052-44bc-85c7-c51f2e431fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:55.741010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3250a83-8052-44bc-85c7-c51f2e431fb3 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:55.962120 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1127/2241] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:32:55 2022] POST /identity/v3/users => generated 294 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:55.968456 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc838a-3a67-485b-afc8-77ec9e4b948c admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:55.991266 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc838a-3a67-485b-afc8-77ec9e4b948c admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:56.011298 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c0af0-3d2e-4b6c-a459-d9113c4af123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:56.014121 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c0af0-3d2e-4b6c-a459-d9113c4af123 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:56.014121 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c0af0-3d2e-4b6c-a459-d9113c4af123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:56.014121 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c0af0-3d2e-4b6c-a459-d9113c4af123 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:56.016019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c0af0-3d2e-4b6c-a459-d9113c4af123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:56.019454 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c0af0-3d2e-4b6c-a459-d9113c4af123 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:56.068375 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1115/2242] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:56.072389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3250a83-8052-44bc-85c7-c51f2e431fb3 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:56.091029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3250a83-8052-44bc-85c7-c51f2e431fb3 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:56.107355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503ec19-c1a3-40a0-8f23-d3b37ed8d0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:56.108798 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503ec19-c1a3-40a0-8f23-d3b37ed8d0fe admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:56.108920 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503ec19-c1a3-40a0-8f23-d3b37ed8d0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:56.109238 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503ec19-c1a3-40a0-8f23-d3b37ed8d0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:56.109850 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503ec19-c1a3-40a0-8f23-d3b37ed8d0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:56.111560 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503ec19-c1a3-40a0-8f23-d3b37ed8d0fe admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:56.138025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1128/2243] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:56.139528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c0af0-3d2e-4b6c-a459-d9113c4af123 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:56.153210 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c0af0-3d2e-4b6c-a459-d9113c4af123 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:56.162450 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863b9c9-c22c-40c7-add7-273b9ff390ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:56.163552 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863b9c9-c22c-40c7-add7-273b9ff390ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:56.164106 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863b9c9-c22c-40c7-add7-273b9ff390ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:56.164606 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863b9c9-c22c-40c7-add7-273b9ff390ee admin admin] PATH_INFO: `/v3/projects/daa12b60961846d891f0407787dc1e7e/users/c50da0ef27d1455bbdbab35e820ea5a1/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:56.192903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863b9c9-c22c-40c7-add7-273b9ff390ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa12b60961846d891f0407787dc1e7e, user_id=c50da0ef27d1455bbdbab35e820ea5a1, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:56.197246 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863b9c9-c22c-40c7-add7-273b9ff390ee admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:56.335633 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1116/2244] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:32:56 2022] PUT /identity/v3/projects/daa12b60961846d891f0407787dc1e7e/users/c50da0ef27d1455bbdbab35e820ea5a1/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:56.350647 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e072cb4-6f3b-4381-8fc5-5b27e3200a55 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:56.350647 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e072cb4-6f3b-4381-8fc5-5b27e3200a55 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:56.350647 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e072cb4-6f3b-4381-8fc5-5b27e3200a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:56.417425 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-6e072cb4-6f3b-4381-8fc5-5b27e3200a55 None None] MFA Rules not processed for user `c50da0ef27d1455bbdbab35e820ea5a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:56.419790 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-6e072cb4-6f3b-4381-8fc5-5b27e3200a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:56.593889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1129/2245] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:56.600458 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863b9c9-c22c-40c7-add7-273b9ff390ee admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:56.731262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863b9c9-c22c-40c7-add7-273b9ff390ee admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:56.741781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687f1f5-cf8a-4319-9e98-2f2322eeb9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:56.742359 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687f1f5-cf8a-4319-9e98-2f2322eeb9cc admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:56.742803 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687f1f5-cf8a-4319-9e98-2f2322eeb9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:56.743163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687f1f5-cf8a-4319-9e98-2f2322eeb9cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:56.744143 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687f1f5-cf8a-4319-9e98-2f2322eeb9cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:56.746163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687f1f5-cf8a-4319-9e98-2f2322eeb9cc admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:56.818958 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:56.989361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1117/2246] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:32:56 2022] POST /identity/v3/projects => generated 385 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:32:56.998359 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e072cb4-6f3b-4381-8fc5-5b27e3200a55 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:57.022776 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e072cb4-6f3b-4381-8fc5-5b27e3200a55 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:57.131109 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ef392-8caf-4088-8f84-a7dbb7b981d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:57.131674 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ef392-8caf-4088-8f84-a7dbb7b981d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:57.132412 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ef392-8caf-4088-8f84-a7dbb7b981d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:57.133026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ef392-8caf-4088-8f84-a7dbb7b981d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:57.133898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ef392-8caf-4088-8f84-a7dbb7b981d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:57.136170 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ef392-8caf-4088-8f84-a7dbb7b981d9 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:57.287210 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1130/2247] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:32:56 2022] POST /identity/v3/users => generated 299 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:32:57.291390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687f1f5-cf8a-4319-9e98-2f2322eeb9cc admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:57.307649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687f1f5-cf8a-4319-9e98-2f2322eeb9cc admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:57.317666 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d677f-395a-4489-9b95-dfca4c4e994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:57.318619 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d677f-395a-4489-9b95-dfca4c4e994d admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:57.319569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d677f-395a-4489-9b95-dfca4c4e994d admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:57.320037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d677f-395a-4489-9b95-dfca4c4e994d admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:57.324873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d677f-395a-4489-9b95-dfca4c4e994d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:57.324873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d677f-395a-4489-9b95-dfca4c4e994d admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:57.344951 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1118/2248] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:57.349053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ef392-8caf-4088-8f84-a7dbb7b981d9 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:57.363128 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ef392-8caf-4088-8f84-a7dbb7b981d9 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:57.372630 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a6b33-4fe2-4b88-8e58-2b278a970745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:57.373923 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a6b33-4fe2-4b88-8e58-2b278a970745 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:57.374449 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a6b33-4fe2-4b88-8e58-2b278a970745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:57.374947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a6b33-4fe2-4b88-8e58-2b278a970745 admin admin] PATH_INFO: `/v3/projects/d1cd449152384516912995a78ec4c4bf/users/2e0f771e84034878a2c00148d38bd49f/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:57.405617 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a6b33-4fe2-4b88-8e58-2b278a970745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1cd449152384516912995a78ec4c4bf, user_id=2e0f771e84034878a2c00148d38bd49f, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:57.411529 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a6b33-4fe2-4b88-8e58-2b278a970745 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:57.560294 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1131/2249] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:32:57 2022] PUT /identity/v3/projects/d1cd449152384516912995a78ec4c4bf/users/2e0f771e84034878a2c00148d38bd49f/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:32:57.565623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d677f-395a-4489-9b95-dfca4c4e994d admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:57.579269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d677f-395a-4489-9b95-dfca4c4e994d admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:57.663145 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686623ad-084a-45ec-9289-7a4788d687ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:57.665404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686623ad-084a-45ec-9289-7a4788d687ff admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:57.665901 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686623ad-084a-45ec-9289-7a4788d687ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:57.666332 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686623ad-084a-45ec-9289-7a4788d687ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:57.667201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686623ad-084a-45ec-9289-7a4788d687ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:57.670191 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686623ad-084a-45ec-9289-7a4788d687ff admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:57.684386 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1119/2250] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:32:57.689076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a6b33-4fe2-4b88-8e58-2b278a970745 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:57.701394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a6b33-4fe2-4b88-8e58-2b278a970745 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:57.708931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e7ce8-0138-4fa3-a1e3-14ae98845fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:57.710012 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e7ce8-0138-4fa3-a1e3-14ae98845fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:57.710396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e7ce8-0138-4fa3-a1e3-14ae98845fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:57.710847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e7ce8-0138-4fa3-a1e3-14ae98845fcc admin admin] PATH_INFO: `/v3/projects/d1cd449152384516912995a78ec4c4bf/users/2e0f771e84034878a2c00148d38bd49f/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:57.715071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e7ce8-0138-4fa3-a1e3-14ae98845fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1cd449152384516912995a78ec4c4bf, user_id=2e0f771e84034878a2c00148d38bd49f, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:57.718172 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e7ce8-0138-4fa3-a1e3-14ae98845fcc admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:57.734711 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1132/2251] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:32:57 2022] PUT /identity/v3/projects/d1cd449152384516912995a78ec4c4bf/users/2e0f771e84034878a2c00148d38bd49f/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:32:57.748591 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186fa32-2c2b-47f6-acf1-aac212a314e4 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:57.749141 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186fa32-2c2b-47f6-acf1-aac212a314e4 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:57.749571 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186fa32-2c2b-47f6-acf1-aac212a314e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:57.791675 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-a186fa32-2c2b-47f6-acf1-aac212a314e4 None None] MFA Rules not processed for user `2e0f771e84034878a2c00148d38bd49f`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:57.793449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a186fa32-2c2b-47f6-acf1-aac212a314e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:57.925112 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1120/2252] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:57.936591 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e7ce8-0138-4fa3-a1e3-14ae98845fcc admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:57.939083 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-1e9e7ce8-0138-4fa3-a1e3-14ae98845fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:58.019520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e7ce8-0138-4fa3-a1e3-14ae98845fcc admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:58.024141 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4451e1-b98c-4e0f-acff-5518553bd3e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:58.024795 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4451e1-b98c-4e0f-acff-5518553bd3e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:58.025099 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4451e1-b98c-4e0f-acff-5518553bd3e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:58.025331 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4451e1-b98c-4e0f-acff-5518553bd3e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:58.041609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4451e1-b98c-4e0f-acff-5518553bd3e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:58.044235 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4451e1-b98c-4e0f-acff-5518553bd3e5 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:58.060689 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1133/2253] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:58.100027 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186fa32-2c2b-47f6-acf1-aac212a314e4 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:58.216920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:58.222445 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186fa32-2c2b-47f6-acf1-aac212a314e4 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:58.231320 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b0037-47eb-4872-b6f5-1211b1e22094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:58.234366 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b0037-47eb-4872-b6f5-1211b1e22094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:58.235081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b0037-47eb-4872-b6f5-1211b1e22094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:58.235608 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b0037-47eb-4872-b6f5-1211b1e22094 admin admin] PATH_INFO: `/v3/users/c50da0ef27d1455bbdbab35e820ea5a1` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:58.237721 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b0037-47eb-4872-b6f5-1211b1e22094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c50da0ef27d1455bbdbab35e820ea5a1)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:58.242202 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b0037-47eb-4872-b6f5-1211b1e22094 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:58.512859 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-260b0037-47eb-4872-b6f5-1211b1e22094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c50da0ef27d1455bbdbab35e820ea5a1'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:58.608514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-260b0037-47eb-4872-b6f5-1211b1e22094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c50da0ef27d1455bbdbab35e820ea5a1'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:58.710909 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-260b0037-47eb-4872-b6f5-1211b1e22094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c50da0ef27d1455bbdbab35e820ea5a1'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:58.712866 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-260b0037-47eb-4872-b6f5-1211b1e22094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c50da0ef27d1455bbdbab35e820ea5a1'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:58.727496 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-260b0037-47eb-4872-b6f5-1211b1e22094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c50da0ef27d1455bbdbab35e820ea5a1'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:32:58.745672 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1121/2254] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:32:58 2022] DELETE /identity/v3/users/c50da0ef27d1455bbdbab35e820ea5a1 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:32:58.751674 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50110fc-fd96-4e00-ba17-348cb1919c8a None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:58.752514 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50110fc-fd96-4e00-ba17-348cb1919c8a None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:58.752971 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50110fc-fd96-4e00-ba17-348cb1919c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:58.815845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-e50110fc-fd96-4e00-ba17-348cb1919c8a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:32:58.819716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-e50110fc-fd96-4e00-ba17-348cb1919c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:58.934635 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1134/2255] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:32:58.958692 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b0037-47eb-4872-b6f5-1211b1e22094 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:32:58.960178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-260b0037-47eb-4872-b6f5-1211b1e22094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:32:59.067434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b0037-47eb-4872-b6f5-1211b1e22094 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:32:59.073261 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b499f7-8076-4527-ac93-f8e5ce9028f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:32:59.073784 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b499f7-8076-4527-ac93-f8e5ce9028f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:32:59.074189 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b499f7-8076-4527-ac93-f8e5ce9028f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:32:59.074559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b499f7-8076-4527-ac93-f8e5ce9028f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:32:59.116171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b499f7-8076-4527-ac93-f8e5ce9028f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:32:59.121597 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b499f7-8076-4527-ac93-f8e5ce9028f5 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:32:59.149857 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1122/2256] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:32:59.751740 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:00.108035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50110fc-fd96-4e00-ba17-348cb1919c8a None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:00.110269 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-e50110fc-fd96-4e00-ba17-348cb1919c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:00.126182 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50110fc-fd96-4e00-ba17-348cb1919c8a None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:00.132962 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cead2-d99c-4696-8a72-25a60b7478f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:00.132962 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cead2-d99c-4696-8a72-25a60b7478f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:00.132962 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cead2-d99c-4696-8a72-25a60b7478f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:00.132962 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cead2-d99c-4696-8a72-25a60b7478f0 admin admin] PATH_INFO: `/v3/projects/daa12b60961846d891f0407787dc1e7e` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:00.141128 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cead2-d99c-4696-8a72-25a60b7478f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daa12b60961846d891f0407787dc1e7e)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:00.141128 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cead2-d99c-4696-8a72-25a60b7478f0 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:00.319397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-ae4cead2-d99c-4696-8a72-25a60b7478f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daa12b60961846d891f0407787dc1e7e', 'request_id': 'req-ae4cead2-d99c-4696-8a72-25a60b7478f0'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:00.458563 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-ae4cead2-d99c-4696-8a72-25a60b7478f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daa12b60961846d891f0407787dc1e7e', 'request_id': 'req-ae4cead2-d99c-4696-8a72-25a60b7478f0'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:00.478807 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-ae4cead2-d99c-4696-8a72-25a60b7478f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daa12b60961846d891f0407787dc1e7e', 'request_id': 'req-ae4cead2-d99c-4696-8a72-25a60b7478f0'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:00.514553 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-ae4cead2-d99c-4696-8a72-25a60b7478f0 admin admin] The token cache is being invalidate because project daa12b60961846d891f0407787dc1e7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:33:00.515373 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-ae4cead2-d99c-4696-8a72-25a60b7478f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:00.516396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-ae4cead2-d99c-4696-8a72-25a60b7478f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:00.526059 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1135/2257] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:33:00 2022] DELETE /identity/v3/projects/daa12b60961846d891f0407787dc1e7e => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:00.528080 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b499f7-8076-4527-ac93-f8e5ce9028f5 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:00.555610 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b499f7-8076-4527-ac93-f8e5ce9028f5 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:00.638622 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8025bc-37a0-427d-be03-51a85d2032e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:00.640523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8025bc-37a0-427d-be03-51a85d2032e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:00.641270 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8025bc-37a0-427d-be03-51a85d2032e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:00.641662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8025bc-37a0-427d-be03-51a85d2032e5 admin admin] PATH_INFO: `/v3/users/2e0f771e84034878a2c00148d38bd49f` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:00.643353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8025bc-37a0-427d-be03-51a85d2032e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e0f771e84034878a2c00148d38bd49f)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:00.645656 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8025bc-37a0-427d-be03-51a85d2032e5 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:00.936674 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4a8025bc-37a0-427d-be03-51a85d2032e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e0f771e84034878a2c00148d38bd49f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:00.973965 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4a8025bc-37a0-427d-be03-51a85d2032e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e0f771e84034878a2c00148d38bd49f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:01.093309 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4a8025bc-37a0-427d-be03-51a85d2032e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e0f771e84034878a2c00148d38bd49f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:01.094314 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4a8025bc-37a0-427d-be03-51a85d2032e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e0f771e84034878a2c00148d38bd49f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:01.131970 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4a8025bc-37a0-427d-be03-51a85d2032e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e0f771e84034878a2c00148d38bd49f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:01.168650 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1123/2258] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:33:00 2022] DELETE /identity/v3/users/2e0f771e84034878a2c00148d38bd49f => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:01.499031 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:01.580732 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:02.171368 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c2ba1-c48a-4bed-afdc-dc99b7c5ec4b None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:02.171368 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c2ba1-c48a-4bed-afdc-dc99b7c5ec4b None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:02.171855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c2ba1-c48a-4bed-afdc-dc99b7c5ec4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:02.236939 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-4b7c2ba1-c48a-4bed-afdc-dc99b7c5ec4b None None] MFA Rules not processed for user `39a11b66e3564a0a8bf369242b4318eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:02.238243 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-4b7c2ba1-c48a-4bed-afdc-dc99b7c5ec4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:02.358569 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1136/2259] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:02.364566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8025bc-37a0-427d-be03-51a85d2032e5 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:02.373604 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4a8025bc-37a0-427d-be03-51a85d2032e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:02.499735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8025bc-37a0-427d-be03-51a85d2032e5 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:02.505111 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812687e5-103b-4707-a3e6-287fffc8ccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:02.506489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812687e5-103b-4707-a3e6-287fffc8ccca admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:02.506969 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812687e5-103b-4707-a3e6-287fffc8ccca admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:02.507281 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812687e5-103b-4707-a3e6-287fffc8ccca admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:02.507987 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812687e5-103b-4707-a3e6-287fffc8ccca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:02.510176 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812687e5-103b-4707-a3e6-287fffc8ccca admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:02.574400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c2ba1-c48a-4bed-afdc-dc99b7c5ec4b None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:02.577461 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-4b7c2ba1-c48a-4bed-afdc-dc99b7c5ec4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:02.600983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c2ba1-c48a-4bed-afdc-dc99b7c5ec4b None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:02.622098 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3183d4-0b19-4e01-a65e-a7285cb61b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:02.622098 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3183d4-0b19-4e01-a65e-a7285cb61b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:02.622098 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3183d4-0b19-4e01-a65e-a7285cb61b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:02.625465 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3183d4-0b19-4e01-a65e-a7285cb61b2f admin admin] PATH_INFO: `/v3/projects/d1cd449152384516912995a78ec4c4bf` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:02.630976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3183d4-0b19-4e01-a65e-a7285cb61b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1cd449152384516912995a78ec4c4bf)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:02.633016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3183d4-0b19-4e01-a65e-a7285cb61b2f admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:02.708025 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1124/2260] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:33:02 2022] POST /identity/v3/projects => generated 373 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:02.709190 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812687e5-103b-4707-a3e6-287fffc8ccca admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:02.842010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-df3183d4-0b19-4e01-a65e-a7285cb61b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1cd449152384516912995a78ec4c4bf', 'request_id': 'req-df3183d4-0b19-4e01-a65e-a7285cb61b2f'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:02.910097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812687e5-103b-4707-a3e6-287fffc8ccca admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:02.935151 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-df3183d4-0b19-4e01-a65e-a7285cb61b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1cd449152384516912995a78ec4c4bf', 'request_id': 'req-df3183d4-0b19-4e01-a65e-a7285cb61b2f'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:02.962632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-df3183d4-0b19-4e01-a65e-a7285cb61b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1cd449152384516912995a78ec4c4bf', 'request_id': 'req-df3183d4-0b19-4e01-a65e-a7285cb61b2f'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:03.028914 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-df3183d4-0b19-4e01-a65e-a7285cb61b2f admin admin] The token cache is being invalidate because project d1cd449152384516912995a78ec4c4bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:33:03.035401 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-df3183d4-0b19-4e01-a65e-a7285cb61b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:03.039257 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-df3183d4-0b19-4e01-a65e-a7285cb61b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:03.053111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1137/2261] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:33:02 2022] DELETE /identity/v3/projects/d1cd449152384516912995a78ec4c4bf => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:33:03.065685 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f74ca-281d-487a-ab65-ee63d9410504 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:03.072309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f74ca-281d-487a-ab65-ee63d9410504 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:03.072309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f74ca-281d-487a-ab65-ee63d9410504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:03.157046 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-aa5f74ca-281d-487a-ab65-ee63d9410504 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:03.159759 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-aa5f74ca-281d-487a-ab65-ee63d9410504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:03.169877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212e886-8c71-4f6f-9bc0-346bb14a1e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:03.172357 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212e886-8c71-4f6f-9bc0-346bb14a1e8b admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:03.173734 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212e886-8c71-4f6f-9bc0-346bb14a1e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:03.175277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212e886-8c71-4f6f-9bc0-346bb14a1e8b admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:03.178098 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212e886-8c71-4f6f-9bc0-346bb14a1e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:03.186554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212e886-8c71-4f6f-9bc0-346bb14a1e8b admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:03.189599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1138/2262] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:03.191832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d051b3-723c-4115-87b4-00eeb881ff6b None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:03.192715 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d051b3-723c-4115-87b4-00eeb881ff6b None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:03.192907 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d051b3-723c-4115-87b4-00eeb881ff6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:03.214880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:03.239371 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-07d051b3-723c-4115-87b4-00eeb881ff6b None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:03.241986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-07d051b3-723c-4115-87b4-00eeb881ff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:03.268205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1139/2263] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:03.269891 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d051b3-723c-4115-87b4-00eeb881ff6b None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:03.287678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d051b3-723c-4115-87b4-00eeb881ff6b None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:03.298457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c102d-80ef-45a9-a27c-58fa59551186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:03.299915 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c102d-80ef-45a9-a27c-58fa59551186 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:03.300950 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c102d-80ef-45a9-a27c-58fa59551186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:03.301672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c102d-80ef-45a9-a27c-58fa59551186 admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:03.303578 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c102d-80ef-45a9-a27c-58fa59551186 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:33:03.304452 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c102d-80ef-45a9-a27c-58fa59551186 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:03.310563 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c102d-80ef-45a9-a27c-58fa59551186 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:03.338760 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1125/2264] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:33:02 2022] POST /identity/v3/users => generated 293 bytes in 630 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:03.343493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212e886-8c71-4f6f-9bc0-346bb14a1e8b admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:03.349473 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1140/2265] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:33:03.366035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c102d-80ef-45a9-a27c-58fa59551186 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:03.372751 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-3212e886-8c71-4f6f-9bc0-346bb14a1e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:03.394442 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c102d-80ef-45a9-a27c-58fa59551186 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:03.417422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bee11-0b09-44ee-ab02-d140de6ba4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:03.419534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bee11-0b09-44ee-ab02-d140de6ba4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:03.420344 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bee11-0b09-44ee-ab02-d140de6ba4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:03.422987 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212e886-8c71-4f6f-9bc0-346bb14a1e8b admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:03.423405 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bee11-0b09-44ee-ab02-d140de6ba4f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:03.424604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bee11-0b09-44ee-ab02-d140de6ba4f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:03.427565 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bee11-0b09-44ee-ab02-d140de6ba4f8 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:03.440347 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497f263-a13a-48d0-b338-c3732f034beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:03.440347 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497f263-a13a-48d0-b338-c3732f034beb admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:03.440565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497f263-a13a-48d0-b338-c3732f034beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:03.441059 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497f263-a13a-48d0-b338-c3732f034beb admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:03.443217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497f263-a13a-48d0-b338-c3732f034beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:03.448614 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497f263-a13a-48d0-b338-c3732f034beb admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:03.483473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1126/2266] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:03.488026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb109e0-630c-4192-b55a-b75f4db85aa1 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:03.488981 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb109e0-630c-4192-b55a-b75f4db85aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:03.489466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb109e0-630c-4192-b55a-b75f4db85aa1 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:03.493396 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1127/2267] 10.222.0.83 () {54 vars in 921 bytes} [Fri Sep 23 01:33:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:33:03.494937 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb109e0-630c-4192-b55a-b75f4db85aa1 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:03.521634 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb109e0-630c-4192-b55a-b75f4db85aa1 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:03.529000 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08784be1-c213-46bc-94e7-dbfea06b1dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:03.529788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08784be1-c213-46bc-94e7-dbfea06b1dde admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:03.530253 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08784be1-c213-46bc-94e7-dbfea06b1dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:03.530759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08784be1-c213-46bc-94e7-dbfea06b1dde admin admin] PATH_INFO: `/v3/projects/4f43a57e5f364075941d061e6aef51d7/users/2b2670bafddd408397d16ec8ae031c4d/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:03.586652 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1141/2268] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:33:03 2022] POST /identity/v3/projects => generated 407 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:33:03.590516 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da0c1a-895a-42d7-a498-47ef0f5cbedf None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:03.590914 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da0c1a-895a-42d7-a498-47ef0f5cbedf None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:03.591417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da0c1a-895a-42d7-a498-47ef0f5cbedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:03.638562 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-94da0c1a-895a-42d7-a498-47ef0f5cbedf None None] MFA Rules not processed for user `3eab2cbff5984fa6a8e715ed6553db82`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:03.648367 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-94da0c1a-895a-42d7-a498-47ef0f5cbedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:03.786258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08784be1-c213-46bc-94e7-dbfea06b1dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f43a57e5f364075941d061e6aef51d7, user_id=2b2670bafddd408397d16ec8ae031c4d, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:03.790655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1142/2269] 10.222.0.83 () {58 vars in 1018 bytes} [Fri Sep 23 01:33:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:03.791981 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da0c1a-895a-42d7-a498-47ef0f5cbedf None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:03.794005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08784be1-c213-46bc-94e7-dbfea06b1dde admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:04.068756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da0c1a-895a-42d7-a498-47ef0f5cbedf None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:04.068756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926fa95-dfa1-40fd-8e28-d4ea576dd89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:04.068756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926fa95-dfa1-40fd-8e28-d4ea576dd89f admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:04.068756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926fa95-dfa1-40fd-8e28-d4ea576dd89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:04.069811 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926fa95-dfa1-40fd-8e28-d4ea576dd89f admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:04.069811 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926fa95-dfa1-40fd-8e28-d4ea576dd89f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:04.069811 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926fa95-dfa1-40fd-8e28-d4ea576dd89f admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:04.071419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1128/2270] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:33:03 2022] PUT /identity/v3/projects/4f43a57e5f364075941d061e6aef51d7/users/2b2670bafddd408397d16ec8ae031c4d/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:04.071419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08784be1-c213-46bc-94e7-dbfea06b1dde admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:04.071419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-08784be1-c213-46bc-94e7-dbfea06b1dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:04.138195 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08784be1-c213-46bc-94e7-dbfea06b1dde admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:04.143316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079ea49-6703-468f-9ea8-0adc09056aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:04.143964 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079ea49-6703-468f-9ea8-0adc09056aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:04.144238 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079ea49-6703-468f-9ea8-0adc09056aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:04.144507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079ea49-6703-468f-9ea8-0adc09056aa8 admin admin] PATH_INFO: `/v3/users/9fbdd6c4d635433cbcde1885c20eb287` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:04.145759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079ea49-6703-468f-9ea8-0adc09056aa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fbdd6c4d635433cbcde1885c20eb287)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:04.147821 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079ea49-6703-468f-9ea8-0adc09056aa8 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:04.249396 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:04.261044 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1143/2271] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:33:03 2022] POST /identity/v3/users => generated 304 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:04.262954 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926fa95-dfa1-40fd-8e28-d4ea576dd89f admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:04.265923 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-3926fa95-dfa1-40fd-8e28-d4ea576dd89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:04.296853 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926fa95-dfa1-40fd-8e28-d4ea576dd89f admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:04.426226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defded56-6b59-4553-b7b5-ec78134aae03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eab2cbff5984fa6a8e715ed6553db82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:04.427446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-1079ea49-6703-468f-9ea8-0adc09056aa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fbdd6c4d635433cbcde1885c20eb287'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:04.428166 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defded56-6b59-4553-b7b5-ec78134aae03 service placement] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:04.428324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defded56-6b59-4553-b7b5-ec78134aae03 service placement] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:04.428880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defded56-6b59-4553-b7b5-ec78134aae03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:04.455324 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-1079ea49-6703-468f-9ea8-0adc09056aa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fbdd6c4d635433cbcde1885c20eb287'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:04.457407 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defded56-6b59-4553-b7b5-ec78134aae03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:04.461651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defded56-6b59-4553-b7b5-ec78134aae03 service placement] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:04.488382 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1144/2272] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:33:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:33:04.489458 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defded56-6b59-4553-b7b5-ec78134aae03 service placement] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:04.525412 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defded56-6b59-4553-b7b5-ec78134aae03 service placement] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:04.543332 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d188765-c90f-46dc-9177-404e3596493f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:04.544494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-1079ea49-6703-468f-9ea8-0adc09056aa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fbdd6c4d635433cbcde1885c20eb287'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:04.545396 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-1079ea49-6703-468f-9ea8-0adc09056aa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fbdd6c4d635433cbcde1885c20eb287'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:04.550893 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d188765-c90f-46dc-9177-404e3596493f admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:04.551671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d188765-c90f-46dc-9177-404e3596493f admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:04.552261 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d188765-c90f-46dc-9177-404e3596493f admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:04.553786 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d188765-c90f-46dc-9177-404e3596493f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:04.559449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-1079ea49-6703-468f-9ea8-0adc09056aa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fbdd6c4d635433cbcde1885c20eb287'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:04.564478 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d188765-c90f-46dc-9177-404e3596493f admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:04.583173 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1129/2273] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:33:04 2022] DELETE /identity/v3/users/9fbdd6c4d635433cbcde1885c20eb287 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:04.583173 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079ea49-6703-468f-9ea8-0adc09056aa8 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:04.591924 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-1079ea49-6703-468f-9ea8-0adc09056aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:04.605299 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1145/2274] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:04.606994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d188765-c90f-46dc-9177-404e3596493f admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:04.614114 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-3d188765-c90f-46dc-9177-404e3596493f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:04.646988 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d188765-c90f-46dc-9177-404e3596493f admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:04.829292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecb764-90d7-4405-bf14-30b93a825062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:04.830275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecb764-90d7-4405-bf14-30b93a825062 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:04.832363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecb764-90d7-4405-bf14-30b93a825062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:04.832932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecb764-90d7-4405-bf14-30b93a825062 admin admin] PATH_INFO: `/v3/projects/4f43a57e5f364075941d061e6aef51d7/users/2b2670bafddd408397d16ec8ae031c4d/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:04.838839 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecb764-90d7-4405-bf14-30b93a825062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f43a57e5f364075941d061e6aef51d7, user_id=2b2670bafddd408397d16ec8ae031c4d, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:04.852690 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecb764-90d7-4405-bf14-30b93a825062 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:04.865331 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079ea49-6703-468f-9ea8-0adc09056aa8 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:04.888382 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1146/2275] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:33:04 2022] PUT /identity/v3/projects/4f43a57e5f364075941d061e6aef51d7/users/2b2670bafddd408397d16ec8ae031c4d/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:04.889128 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df34f08-385a-45f4-a7de-4079e6bf9d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:04.889837 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df34f08-385a-45f4-a7de-4079e6bf9d72 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:04.890175 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df34f08-385a-45f4-a7de-4079e6bf9d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:04.890506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df34f08-385a-45f4-a7de-4079e6bf9d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:04.891322 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df34f08-385a-45f4-a7de-4079e6bf9d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:04.893283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df34f08-385a-45f4-a7de-4079e6bf9d72 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:04.915175 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1130/2276] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:04.919840 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecb764-90d7-4405-bf14-30b93a825062 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:05.087955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecb764-90d7-4405-bf14-30b93a825062 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:05.126226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939c44a-9ac6-49e9-8f0a-c2511ffd5ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:05.127244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939c44a-9ac6-49e9-8f0a-c2511ffd5ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:05.127634 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939c44a-9ac6-49e9-8f0a-c2511ffd5ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:05.127880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939c44a-9ac6-49e9-8f0a-c2511ffd5ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:05.129003 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939c44a-9ac6-49e9-8f0a-c2511ffd5ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:05.136315 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939c44a-9ac6-49e9-8f0a-c2511ffd5ac5 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:05.171270 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1147/2277] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:05.176502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df34f08-385a-45f4-a7de-4079e6bf9d72 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:05.209367 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df34f08-385a-45f4-a7de-4079e6bf9d72 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:05.231573 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b7ec2-56f9-4844-a5ac-91d1f90c3b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:05.233670 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b7ec2-56f9-4844-a5ac-91d1f90c3b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:05.233670 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b7ec2-56f9-4844-a5ac-91d1f90c3b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:05.233670 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b7ec2-56f9-4844-a5ac-91d1f90c3b7c admin admin] PATH_INFO: `/v3/projects/1195eac52983420f8cedfc15d6c0c1f1/users/5a267424721f457a80498ce6f54c4e3c/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:05.295499 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b7ec2-56f9-4844-a5ac-91d1f90c3b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1195eac52983420f8cedfc15d6c0c1f1, user_id=5a267424721f457a80498ce6f54c4e3c, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:05.298985 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b7ec2-56f9-4844-a5ac-91d1f90c3b7c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:05.410636 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939c44a-9ac6-49e9-8f0a-c2511ffd5ac5 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:05.413354 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d939c44a-9ac6-49e9-8f0a-c2511ffd5ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:05.441875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1131/2278] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:33:05 2022] PUT /identity/v3/projects/1195eac52983420f8cedfc15d6c0c1f1/users/5a267424721f457a80498ce6f54c4e3c/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:33:05.455056 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab57d6e-dd2d-41da-994c-9a447153d150 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:05.455299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab57d6e-dd2d-41da-994c-9a447153d150 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:05.455641 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab57d6e-dd2d-41da-994c-9a447153d150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:05.456534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939c44a-9ac6-49e9-8f0a-c2511ffd5ac5 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:05.517685 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-4ab57d6e-dd2d-41da-994c-9a447153d150 None None] MFA Rules not processed for user `5a267424721f457a80498ce6f54c4e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:05.519273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4ab57d6e-dd2d-41da-994c-9a447153d150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:05.641691 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d7e98-1124-4c83-84cc-04d47ca69c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:05.643048 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d7e98-1124-4c83-84cc-04d47ca69c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:05.643479 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d7e98-1124-4c83-84cc-04d47ca69c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:05.643969 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d7e98-1124-4c83-84cc-04d47ca69c01 admin admin] PATH_INFO: `/v3/projects/178904b613b548899a222e05ffb970ea` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:05.646460 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d7e98-1124-4c83-84cc-04d47ca69c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=178904b613b548899a222e05ffb970ea)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:05.651464 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d7e98-1124-4c83-84cc-04d47ca69c01 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:05.688933 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1132/2279] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:05 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:33:05.694568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab57d6e-dd2d-41da-994c-9a447153d150 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:05.755112 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab57d6e-dd2d-41da-994c-9a447153d150 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:05.755112 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9c779-0966-4cea-b5c5-fb79ddb3f048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:05.755112 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9c779-0966-4cea-b5c5-fb79ddb3f048 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:05.755112 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9c779-0966-4cea-b5c5-fb79ddb3f048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:05.756656 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9c779-0966-4cea-b5c5-fb79ddb3f048 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:05.756656 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9c779-0966-4cea-b5c5-fb79ddb3f048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:05.756656 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9c779-0966-4cea-b5c5-fb79ddb3f048 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:05.782938 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:05.838959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-787d7e98-1124-4c83-84cc-04d47ca69c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '178904b613b548899a222e05ffb970ea', 'request_id': 'req-787d7e98-1124-4c83-84cc-04d47ca69c01'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:05.889616 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1133/2280] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:33:05 2022] POST /identity/v3/projects => generated 409 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:05.891268 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9c779-0966-4cea-b5c5-fb79ddb3f048 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:05.969367 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-787d7e98-1124-4c83-84cc-04d47ca69c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '178904b613b548899a222e05ffb970ea', 'request_id': 'req-787d7e98-1124-4c83-84cc-04d47ca69c01'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:05.988826 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-787d7e98-1124-4c83-84cc-04d47ca69c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '178904b613b548899a222e05ffb970ea', 'request_id': 'req-787d7e98-1124-4c83-84cc-04d47ca69c01'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:06.010882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:06.025886 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-787d7e98-1124-4c83-84cc-04d47ca69c01 admin admin] The token cache is being invalidate because project 178904b613b548899a222e05ffb970ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:33:06.029114 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-787d7e98-1124-4c83-84cc-04d47ca69c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:06.032646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-787d7e98-1124-4c83-84cc-04d47ca69c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:06.036314 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1148/2281] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:33:05 2022] DELETE /identity/v3/projects/178904b613b548899a222e05ffb970ea => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:33:06.044313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d7e98-1124-4c83-84cc-04d47ca69c01 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:06.046116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-787d7e98-1124-4c83-84cc-04d47ca69c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:06.073810 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9c779-0966-4cea-b5c5-fb79ddb3f048 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:06.082808 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76564aa-c6e3-4eb4-90db-14e415124829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:06.084380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76564aa-c6e3-4eb4-90db-14e415124829 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:06.085293 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76564aa-c6e3-4eb4-90db-14e415124829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:06.085781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76564aa-c6e3-4eb4-90db-14e415124829 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:06.087377 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76564aa-c6e3-4eb4-90db-14e415124829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:06.092215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76564aa-c6e3-4eb4-90db-14e415124829 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:06.236575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d7e98-1124-4c83-84cc-04d47ca69c01 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:06.244117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14cc9b-a562-4ac6-9cc3-53f01c73033e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:06.244810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14cc9b-a562-4ac6-9cc3-53f01c73033e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:06.245110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14cc9b-a562-4ac6-9cc3-53f01c73033e admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:06.245394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14cc9b-a562-4ac6-9cc3-53f01c73033e admin admin] PATH_INFO: `/v3/users/ab240c44ae7e400783133b772473ebc7` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:06.247103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14cc9b-a562-4ac6-9cc3-53f01c73033e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab240c44ae7e400783133b772473ebc7)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:06.250036 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14cc9b-a562-4ac6-9cc3-53f01c73033e admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:06.312476 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1134/2282] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:33:05 2022] POST /identity/v3/users => generated 311 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:06.314998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76564aa-c6e3-4eb4-90db-14e415124829 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:06.320363 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f76564aa-c6e3-4eb4-90db-14e415124829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:06.346049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76564aa-c6e3-4eb4-90db-14e415124829 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:06.369236 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbd7d9-245e-4b3f-868a-29d87d3b92f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:06.372803 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbd7d9-245e-4b3f-868a-29d87d3b92f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:06.373326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbd7d9-245e-4b3f-868a-29d87d3b92f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:06.373822 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbd7d9-245e-4b3f-868a-29d87d3b92f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:06.375123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbd7d9-245e-4b3f-868a-29d87d3b92f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:06.378832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbd7d9-245e-4b3f-868a-29d87d3b92f6 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:06.410686 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1135/2283] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:06.419192 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbd7d9-245e-4b3f-868a-29d87d3b92f6 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:06.438228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbd7d9-245e-4b3f-868a-29d87d3b92f6 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:06.448320 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc205bc-807a-46b7-b682-60ff3e17659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:06.450427 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc205bc-807a-46b7-b682-60ff3e17659a admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:06.450981 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc205bc-807a-46b7-b682-60ff3e17659a admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:06.451338 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc205bc-807a-46b7-b682-60ff3e17659a admin admin] PATH_INFO: `/v3/projects/770f6a8f9ef24762a1d49afbb9ade9db/users/4b373c11300e4243a93637a610cc0aac/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:06.500585 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc205bc-807a-46b7-b682-60ff3e17659a admin admin] RBAC: Authorizing `identity:create_grant(project_id=770f6a8f9ef24762a1d49afbb9ade9db, user_id=4b373c11300e4243a93637a610cc0aac, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:06.507669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc205bc-807a-46b7-b682-60ff3e17659a admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:06.585087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-cf14cc9b-a562-4ac6-9cc3-53f01c73033e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab240c44ae7e400783133b772473ebc7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:06.672887 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1136/2284] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:33:06 2022] PUT /identity/v3/projects/770f6a8f9ef24762a1d49afbb9ade9db/users/4b373c11300e4243a93637a610cc0aac/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:06.685694 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc205bc-807a-46b7-b682-60ff3e17659a admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:06.693468 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-cf14cc9b-a562-4ac6-9cc3-53f01c73033e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab240c44ae7e400783133b772473ebc7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:06.695934 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-cf14cc9b-a562-4ac6-9cc3-53f01c73033e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab240c44ae7e400783133b772473ebc7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:06.720955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-cf14cc9b-a562-4ac6-9cc3-53f01c73033e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab240c44ae7e400783133b772473ebc7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:06.722794 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-cf14cc9b-a562-4ac6-9cc3-53f01c73033e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab240c44ae7e400783133b772473ebc7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:06.784930 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1149/2285] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:33:06 2022] DELETE /identity/v3/users/ab240c44ae7e400783133b772473ebc7 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:06.868359 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc205bc-807a-46b7-b682-60ff3e17659a admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:06.983139 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:07.091488 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eca614-7b40-4ab7-83d5-1f00f550a2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:07.092440 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eca614-7b40-4ab7-83d5-1f00f550a2be admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:07.092917 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eca614-7b40-4ab7-83d5-1f00f550a2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:07.093231 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eca614-7b40-4ab7-83d5-1f00f550a2be admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:07.093995 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eca614-7b40-4ab7-83d5-1f00f550a2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:07.101887 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eca614-7b40-4ab7-83d5-1f00f550a2be admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:07.130414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1137/2286] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:33:07.134834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14cc9b-a562-4ac6-9cc3-53f01c73033e admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:07.140170 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-cf14cc9b-a562-4ac6-9cc3-53f01c73033e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:07.181460 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14cc9b-a562-4ac6-9cc3-53f01c73033e admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:07.203518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b41e1f-286d-42b4-8079-8b8f595f9600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:07.208454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b41e1f-286d-42b4-8079-8b8f595f9600 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:07.209359 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b41e1f-286d-42b4-8079-8b8f595f9600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:07.210310 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b41e1f-286d-42b4-8079-8b8f595f9600 admin admin] PATH_INFO: `/v3/projects/770f6a8f9ef24762a1d49afbb9ade9db/users/4b373c11300e4243a93637a610cc0aac/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:07.213638 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b41e1f-286d-42b4-8079-8b8f595f9600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=770f6a8f9ef24762a1d49afbb9ade9db, user_id=4b373c11300e4243a93637a610cc0aac, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:07.224669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b41e1f-286d-42b4-8079-8b8f595f9600 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:07.259699 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1150/2287] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:33:07 2022] PUT /identity/v3/projects/770f6a8f9ef24762a1d49afbb9ade9db/users/4b373c11300e4243a93637a610cc0aac/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:07.290272 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85efd4d-c245-496c-92ec-db263a547589 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:07.290697 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85efd4d-c245-496c-92ec-db263a547589 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:07.291067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85efd4d-c245-496c-92ec-db263a547589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:07.374942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-c85efd4d-c245-496c-92ec-db263a547589 None None] MFA Rules not processed for user `4b373c11300e4243a93637a610cc0aac`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:07.377090 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-c85efd4d-c245-496c-92ec-db263a547589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:07.591185 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b41e1f-286d-42b4-8079-8b8f595f9600 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:07.595486 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-46b41e1f-286d-42b4-8079-8b8f595f9600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:07.597478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1138/2288] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:07 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:07.617190 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85efd4d-c245-496c-92ec-db263a547589 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:07.618965 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-c85efd4d-c245-496c-92ec-db263a547589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:07.808393 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85efd4d-c245-496c-92ec-db263a547589 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:07.822640 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b41e1f-286d-42b4-8079-8b8f595f9600 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:07.827613 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a07403-8b04-4dc4-bf3a-94506684e08c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:07.828751 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a07403-8b04-4dc4-bf3a-94506684e08c service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:07.829117 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a07403-8b04-4dc4-bf3a-94506684e08c service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:07.829541 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a07403-8b04-4dc4-bf3a-94506684e08c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:07.836922 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347f6b2-60d7-4d87-861f-21bfefbd879c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:07.838354 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347f6b2-60d7-4d87-861f-21bfefbd879c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:07.838953 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347f6b2-60d7-4d87-861f-21bfefbd879c admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:07.840212 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347f6b2-60d7-4d87-861f-21bfefbd879c admin admin] PATH_INFO: `/v3/projects/8ef9d5c765bf4881a7198ec6b0660db1` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:07.842835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347f6b2-60d7-4d87-861f-21bfefbd879c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ef9d5c765bf4881a7198ec6b0660db1)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:07.847242 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347f6b2-60d7-4d87-861f-21bfefbd879c admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:07.863739 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a07403-8b04-4dc4-bf3a-94506684e08c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:07.867339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a07403-8b04-4dc4-bf3a-94506684e08c service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:07.891215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1139/2289] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:33:07 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:33:08.135891 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d347f6b2-60d7-4d87-861f-21bfefbd879c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ef9d5c765bf4881a7198ec6b0660db1', 'request_id': 'req-d347f6b2-60d7-4d87-861f-21bfefbd879c'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:08.281396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d347f6b2-60d7-4d87-861f-21bfefbd879c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ef9d5c765bf4881a7198ec6b0660db1', 'request_id': 'req-d347f6b2-60d7-4d87-861f-21bfefbd879c'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:08.290885 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d347f6b2-60d7-4d87-861f-21bfefbd879c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ef9d5c765bf4881a7198ec6b0660db1', 'request_id': 'req-d347f6b2-60d7-4d87-861f-21bfefbd879c'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:08.315557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d347f6b2-60d7-4d87-861f-21bfefbd879c admin admin] The token cache is being invalidate because project 8ef9d5c765bf4881a7198ec6b0660db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:33:08.318397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d347f6b2-60d7-4d87-861f-21bfefbd879c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:08.320025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d347f6b2-60d7-4d87-861f-21bfefbd879c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:08.328569 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1151/2290] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:33:07 2022] DELETE /identity/v3/projects/8ef9d5c765bf4881a7198ec6b0660db1 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:33:08.330901 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41a694-124d-4f63-9e3e-64a567ece217 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:08.331514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41a694-124d-4f63-9e3e-64a567ece217 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:08.332051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41a694-124d-4f63-9e3e-64a567ece217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:08.399787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-cf41a694-124d-4f63-9e3e-64a567ece217 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:08.402358 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-cf41a694-124d-4f63-9e3e-64a567ece217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:08.570685 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6402a-fe15-46cc-a19a-461db1ab75fa None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:08.571911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6402a-fe15-46cc-a19a-461db1ab75fa None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:08.578165 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6402a-fe15-46cc-a19a-461db1ab75fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:08.583093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1140/2291] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:08.627079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-76d6402a-fe15-46cc-a19a-461db1ab75fa None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:08.630109 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-76d6402a-fe15-46cc-a19a-461db1ab75fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:08.651768 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1152/2292] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:08.658314 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41a694-124d-4f63-9e3e-64a567ece217 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:08.675673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6402a-fe15-46cc-a19a-461db1ab75fa None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:08.680304 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-76d6402a-fe15-46cc-a19a-461db1ab75fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:08.696592 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41a694-124d-4f63-9e3e-64a567ece217 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:08.707684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae71441-158f-49b9-9a73-708361d063ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:08.708761 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae71441-158f-49b9-9a73-708361d063ba admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:08.709325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae71441-158f-49b9-9a73-708361d063ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:08.709793 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae71441-158f-49b9-9a73-708361d063ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:08.711282 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae71441-158f-49b9-9a73-708361d063ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:33:08.711985 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae71441-158f-49b9-9a73-708361d063ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:08.716117 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae71441-158f-49b9-9a73-708361d063ba admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:08.743888 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1141/2293] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:33:08.751809 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae71441-158f-49b9-9a73-708361d063ba admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:08.786690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae71441-158f-49b9-9a73-708361d063ba admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:08.808079 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cda22-c71f-49d9-afd4-183f3b921de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:08.809737 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cda22-c71f-49d9-afd4-183f3b921de3 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:08.810376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cda22-c71f-49d9-afd4-183f3b921de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:08.811178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cda22-c71f-49d9-afd4-183f3b921de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:08.813388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cda22-c71f-49d9-afd4-183f3b921de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:08.819255 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cda22-c71f-49d9-afd4-183f3b921de3 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:08.916378 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6402a-fe15-46cc-a19a-461db1ab75fa None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:08.925263 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa27450-fbb9-49a2-b854-1ed335aa2a21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:08.926737 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa27450-fbb9-49a2-b854-1ed335aa2a21 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:08.927026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa27450-fbb9-49a2-b854-1ed335aa2a21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:08.927809 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa27450-fbb9-49a2-b854-1ed335aa2a21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:08.931924 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-5fa27450-fbb9-49a2-b854-1ed335aa2a21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:09.003566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1142/2294] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:33:08 2022] POST /identity/v3/projects => generated 361 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:09.009954 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cda22-c71f-49d9-afd4-183f3b921de3 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:09.020406 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:09.133977 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa27450-fbb9-49a2-b854-1ed335aa2a21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:09.139572 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa27450-fbb9-49a2-b854-1ed335aa2a21 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:09.182234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1153/2295] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:33:08 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:33:09.223544 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cda22-c71f-49d9-afd4-183f3b921de3 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:09.229602 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493dc5a-f5f3-4b82-88bd-bf7b99da76e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:09.230294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493dc5a-f5f3-4b82-88bd-bf7b99da76e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:09.230576 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493dc5a-f5f3-4b82-88bd-bf7b99da76e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:09.230964 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493dc5a-f5f3-4b82-88bd-bf7b99da76e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:09.231800 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493dc5a-f5f3-4b82-88bd-bf7b99da76e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:09.234892 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493dc5a-f5f3-4b82-88bd-bf7b99da76e9 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:09.407869 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1143/2296] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:33:09 2022] POST /identity/v3/users => generated 281 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:09.409163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:09.413275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa27450-fbb9-49a2-b854-1ed335aa2a21 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:09.448403 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa27450-fbb9-49a2-b854-1ed335aa2a21 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:09.473402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974a33e-9313-41c3-be22-98e2c5c8ad7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:09.476834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974a33e-9313-41c3-be22-98e2c5c8ad7c admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:09.477767 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974a33e-9313-41c3-be22-98e2c5c8ad7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:09.480997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974a33e-9313-41c3-be22-98e2c5c8ad7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:09.482296 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974a33e-9313-41c3-be22-98e2c5c8ad7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:09.488831 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974a33e-9313-41c3-be22-98e2c5c8ad7c admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:09.505838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1154/2297] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:09.511144 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493dc5a-f5f3-4b82-88bd-bf7b99da76e9 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:09.539997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493dc5a-f5f3-4b82-88bd-bf7b99da76e9 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:09.553293 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178792a-d351-492e-b168-594e2e698845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:09.556951 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178792a-d351-492e-b168-594e2e698845 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:09.558332 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178792a-d351-492e-b168-594e2e698845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:09.560272 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178792a-d351-492e-b168-594e2e698845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:09.562542 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178792a-d351-492e-b168-594e2e698845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:09.570301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178792a-d351-492e-b168-594e2e698845 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:09.595659 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1144/2298] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:09.600887 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974a33e-9313-41c3-be22-98e2c5c8ad7c admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:09.638077 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974a33e-9313-41c3-be22-98e2c5c8ad7c admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:09.655667 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe15e02-c101-4949-b64b-ab6c914a4cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:09.656457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe15e02-c101-4949-b64b-ab6c914a4cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:09.656975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe15e02-c101-4949-b64b-ab6c914a4cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:09.657432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe15e02-c101-4949-b64b-ab6c914a4cc1 admin admin] PATH_INFO: `/v3/projects/9176c879f533417b86879d23fcbcdba6/users/4f8669450309468ca97e63ac342feed8/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:09.685445 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe15e02-c101-4949-b64b-ab6c914a4cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9176c879f533417b86879d23fcbcdba6, user_id=4f8669450309468ca97e63ac342feed8, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:09.689495 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe15e02-c101-4949-b64b-ab6c914a4cc1 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:09.840528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1155/2299] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:33:09 2022] PUT /identity/v3/projects/9176c879f533417b86879d23fcbcdba6/users/4f8669450309468ca97e63ac342feed8/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:09.853983 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d63e2-4eb0-4254-a6d5-5e76caf5c639 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:09.854942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d63e2-4eb0-4254-a6d5-5e76caf5c639 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:09.854942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d63e2-4eb0-4254-a6d5-5e76caf5c639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:09.910475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-6e3d63e2-4eb0-4254-a6d5-5e76caf5c639 None None] MFA Rules not processed for user `4f8669450309468ca97e63ac342feed8`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:09.912782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6e3d63e2-4eb0-4254-a6d5-5e76caf5c639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:10.128860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1145/2300] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:10.202657 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:10.208006 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe15e02-c101-4949-b64b-ab6c914a4cc1 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:10.212895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-5fe15e02-c101-4949-b64b-ab6c914a4cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:10.365924 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe15e02-c101-4949-b64b-ab6c914a4cc1 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:10.374349 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d8d87-ec48-4b37-b2d5-d9b6fac33563 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:10.375628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d8d87-ec48-4b37-b2d5-d9b6fac33563 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:10.376081 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d8d87-ec48-4b37-b2d5-d9b6fac33563 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:10.376553 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d8d87-ec48-4b37-b2d5-d9b6fac33563 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:10.401640 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d8d87-ec48-4b37-b2d5-d9b6fac33563 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:10.402060 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d8d87-ec48-4b37-b2d5-d9b6fac33563 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:10.422957 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1156/2301] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:33:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:33:10.468403 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d63e2-4eb0-4254-a6d5-5e76caf5c639 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:10.545876 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:10.631514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d63e2-4eb0-4254-a6d5-5e76caf5c639 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:10.643536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312962a-d278-414a-aa7d-7f7ec10a7222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:10.645006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312962a-d278-414a-aa7d-7f7ec10a7222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:10.645649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312962a-d278-414a-aa7d-7f7ec10a7222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:10.646288 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312962a-d278-414a-aa7d-7f7ec10a7222 admin admin] PATH_INFO: `/v3/users/4f8669450309468ca97e63ac342feed8` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:10.650640 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312962a-d278-414a-aa7d-7f7ec10a7222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f8669450309468ca97e63ac342feed8)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:10.654150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312962a-d278-414a-aa7d-7f7ec10a7222 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:11.042921 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4312962a-d278-414a-aa7d-7f7ec10a7222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f8669450309468ca97e63ac342feed8'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:11.070445 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4312962a-d278-414a-aa7d-7f7ec10a7222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f8669450309468ca97e63ac342feed8'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:11.202090 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4312962a-d278-414a-aa7d-7f7ec10a7222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f8669450309468ca97e63ac342feed8'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:11.203318 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4312962a-d278-414a-aa7d-7f7ec10a7222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f8669450309468ca97e63ac342feed8'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:11.250912 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4312962a-d278-414a-aa7d-7f7ec10a7222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f8669450309468ca97e63ac342feed8'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:11.282031 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1146/2302] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:33:10 2022] DELETE /identity/v3/users/4f8669450309468ca97e63ac342feed8 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:11.289872 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30acb12-82dc-43e0-a32e-548c8c8e0b87 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:11.290855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30acb12-82dc-43e0-a32e-548c8c8e0b87 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:11.290966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30acb12-82dc-43e0-a32e-548c8c8e0b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:11.368471 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-c30acb12-82dc-43e0-a32e-548c8c8e0b87 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:11.370917 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-c30acb12-82dc-43e0-a32e-548c8c8e0b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:11.554876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1157/2303] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:11.573768 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312962a-d278-414a-aa7d-7f7ec10a7222 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:11.576768 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4312962a-d278-414a-aa7d-7f7ec10a7222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:11.790461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312962a-d278-414a-aa7d-7f7ec10a7222 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:11.832965 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f9529-8f92-4f36-a2d8-c64f1eb1ddd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:11.834400 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f9529-8f92-4f36-a2d8-c64f1eb1ddd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:11.835430 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f9529-8f92-4f36-a2d8-c64f1eb1ddd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:11.838631 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f9529-8f92-4f36-a2d8-c64f1eb1ddd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:11.884212 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:11.899803 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f9529-8f92-4f36-a2d8-c64f1eb1ddd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:11.903745 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f9529-8f92-4f36-a2d8-c64f1eb1ddd5 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:11.948879 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1147/2304] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:33:12.169341 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:13.036745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30acb12-82dc-43e0-a32e-548c8c8e0b87 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:13.039814 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-c30acb12-82dc-43e0-a32e-548c8c8e0b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:13.067665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30acb12-82dc-43e0-a32e-548c8c8e0b87 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:13.082326 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24179cf7-0d75-4278-9edc-4b7846354f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:13.083092 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24179cf7-0d75-4278-9edc-4b7846354f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:13.083376 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24179cf7-0d75-4278-9edc-4b7846354f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:13.083660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24179cf7-0d75-4278-9edc-4b7846354f83 admin admin] PATH_INFO: `/v3/projects/9176c879f533417b86879d23fcbcdba6` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:13.085331 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24179cf7-0d75-4278-9edc-4b7846354f83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9176c879f533417b86879d23fcbcdba6)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:13.088862 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24179cf7-0d75-4278-9edc-4b7846354f83 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:13.380085 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-24179cf7-0d75-4278-9edc-4b7846354f83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9176c879f533417b86879d23fcbcdba6', 'request_id': 'req-24179cf7-0d75-4278-9edc-4b7846354f83'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:13.471258 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-24179cf7-0d75-4278-9edc-4b7846354f83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9176c879f533417b86879d23fcbcdba6', 'request_id': 'req-24179cf7-0d75-4278-9edc-4b7846354f83'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:13.533753 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-24179cf7-0d75-4278-9edc-4b7846354f83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9176c879f533417b86879d23fcbcdba6', 'request_id': 'req-24179cf7-0d75-4278-9edc-4b7846354f83'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:13.576834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:13.585394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-24179cf7-0d75-4278-9edc-4b7846354f83 admin admin] The token cache is being invalidate because project 9176c879f533417b86879d23fcbcdba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:33:13.586621 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-24179cf7-0d75-4278-9edc-4b7846354f83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:13.587533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-24179cf7-0d75-4278-9edc-4b7846354f83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:13.594349 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1158/2305] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:33:13 2022] DELETE /identity/v3/projects/9176c879f533417b86879d23fcbcdba6 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:13.597444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ce6af-44d5-4c5a-ae5d-aee8345993e4 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:13.599599 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ce6af-44d5-4c5a-ae5d-aee8345993e4 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:13.600064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ce6af-44d5-4c5a-ae5d-aee8345993e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:13.655442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-524ce6af-44d5-4c5a-ae5d-aee8345993e4 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:13.659387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-524ce6af-44d5-4c5a-ae5d-aee8345993e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:13.732671 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:13.805678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1148/2306] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:13.821427 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584445b-a000-4a92-9814-eedd7a54bd2c None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:13.821990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584445b-a000-4a92-9814-eedd7a54bd2c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:13.822335 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584445b-a000-4a92-9814-eedd7a54bd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:13.869286 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-0584445b-a000-4a92-9814-eedd7a54bd2c None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:13.871420 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-0584445b-a000-4a92-9814-eedd7a54bd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:13.888963 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1159/2307] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:13.892657 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ce6af-44d5-4c5a-ae5d-aee8345993e4 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:13.986718 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ce6af-44d5-4c5a-ae5d-aee8345993e4 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:14.006626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e374ff-3dab-4edd-83ac-9cd6d9120203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:14.006921 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e374ff-3dab-4edd-83ac-9cd6d9120203 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:14.009505 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e374ff-3dab-4edd-83ac-9cd6d9120203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:14.009505 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e374ff-3dab-4edd-83ac-9cd6d9120203 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:14.009505 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e374ff-3dab-4edd-83ac-9cd6d9120203 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:33:14.012142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e374ff-3dab-4edd-83ac-9cd6d9120203 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:14.021498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e374ff-3dab-4edd-83ac-9cd6d9120203 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:14.075240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1149/2308] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:33:14.081001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584445b-a000-4a92-9814-eedd7a54bd2c None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:14.101819 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584445b-a000-4a92-9814-eedd7a54bd2c None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:14.112533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b98d6b-4556-47b8-9c04-e8d14a05b946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:14.114889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b98d6b-4556-47b8-9c04-e8d14a05b946 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:14.115445 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b98d6b-4556-47b8-9c04-e8d14a05b946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:14.115913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b98d6b-4556-47b8-9c04-e8d14a05b946 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:14.116952 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b98d6b-4556-47b8-9c04-e8d14a05b946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:14.121666 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b98d6b-4556-47b8-9c04-e8d14a05b946 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:14.526532 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1160/2309] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:33:14 2022] POST /identity/v3/projects => generated 385 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:14.531793 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e374ff-3dab-4edd-83ac-9cd6d9120203 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:14.581606 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e374ff-3dab-4edd-83ac-9cd6d9120203 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:14.752256 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f8319-de52-4cc0-8601-5f6ad7d3eb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:14.756222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f8319-de52-4cc0-8601-5f6ad7d3eb70 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:14.756222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f8319-de52-4cc0-8601-5f6ad7d3eb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:14.756222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f8319-de52-4cc0-8601-5f6ad7d3eb70 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:14.756222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f8319-de52-4cc0-8601-5f6ad7d3eb70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:14.760531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f8319-de52-4cc0-8601-5f6ad7d3eb70 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:14.936136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1150/2310] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:33:14 2022] POST /identity/v3/users => generated 293 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:33:14.940660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b98d6b-4556-47b8-9c04-e8d14a05b946 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:14.956447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b98d6b-4556-47b8-9c04-e8d14a05b946 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:14.963140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd337bbd-4efc-48b9-a3c6-0f0f4f0d97be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:14.964087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd337bbd-4efc-48b9-a3c6-0f0f4f0d97be admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:14.965067 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd337bbd-4efc-48b9-a3c6-0f0f4f0d97be admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:14.965573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd337bbd-4efc-48b9-a3c6-0f0f4f0d97be admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:14.966674 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd337bbd-4efc-48b9-a3c6-0f0f4f0d97be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:14.969249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd337bbd-4efc-48b9-a3c6-0f0f4f0d97be admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:14.984838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1161/2311] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:33:14.990368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f8319-de52-4cc0-8601-5f6ad7d3eb70 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:15.012734 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f8319-de52-4cc0-8601-5f6ad7d3eb70 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:15.022407 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524f273-d308-48a7-bf37-9699bcb4ca08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:15.023674 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524f273-d308-48a7-bf37-9699bcb4ca08 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:15.024259 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524f273-d308-48a7-bf37-9699bcb4ca08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:15.024816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524f273-d308-48a7-bf37-9699bcb4ca08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:15.026017 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524f273-d308-48a7-bf37-9699bcb4ca08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:15.029185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524f273-d308-48a7-bf37-9699bcb4ca08 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:15.048060 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1151/2312] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:15.054630 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd337bbd-4efc-48b9-a3c6-0f0f4f0d97be admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:15.072782 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd337bbd-4efc-48b9-a3c6-0f0f4f0d97be admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:15.097945 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68141cf8-0a78-4e88-97ca-d0a0aa472568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:15.097945 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68141cf8-0a78-4e88-97ca-d0a0aa472568 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:15.097945 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68141cf8-0a78-4e88-97ca-d0a0aa472568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:15.097945 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68141cf8-0a78-4e88-97ca-d0a0aa472568 admin admin] PATH_INFO: `/v3/projects/58f1eed4e72f40bda4929c01e5249bc3/users/3c012c9c27494994826c728d92476db3/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:15.130940 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68141cf8-0a78-4e88-97ca-d0a0aa472568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f1eed4e72f40bda4929c01e5249bc3, user_id=3c012c9c27494994826c728d92476db3, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:15.134428 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68141cf8-0a78-4e88-97ca-d0a0aa472568 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:15.288050 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1162/2313] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:33:15 2022] PUT /identity/v3/projects/58f1eed4e72f40bda4929c01e5249bc3/users/3c012c9c27494994826c728d92476db3/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:33:15.299443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc15e14-f6f1-4d53-994b-ec6dc3cac30b None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:15.299715 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc15e14-f6f1-4d53-994b-ec6dc3cac30b None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:15.299990 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc15e14-f6f1-4d53-994b-ec6dc3cac30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:15.347460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-0cc15e14-f6f1-4d53-994b-ec6dc3cac30b None None] MFA Rules not processed for user `3c012c9c27494994826c728d92476db3`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:15.347460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-0cc15e14-f6f1-4d53-994b-ec6dc3cac30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:15.454738 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1152/2314] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:15.455906 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68141cf8-0a78-4e88-97ca-d0a0aa472568 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:15.558826 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68141cf8-0a78-4e88-97ca-d0a0aa472568 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:15.564185 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79eac96-9af1-48b9-b897-db0bf98fcdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:15.564921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eac96-9af1-48b9-b897-db0bf98fcdc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:15.565202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eac96-9af1-48b9-b897-db0bf98fcdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:15.565479 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eac96-9af1-48b9-b897-db0bf98fcdc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:15.566157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79eac96-9af1-48b9-b897-db0bf98fcdc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:15.568312 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79eac96-9af1-48b9-b897-db0bf98fcdc1 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:15.782911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1163/2315] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:33:15 2022] POST /identity/v3/projects => generated 383 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:15.791561 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc15e14-f6f1-4d53-994b-ec6dc3cac30b None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:15.814924 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc15e14-f6f1-4d53-994b-ec6dc3cac30b None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:15.950076 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480dbf9-58e0-4c2a-b439-753dde525e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:15.952549 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480dbf9-58e0-4c2a-b439-753dde525e41 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:15.952756 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480dbf9-58e0-4c2a-b439-753dde525e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:15.953038 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480dbf9-58e0-4c2a-b439-753dde525e41 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:15.954387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480dbf9-58e0-4c2a-b439-753dde525e41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:15.957937 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480dbf9-58e0-4c2a-b439-753dde525e41 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:16.086763 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1153/2316] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:33:15 2022] POST /identity/v3/users => generated 292 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:16.087287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79eac96-9af1-48b9-b897-db0bf98fcdc1 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:16.103134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79eac96-9af1-48b9-b897-db0bf98fcdc1 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:16.110551 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a374c7-2402-4085-a2a3-8545a347a9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:16.111496 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a374c7-2402-4085-a2a3-8545a347a9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:16.111902 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a374c7-2402-4085-a2a3-8545a347a9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:16.112315 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a374c7-2402-4085-a2a3-8545a347a9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:16.113118 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a374c7-2402-4085-a2a3-8545a347a9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:16.115175 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a374c7-2402-4085-a2a3-8545a347a9f0 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:16.132085 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1164/2317] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:33:16.141704 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480dbf9-58e0-4c2a-b439-753dde525e41 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:16.163891 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480dbf9-58e0-4c2a-b439-753dde525e41 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:16.187519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2867c79-b4a8-4bef-b20d-ff39d2be1ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:16.187519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2867c79-b4a8-4bef-b20d-ff39d2be1ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:16.188300 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2867c79-b4a8-4bef-b20d-ff39d2be1ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:16.188725 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2867c79-b4a8-4bef-b20d-ff39d2be1ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:16.189667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2867c79-b4a8-4bef-b20d-ff39d2be1ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:16.192421 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2867c79-b4a8-4bef-b20d-ff39d2be1ce3 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:16.208018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1154/2318] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:16.215711 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a374c7-2402-4085-a2a3-8545a347a9f0 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:16.239135 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a374c7-2402-4085-a2a3-8545a347a9f0 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:16.262122 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e5dbe-c315-4440-9968-19b6904d9b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:16.264276 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e5dbe-c315-4440-9968-19b6904d9b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:16.268234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e5dbe-c315-4440-9968-19b6904d9b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:16.272196 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e5dbe-c315-4440-9968-19b6904d9b75 admin admin] PATH_INFO: `/v3/projects/e84b04461df84544bfd3bf95942b3aec/users/d90b6db2a68e4dbd865da6f24d015e68/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:16.320558 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e5dbe-c315-4440-9968-19b6904d9b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84b04461df84544bfd3bf95942b3aec, user_id=d90b6db2a68e4dbd865da6f24d015e68, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:16.325896 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e5dbe-c315-4440-9968-19b6904d9b75 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:16.485299 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1165/2319] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:33:16 2022] PUT /identity/v3/projects/e84b04461df84544bfd3bf95942b3aec/users/d90b6db2a68e4dbd865da6f24d015e68/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:16.502003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b762c-2db8-4316-a29f-c34c8efe5cc2 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:16.502570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b762c-2db8-4316-a29f-c34c8efe5cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:16.503148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b762c-2db8-4316-a29f-c34c8efe5cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:16.560178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-968b762c-2db8-4316-a29f-c34c8efe5cc2 None None] MFA Rules not processed for user `d90b6db2a68e4dbd865da6f24d015e68`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:16.560178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-968b762c-2db8-4316-a29f-c34c8efe5cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:16.704101 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1155/2320] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:16.710869 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e5dbe-c315-4440-9968-19b6904d9b75 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:16.853503 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:16.969075 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e5dbe-c315-4440-9968-19b6904d9b75 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:16.990807 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51165a-0530-4f31-bcb0-448057c49db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:16.991903 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51165a-0530-4f31-bcb0-448057c49db7 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:16.992416 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51165a-0530-4f31-bcb0-448057c49db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:16.992926 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51165a-0530-4f31-bcb0-448057c49db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:16.994743 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51165a-0530-4f31-bcb0-448057c49db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:17.006958 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51165a-0530-4f31-bcb0-448057c49db7 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:17.192527 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1166/2321] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:33:16 2022] POST /identity/v3/projects => generated 383 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:33:17.197304 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b762c-2db8-4316-a29f-c34c8efe5cc2 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:17.224022 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b762c-2db8-4316-a29f-c34c8efe5cc2 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:17.236664 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:17.328738 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9e282-a4df-46d1-aeee-da26d828b648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:17.329601 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9e282-a4df-46d1-aeee-da26d828b648 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:17.329601 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9e282-a4df-46d1-aeee-da26d828b648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:17.329848 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9e282-a4df-46d1-aeee-da26d828b648 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:17.330511 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9e282-a4df-46d1-aeee-da26d828b648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:17.332692 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9e282-a4df-46d1-aeee-da26d828b648 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:17.382549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030f62c-14cf-4fd5-b24c-cb67be7d492d None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:17.383107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030f62c-14cf-4fd5-b24c-cb67be7d492d None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:17.383585 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030f62c-14cf-4fd5-b24c-cb67be7d492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:17.436590 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-a030f62c-14cf-4fd5-b24c-cb67be7d492d None None] MFA Rules not processed for user `2b2670bafddd408397d16ec8ae031c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:17.438335 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a030f62c-14cf-4fd5-b24c-cb67be7d492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:17.493244 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1156/2322] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:33:17 2022] POST /identity/v3/users => generated 298 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:17.499146 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9e282-a4df-46d1-aeee-da26d828b648 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:17.515307 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9e282-a4df-46d1-aeee-da26d828b648 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:17.529959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bea822-3acc-4d32-99d0-d2896ddc4183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:17.530989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bea822-3acc-4d32-99d0-d2896ddc4183 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:17.531784 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bea822-3acc-4d32-99d0-d2896ddc4183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:17.532635 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bea822-3acc-4d32-99d0-d2896ddc4183 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:17.533649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bea822-3acc-4d32-99d0-d2896ddc4183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:17.537074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bea822-3acc-4d32-99d0-d2896ddc4183 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:17.555482 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1157/2323] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:17.561664 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bea822-3acc-4d32-99d0-d2896ddc4183 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:17.577345 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bea822-3acc-4d32-99d0-d2896ddc4183 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:17.590973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaeed41-6c1b-459b-8400-4a2456272acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:17.592226 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaeed41-6c1b-459b-8400-4a2456272acf admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:17.592516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaeed41-6c1b-459b-8400-4a2456272acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:17.592807 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaeed41-6c1b-459b-8400-4a2456272acf admin admin] PATH_INFO: `/v3/projects/3f26a5938556468da708099a57b50b22/users/f74f0b86ef2f4a55830bdbc0ed618536/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:17.612730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1167/2324] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:17.629695 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaeed41-6c1b-459b-8400-4a2456272acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f26a5938556468da708099a57b50b22, user_id=f74f0b86ef2f4a55830bdbc0ed618536, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:17.634852 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaeed41-6c1b-459b-8400-4a2456272acf admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:17.646756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030f62c-14cf-4fd5-b24c-cb67be7d492d None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:17.650650 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a030f62c-14cf-4fd5-b24c-cb67be7d492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:17.748012 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1158/2325] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:33:17 2022] PUT /identity/v3/projects/3f26a5938556468da708099a57b50b22/users/f74f0b86ef2f4a55830bdbc0ed618536/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:17.759380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaeed41-6c1b-459b-8400-4a2456272acf admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:17.920393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030f62c-14cf-4fd5-b24c-cb67be7d492d None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:18.016486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaeed41-6c1b-459b-8400-4a2456272acf admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:18.025135 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30336ed9-245c-41fe-9f74-d6204819cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:18.025811 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30336ed9-245c-41fe-9f74-d6204819cd79 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:18.026135 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30336ed9-245c-41fe-9f74-d6204819cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:18.026463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30336ed9-245c-41fe-9f74-d6204819cd79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:18.027898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30336ed9-245c-41fe-9f74-d6204819cd79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:18.029843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30336ed9-245c-41fe-9f74-d6204819cd79 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:18.046847 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1159/2326] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:18.048370 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30336ed9-245c-41fe-9f74-d6204819cd79 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:18.058379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe62ce1-8b09-42c6-a59e-50976839e139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:18.059467 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe62ce1-8b09-42c6-a59e-50976839e139 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:18.059995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe62ce1-8b09-42c6-a59e-50976839e139 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:18.060519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe62ce1-8b09-42c6-a59e-50976839e139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:18.063955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-9fe62ce1-8b09-42c6-a59e-50976839e139 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:18.065076 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30336ed9-245c-41fe-9f74-d6204819cd79 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:18.074242 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fabea9-a027-4a14-8fb2-6d4a1ed89da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:18.076036 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fabea9-a027-4a14-8fb2-6d4a1ed89da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:18.078258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fabea9-a027-4a14-8fb2-6d4a1ed89da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:18.079626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fabea9-a027-4a14-8fb2-6d4a1ed89da3 admin admin] PATH_INFO: `/v3/projects/3f26a5938556468da708099a57b50b22/users/f74f0b86ef2f4a55830bdbc0ed618536/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:18.085480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fabea9-a027-4a14-8fb2-6d4a1ed89da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f26a5938556468da708099a57b50b22, user_id=f74f0b86ef2f4a55830bdbc0ed618536, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:18.089375 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fabea9-a027-4a14-8fb2-6d4a1ed89da3 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:18.113678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1160/2327] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:33:18 2022] PUT /identity/v3/projects/3f26a5938556468da708099a57b50b22/users/f74f0b86ef2f4a55830bdbc0ed618536/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:18.125925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a83b74-804b-4099-a800-93e2784cdc49 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:18.126376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a83b74-804b-4099-a800-93e2784cdc49 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:18.126559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a83b74-804b-4099-a800-93e2784cdc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:18.171193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-b7a83b74-804b-4099-a800-93e2784cdc49 None None] MFA Rules not processed for user `f74f0b86ef2f4a55830bdbc0ed618536`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:18.173007 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b7a83b74-804b-4099-a800-93e2784cdc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:18.258206 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe62ce1-8b09-42c6-a59e-50976839e139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:18.259091 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe62ce1-8b09-42c6-a59e-50976839e139 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:18.278196 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1168/2328] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:33:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:33:18.318782 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1161/2329] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:33:18.331142 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe62ce1-8b09-42c6-a59e-50976839e139 service nova] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:18.333170 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-9fe62ce1-8b09-42c6-a59e-50976839e139 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:18.434253 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe62ce1-8b09-42c6-a59e-50976839e139 service nova] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:18.566524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39f1c9-6c5c-478e-b965-a8b3bfb55819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:18.567786 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39f1c9-6c5c-478e-b965-a8b3bfb55819 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:18.568307 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39f1c9-6c5c-478e-b965-a8b3bfb55819 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:18.568929 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39f1c9-6c5c-478e-b965-a8b3bfb55819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:18.696410 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a83b74-804b-4099-a800-93e2784cdc49 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:18.699266 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b7a83b74-804b-4099-a800-93e2784cdc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:18.705361 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39f1c9-6c5c-478e-b965-a8b3bfb55819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:18.707374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39f1c9-6c5c-478e-b965-a8b3bfb55819 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:18.735475 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1169/2330] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:33:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:33:18.861244 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a83b74-804b-4099-a800-93e2784cdc49 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:18.870401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27db8a-09f4-4f66-9ff5-9d9715eda747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:18.873076 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27db8a-09f4-4f66-9ff5-9d9715eda747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:18.873684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27db8a-09f4-4f66-9ff5-9d9715eda747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:18.874231 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27db8a-09f4-4f66-9ff5-9d9715eda747 admin admin] PATH_INFO: `/v3/users/5a267424721f457a80498ce6f54c4e3c` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:18.876690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27db8a-09f4-4f66-9ff5-9d9715eda747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a267424721f457a80498ce6f54c4e3c)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:18.880707 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27db8a-09f4-4f66-9ff5-9d9715eda747 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:19.365922 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5a27db8a-09f4-4f66-9ff5-9d9715eda747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a267424721f457a80498ce6f54c4e3c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:19.403184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5a27db8a-09f4-4f66-9ff5-9d9715eda747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a267424721f457a80498ce6f54c4e3c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:19.557722 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5a27db8a-09f4-4f66-9ff5-9d9715eda747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a267424721f457a80498ce6f54c4e3c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:19.560196 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5a27db8a-09f4-4f66-9ff5-9d9715eda747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a267424721f457a80498ce6f54c4e3c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:19.584063 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-5a27db8a-09f4-4f66-9ff5-9d9715eda747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a267424721f457a80498ce6f54c4e3c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:19.622498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1162/2331] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:33:18 2022] DELETE /identity/v3/users/5a267424721f457a80498ce6f54c4e3c => generated 0 bytes in 927 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:33:19.629902 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfee779-3692-4538-8f9b-8ea2f7d63b1e None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:19.630941 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfee779-3692-4538-8f9b-8ea2f7d63b1e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:19.632859 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfee779-3692-4538-8f9b-8ea2f7d63b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:19.638768 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:19.673515 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-0dfee779-3692-4538-8f9b-8ea2f7d63b1e None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:19.673515 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-0dfee779-3692-4538-8f9b-8ea2f7d63b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:19.865835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1170/2332] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:19.880815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27db8a-09f4-4f66-9ff5-9d9715eda747 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:19.883591 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-5a27db8a-09f4-4f66-9ff5-9d9715eda747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:19.953551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:20.071350 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27db8a-09f4-4f66-9ff5-9d9715eda747 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:20.091481 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c2842-1193-4b86-bb34-fa8b6bfa818c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:20.092995 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c2842-1193-4b86-bb34-fa8b6bfa818c service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:20.094512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c2842-1193-4b86-bb34-fa8b6bfa818c service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:20.094823 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c2842-1193-4b86-bb34-fa8b6bfa818c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:20.129038 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c2842-1193-4b86-bb34-fa8b6bfa818c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:20.133758 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c2842-1193-4b86-bb34-fa8b6bfa818c service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:20.173033 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1163/2333] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:33:20.857913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfee779-3692-4538-8f9b-8ea2f7d63b1e None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:20.861568 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-0dfee779-3692-4538-8f9b-8ea2f7d63b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:20.902872 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfee779-3692-4538-8f9b-8ea2f7d63b1e None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:20.922281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586fc77-b839-403a-b0f4-39b9675ff897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:20.923672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586fc77-b839-403a-b0f4-39b9675ff897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:20.924367 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586fc77-b839-403a-b0f4-39b9675ff897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:20.925029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586fc77-b839-403a-b0f4-39b9675ff897 admin admin] PATH_INFO: `/v3/projects/1195eac52983420f8cedfc15d6c0c1f1` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:20.928079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586fc77-b839-403a-b0f4-39b9675ff897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1195eac52983420f8cedfc15d6c0c1f1)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:20.938823 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586fc77-b839-403a-b0f4-39b9675ff897 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:21.217912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1586fc77-b839-403a-b0f4-39b9675ff897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1195eac52983420f8cedfc15d6c0c1f1', 'request_id': 'req-1586fc77-b839-403a-b0f4-39b9675ff897'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:21.315521 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1586fc77-b839-403a-b0f4-39b9675ff897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1195eac52983420f8cedfc15d6c0c1f1', 'request_id': 'req-1586fc77-b839-403a-b0f4-39b9675ff897'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:21.334746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1586fc77-b839-403a-b0f4-39b9675ff897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1195eac52983420f8cedfc15d6c0c1f1', 'request_id': 'req-1586fc77-b839-403a-b0f4-39b9675ff897'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:21.363058 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1586fc77-b839-403a-b0f4-39b9675ff897 admin admin] The token cache is being invalidate because project 1195eac52983420f8cedfc15d6c0c1f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:33:21.363553 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1586fc77-b839-403a-b0f4-39b9675ff897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:21.364719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1586fc77-b839-403a-b0f4-39b9675ff897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:21.368261 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1171/2334] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:33:20 2022] DELETE /identity/v3/projects/1195eac52983420f8cedfc15d6c0c1f1 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:21.374982 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c2842-1193-4b86-bb34-fa8b6bfa818c service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:21.405708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c2842-1193-4b86-bb34-fa8b6bfa818c service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:21.552729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bafd27-56a6-4aec-ab15-b61919d0be79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:21.553905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bafd27-56a6-4aec-ab15-b61919d0be79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:21.554136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bafd27-56a6-4aec-ab15-b61919d0be79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:21.554546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bafd27-56a6-4aec-ab15-b61919d0be79 admin admin] PATH_INFO: `/v3/users/4b373c11300e4243a93637a610cc0aac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:21.557070 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bafd27-56a6-4aec-ab15-b61919d0be79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b373c11300e4243a93637a610cc0aac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:21.561406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bafd27-56a6-4aec-ab15-b61919d0be79 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:21.864824 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586fc77-b839-403a-b0f4-39b9675ff897 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:21.879985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-1586fc77-b839-403a-b0f4-39b9675ff897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:21.959908 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d3bafd27-56a6-4aec-ab15-b61919d0be79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b373c11300e4243a93637a610cc0aac'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:21.990872 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d3bafd27-56a6-4aec-ab15-b61919d0be79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b373c11300e4243a93637a610cc0aac'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:22.017313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:22.079705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586fc77-b839-403a-b0f4-39b9675ff897 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:22.086577 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d3bafd27-56a6-4aec-ab15-b61919d0be79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b373c11300e4243a93637a610cc0aac'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:22.086917 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a4325-258a-4a48-9924-229d093fd2c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eab2cbff5984fa6a8e715ed6553db82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:22.087272 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a4325-258a-4a48-9924-229d093fd2c5 service placement] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:22.087597 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a4325-258a-4a48-9924-229d093fd2c5 service placement] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:22.087873 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a4325-258a-4a48-9924-229d093fd2c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:22.088438 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d3bafd27-56a6-4aec-ab15-b61919d0be79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b373c11300e4243a93637a610cc0aac'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:22.090032 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-6c7a4325-258a-4a48-9924-229d093fd2c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:22.100555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d3bafd27-56a6-4aec-ab15-b61919d0be79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b373c11300e4243a93637a610cc0aac'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:22.115618 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1164/2335] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:33:21 2022] DELETE /identity/v3/users/4b373c11300e4243a93637a610cc0aac => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:22.116176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a4325-258a-4a48-9924-229d093fd2c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:22.118510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a4325-258a-4a48-9924-229d093fd2c5 service placement] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:22.159041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1172/2336] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:33:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:33:22.672062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bafd27-56a6-4aec-ab15-b61919d0be79 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:22.674349 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-d3bafd27-56a6-4aec-ab15-b61919d0be79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:22.818275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bafd27-56a6-4aec-ab15-b61919d0be79 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:22.830865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc398b2a-e5e9-46fe-a870-a485292aaf3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:22.832229 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc398b2a-e5e9-46fe-a870-a485292aaf3d service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:22.835672 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc398b2a-e5e9-46fe-a870-a485292aaf3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:22.835672 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc398b2a-e5e9-46fe-a870-a485292aaf3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:22.838072 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-bc398b2a-e5e9-46fe-a870-a485292aaf3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:22.964168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc398b2a-e5e9-46fe-a870-a485292aaf3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:22.966347 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc398b2a-e5e9-46fe-a870-a485292aaf3d service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:22.995102 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1165/2337] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:33:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:33:23.083266 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a4325-258a-4a48-9924-229d093fd2c5 service placement] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:23.086448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-6c7a4325-258a-4a48-9924-229d093fd2c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:23.123488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a4325-258a-4a48-9924-229d093fd2c5 service placement] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:23.226247 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beed0c5-dfac-42fe-831a-575a668b08ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:23.227008 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beed0c5-dfac-42fe-831a-575a668b08ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:23.227290 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beed0c5-dfac-42fe-831a-575a668b08ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:23.227571 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beed0c5-dfac-42fe-831a-575a668b08ff admin admin] PATH_INFO: `/v3/projects/770f6a8f9ef24762a1d49afbb9ade9db` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:23.228910 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beed0c5-dfac-42fe-831a-575a668b08ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=770f6a8f9ef24762a1d49afbb9ade9db)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:23.231563 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beed0c5-dfac-42fe-831a-575a668b08ff admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:23.500253 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:23.515685 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2beed0c5-dfac-42fe-831a-575a668b08ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '770f6a8f9ef24762a1d49afbb9ade9db', 'request_id': 'req-2beed0c5-dfac-42fe-831a-575a668b08ff'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:23.533144 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dacfa-8ef9-4a2f-9274-d010473cc54b None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:23.533534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dacfa-8ef9-4a2f-9274-d010473cc54b None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:23.534429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dacfa-8ef9-4a2f-9274-d010473cc54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:23.558458 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-6f1dacfa-8ef9-4a2f-9274-d010473cc54b None None] MFA Rules not processed for user `39a11b66e3564a0a8bf369242b4318eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:23.560875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6f1dacfa-8ef9-4a2f-9274-d010473cc54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:23.626440 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2beed0c5-dfac-42fe-831a-575a668b08ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '770f6a8f9ef24762a1d49afbb9ade9db', 'request_id': 'req-2beed0c5-dfac-42fe-831a-575a668b08ff'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:23.640061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2beed0c5-dfac-42fe-831a-575a668b08ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '770f6a8f9ef24762a1d49afbb9ade9db', 'request_id': 'req-2beed0c5-dfac-42fe-831a-575a668b08ff'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:23.704494 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2beed0c5-dfac-42fe-831a-575a668b08ff admin admin] The token cache is being invalidate because project 770f6a8f9ef24762a1d49afbb9ade9db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:33:23.707157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2beed0c5-dfac-42fe-831a-575a668b08ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:23.726718 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2beed0c5-dfac-42fe-831a-575a668b08ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:23.735055 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1173/2338] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:33:23 2022] DELETE /identity/v3/projects/770f6a8f9ef24762a1d49afbb9ade9db => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:23.744433 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b14c38-5fe9-4533-abb9-80110c04b947 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:23.746053 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b14c38-5fe9-4533-abb9-80110c04b947 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:23.747253 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b14c38-5fe9-4533-abb9-80110c04b947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:23.770212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1166/2339] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:33:23.839246 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-52b14c38-5fe9-4533-abb9-80110c04b947 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:23.843967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-52b14c38-5fe9-4533-abb9-80110c04b947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:23.960805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:24.062665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1174/2340] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:24.074527 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fce46-6f51-460d-9fbd-169e0b4a6f20 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:24.075067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fce46-6f51-460d-9fbd-169e0b4a6f20 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:24.075590 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fce46-6f51-460d-9fbd-169e0b4a6f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:24.111993 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-a74fce46-6f51-460d-9fbd-169e0b4a6f20 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:24.114247 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a74fce46-6f51-460d-9fbd-169e0b4a6f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:24.131050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1167/2341] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:24.137784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b14c38-5fe9-4533-abb9-80110c04b947 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:24.155508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b14c38-5fe9-4533-abb9-80110c04b947 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:24.169189 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267d262-e8ee-4096-8bb9-691290c8d1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:24.170838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267d262-e8ee-4096-8bb9-691290c8d1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:24.171462 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267d262-e8ee-4096-8bb9-691290c8d1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:24.171990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267d262-e8ee-4096-8bb9-691290c8d1f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:24.173289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267d262-e8ee-4096-8bb9-691290c8d1f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:33:24.173916 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267d262-e8ee-4096-8bb9-691290c8d1f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:24.177594 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267d262-e8ee-4096-8bb9-691290c8d1f5 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:24.198993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1175/2342] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:33:24.204233 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fce46-6f51-460d-9fbd-169e0b4a6f20 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:24.225835 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fce46-6f51-460d-9fbd-169e0b4a6f20 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:24.235905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495215d1-b20a-4667-9c6c-bad604d9b21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:24.240484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495215d1-b20a-4667-9c6c-bad604d9b21a admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:24.240484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495215d1-b20a-4667-9c6c-bad604d9b21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:24.240484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495215d1-b20a-4667-9c6c-bad604d9b21a admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:24.240484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495215d1-b20a-4667-9c6c-bad604d9b21a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:24.243247 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495215d1-b20a-4667-9c6c-bad604d9b21a admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:24.397361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1168/2343] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:33:24 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:33:24.403840 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267d262-e8ee-4096-8bb9-691290c8d1f5 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:24.426370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267d262-e8ee-4096-8bb9-691290c8d1f5 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:24.529432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c70be-0b86-4f93-ac05-a0451744c6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:24.530821 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c70be-0b86-4f93-ac05-a0451744c6cc admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:24.531445 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c70be-0b86-4f93-ac05-a0451744c6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:24.531972 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c70be-0b86-4f93-ac05-a0451744c6cc admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:24.533087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c70be-0b86-4f93-ac05-a0451744c6cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:24.536864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c70be-0b86-4f93-ac05-a0451744c6cc admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:24.637992 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1176/2344] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:33:24 2022] POST /identity/v3/users => generated 283 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:33:24.647519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495215d1-b20a-4667-9c6c-bad604d9b21a admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:24.671277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495215d1-b20a-4667-9c6c-bad604d9b21a admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:24.680830 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704f487-80e3-4316-8928-6f42b9c340c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:24.682746 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704f487-80e3-4316-8928-6f42b9c340c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:24.683919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704f487-80e3-4316-8928-6f42b9c340c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:24.684212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704f487-80e3-4316-8928-6f42b9c340c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:24.685432 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704f487-80e3-4316-8928-6f42b9c340c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:24.688601 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704f487-80e3-4316-8928-6f42b9c340c1 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:24.708776 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1169/2345] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:24.715629 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c70be-0b86-4f93-ac05-a0451744c6cc admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:24.734226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c70be-0b86-4f93-ac05-a0451744c6cc admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:24.743829 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec91a5-0d8e-4d59-b998-d73bf2ad3e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:24.744837 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec91a5-0d8e-4d59-b998-d73bf2ad3e66 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:24.745935 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec91a5-0d8e-4d59-b998-d73bf2ad3e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:24.746351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec91a5-0d8e-4d59-b998-d73bf2ad3e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:24.747533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec91a5-0d8e-4d59-b998-d73bf2ad3e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:24.750729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec91a5-0d8e-4d59-b998-d73bf2ad3e66 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:24.772306 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1177/2346] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:24.778526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704f487-80e3-4316-8928-6f42b9c340c1 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:24.791742 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704f487-80e3-4316-8928-6f42b9c340c1 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:24.799929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92957fcb-f1dc-4acc-9ae6-666661cf0c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:24.800934 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92957fcb-f1dc-4acc-9ae6-666661cf0c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:24.801684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92957fcb-f1dc-4acc-9ae6-666661cf0c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:24.801857 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92957fcb-f1dc-4acc-9ae6-666661cf0c0c admin admin] PATH_INFO: `/v3/projects/1780378af5d044f39c1211cfa4ce03ba/users/05aa6d1a9eae4ddeacc3698e6a5c0124/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:24.833162 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92957fcb-f1dc-4acc-9ae6-666661cf0c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1780378af5d044f39c1211cfa4ce03ba, user_id=05aa6d1a9eae4ddeacc3698e6a5c0124, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:24.836912 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92957fcb-f1dc-4acc-9ae6-666661cf0c0c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:24.975262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1170/2347] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:33:24 2022] PUT /identity/v3/projects/1780378af5d044f39c1211cfa4ce03ba/users/05aa6d1a9eae4ddeacc3698e6a5c0124/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:33:24.989493 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f32e6-8664-4810-ab53-f2ac95dd8f99 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:24.989824 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f32e6-8664-4810-ab53-f2ac95dd8f99 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:24.990046 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f32e6-8664-4810-ab53-f2ac95dd8f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:25.032257 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-672f32e6-8664-4810-ab53-f2ac95dd8f99 None None] MFA Rules not processed for user `05aa6d1a9eae4ddeacc3698e6a5c0124`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:25.033963 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-672f32e6-8664-4810-ab53-f2ac95dd8f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:25.087613 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72009e67-4ba1-4e4c-af37-49fc027f57c5 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:25.088172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72009e67-4ba1-4e4c-af37-49fc027f57c5 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:25.088581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72009e67-4ba1-4e4c-af37-49fc027f57c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:25.124282 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-72009e67-4ba1-4e4c-af37-49fc027f57c5 None None] MFA Rules not processed for user `ef68150915d34826ab861dfbe6d4e3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:25.126887 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-72009e67-4ba1-4e4c-af37-49fc027f57c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:25.151573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1178/2348] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:33:25.161941 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f32e6-8664-4810-ab53-f2ac95dd8f99 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:25.243570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1171/2349] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:33:25.327727 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f32e6-8664-4810-ab53-f2ac95dd8f99 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:25.335908 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae4888-7eff-462b-a709-6412a2613927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:25.336867 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae4888-7eff-462b-a709-6412a2613927 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:25.337284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae4888-7eff-462b-a709-6412a2613927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:25.337731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae4888-7eff-462b-a709-6412a2613927 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:25.338813 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae4888-7eff-462b-a709-6412a2613927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:25.341669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae4888-7eff-462b-a709-6412a2613927 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:25.517461 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1179/2350] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:33:25 2022] POST /identity/v3/projects => generated 367 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:25.523061 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72009e67-4ba1-4e4c-af37-49fc027f57c5 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:25.543952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72009e67-4ba1-4e4c-af37-49fc027f57c5 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:25.686764 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644f863-e330-401b-b0b4-873cb0da16b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:25.686764 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644f863-e330-401b-b0b4-873cb0da16b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:25.686764 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644f863-e330-401b-b0b4-873cb0da16b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:25.686764 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644f863-e330-401b-b0b4-873cb0da16b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:25.687199 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644f863-e330-401b-b0b4-873cb0da16b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:25.687199 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644f863-e330-401b-b0b4-873cb0da16b2 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:25.796556 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae4888-7eff-462b-a709-6412a2613927 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:25.798628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a2ae4888-7eff-462b-a709-6412a2613927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:25.822574 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1172/2351] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:33:25 2022] POST /identity/v3/users => generated 290 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:25.829411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644f863-e330-401b-b0b4-873cb0da16b2 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:25.844388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644f863-e330-401b-b0b4-873cb0da16b2 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:25.851195 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f857ff-ed1f-45d3-8491-81d77869df83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:25.852197 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f857ff-ed1f-45d3-8491-81d77869df83 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:25.860779 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f857ff-ed1f-45d3-8491-81d77869df83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:25.860779 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f857ff-ed1f-45d3-8491-81d77869df83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:25.860779 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f857ff-ed1f-45d3-8491-81d77869df83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:25.860779 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f857ff-ed1f-45d3-8491-81d77869df83 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:25.874053 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1173/2352] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:33:25.880622 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f857ff-ed1f-45d3-8491-81d77869df83 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:25.896985 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f857ff-ed1f-45d3-8491-81d77869df83 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:25.903395 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6026a7-93ed-4921-ab09-ed577f859359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:25.904459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6026a7-93ed-4921-ab09-ed577f859359 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:25.905129 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6026a7-93ed-4921-ab09-ed577f859359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:25.905568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6026a7-93ed-4921-ab09-ed577f859359 admin admin] PATH_INFO: `/v3/projects/14f99a900a1c40bab3934f5cc4e64054/users/5bc83a7fe02444c0a834241888151fca/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:25.928594 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae4888-7eff-462b-a709-6412a2613927 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:25.936001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ce0bc-be86-407c-b035-3c6e91c0b813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:25.937143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ce0bc-be86-407c-b035-3c6e91c0b813 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:25.937635 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ce0bc-be86-407c-b035-3c6e91c0b813 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:25.938117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ce0bc-be86-407c-b035-3c6e91c0b813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:25.938375 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6026a7-93ed-4921-ab09-ed577f859359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f99a900a1c40bab3934f5cc4e64054, user_id=5bc83a7fe02444c0a834241888151fca, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:25.941384 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-2c3ce0bc-be86-407c-b035-3c6e91c0b813 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:25.944612 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6026a7-93ed-4921-ab09-ed577f859359 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:26.059329 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1174/2353] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:33:25 2022] PUT /identity/v3/projects/14f99a900a1c40bab3934f5cc4e64054/users/5bc83a7fe02444c0a834241888151fca/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:33:26.061193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6026a7-93ed-4921-ab09-ed577f859359 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:26.112219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ce0bc-be86-407c-b035-3c6e91c0b813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:26.115157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ce0bc-be86-407c-b035-3c6e91c0b813 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:26.136123 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1180/2354] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:33:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:33:26.162939 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:26.200293 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6026a7-93ed-4921-ab09-ed577f859359 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:26.210365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88724320-db7b-4177-8a26-78258328fa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:26.211301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88724320-db7b-4177-8a26-78258328fa6d admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:26.212037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88724320-db7b-4177-8a26-78258328fa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:26.212570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88724320-db7b-4177-8a26-78258328fa6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:26.213633 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88724320-db7b-4177-8a26-78258328fa6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:26.217243 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88724320-db7b-4177-8a26-78258328fa6d admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:26.244384 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1175/2355] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:26.258967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ce0bc-be86-407c-b035-3c6e91c0b813 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:26.269293 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ce0bc-be86-407c-b035-3c6e91c0b813 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:26.280489 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73103779-6fcd-4513-938d-b2f966466f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:26.281717 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73103779-6fcd-4513-938d-b2f966466f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:26.282140 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73103779-6fcd-4513-938d-b2f966466f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:26.282733 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73103779-6fcd-4513-938d-b2f966466f60 admin admin] PATH_INFO: `/v3/projects/14f99a900a1c40bab3934f5cc4e64054/users/5bc83a7fe02444c0a834241888151fca/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:26.299083 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73103779-6fcd-4513-938d-b2f966466f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f99a900a1c40bab3934f5cc4e64054, user_id=5bc83a7fe02444c0a834241888151fca, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:26.299083 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73103779-6fcd-4513-938d-b2f966466f60 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:26.314820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1181/2356] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:33:26 2022] PUT /identity/v3/projects/14f99a900a1c40bab3934f5cc4e64054/users/5bc83a7fe02444c0a834241888151fca/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:33:26.336319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737055d-6d01-4899-9653-cf3870f8238e None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:26.336826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737055d-6d01-4899-9653-cf3870f8238e None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:26.337295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737055d-6d01-4899-9653-cf3870f8238e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:26.428789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-f737055d-6d01-4899-9653-cf3870f8238e None None] MFA Rules not processed for user `5bc83a7fe02444c0a834241888151fca`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:26.431094 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f737055d-6d01-4899-9653-cf3870f8238e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:26.610531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1176/2357] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:26.642056 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73103779-6fcd-4513-938d-b2f966466f60 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:26.643267 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:26.745708 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73103779-6fcd-4513-938d-b2f966466f60 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:26.752132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb0b64-689a-4421-8a17-bb235ef4d7b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:26.753424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb0b64-689a-4421-8a17-bb235ef4d7b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:26.754060 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb0b64-689a-4421-8a17-bb235ef4d7b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:26.754566 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb0b64-689a-4421-8a17-bb235ef4d7b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:26.770667 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb0b64-689a-4421-8a17-bb235ef4d7b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:26.772917 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb0b64-689a-4421-8a17-bb235ef4d7b9 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:26.786348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1182/2358] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:33:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:33:27.208395 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737055d-6d01-4899-9653-cf3870f8238e None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:27.233737 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737055d-6d01-4899-9653-cf3870f8238e None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:27.240659 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23432099-04c3-424d-88e0-ce8d0dc9590d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:27.241988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23432099-04c3-424d-88e0-ce8d0dc9590d service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:27.242578 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23432099-04c3-424d-88e0-ce8d0dc9590d service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:27.243020 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23432099-04c3-424d-88e0-ce8d0dc9590d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:27.364438 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23432099-04c3-424d-88e0-ce8d0dc9590d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:27.367700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23432099-04c3-424d-88e0-ce8d0dc9590d service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:27.388198 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1177/2359] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:33:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:33:28.660016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:29.033278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:31.226834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:31.436517 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:32.894956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:33.178265 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:33.398689 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb0b64-689a-4421-8a17-bb235ef4d7b9 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:33.400799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-52fb0b64-689a-4421-8a17-bb235ef4d7b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:33.518244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb0b64-689a-4421-8a17-bb235ef4d7b9 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:33.524035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c3f30-bf9d-4e00-9250-c01c72a3063d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:33.525018 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c3f30-bf9d-4e00-9250-c01c72a3063d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:33.526368 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c3f30-bf9d-4e00-9250-c01c72a3063d admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:33.526368 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c3f30-bf9d-4e00-9250-c01c72a3063d admin admin] PATH_INFO: `/v3/users/3c012c9c27494994826c728d92476db3` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:33.527630 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c3f30-bf9d-4e00-9250-c01c72a3063d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c012c9c27494994826c728d92476db3)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:33.529554 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c3f30-bf9d-4e00-9250-c01c72a3063d admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:33.926931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1c1c3f30-bf9d-4e00-9250-c01c72a3063d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c012c9c27494994826c728d92476db3'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:34.097946 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1c1c3f30-bf9d-4e00-9250-c01c72a3063d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c012c9c27494994826c728d92476db3'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:34.099536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1c1c3f30-bf9d-4e00-9250-c01c72a3063d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c012c9c27494994826c728d92476db3'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:34.114835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1c1c3f30-bf9d-4e00-9250-c01c72a3063d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c012c9c27494994826c728d92476db3'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:34.115601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1c1c3f30-bf9d-4e00-9250-c01c72a3063d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c012c9c27494994826c728d92476db3'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:34.156771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1183/2360] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:33:33 2022] DELETE /identity/v3/users/3c012c9c27494994826c728d92476db3 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:34.163411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0aa0d-8957-4122-b6c2-b984ffa2a0f6 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:34.164306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0aa0d-8957-4122-b6c2-b984ffa2a0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:34.165117 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0aa0d-8957-4122-b6c2-b984ffa2a0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:34.204544 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-acd0aa0d-8957-4122-b6c2-b984ffa2a0f6 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:34.208459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-acd0aa0d-8957-4122-b6c2-b984ffa2a0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:34.299684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1178/2361] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:34.315335 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c3f30-bf9d-4e00-9250-c01c72a3063d admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:34.317962 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-1c1c3f30-bf9d-4e00-9250-c01c72a3063d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:34.415214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c3f30-bf9d-4e00-9250-c01c72a3063d admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:34.418221 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0d8a0-3d31-4c6b-988c-7ecffeb668d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:34.419393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0d8a0-3d31-4c6b-988c-7ecffeb668d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:34.419775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0d8a0-3d31-4c6b-988c-7ecffeb668d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:34.419996 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0d8a0-3d31-4c6b-988c-7ecffeb668d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:34.436560 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0d8a0-3d31-4c6b-988c-7ecffeb668d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:34.438837 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0d8a0-3d31-4c6b-988c-7ecffeb668d4 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:34.454608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1184/2362] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:33:35.263661 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0aa0d-8957-4122-b6c2-b984ffa2a0f6 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:35.269003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-acd0aa0d-8957-4122-b6c2-b984ffa2a0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:35.295934 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0aa0d-8957-4122-b6c2-b984ffa2a0f6 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:35.313698 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dee00e-fffe-47e5-b8d3-eee145066b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:35.313698 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dee00e-fffe-47e5-b8d3-eee145066b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:35.313698 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dee00e-fffe-47e5-b8d3-eee145066b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:35.313698 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dee00e-fffe-47e5-b8d3-eee145066b53 admin admin] PATH_INFO: `/v3/projects/58f1eed4e72f40bda4929c01e5249bc3` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:35.314280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dee00e-fffe-47e5-b8d3-eee145066b53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58f1eed4e72f40bda4929c01e5249bc3)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:35.314280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dee00e-fffe-47e5-b8d3-eee145066b53 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:35.554847 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-86dee00e-fffe-47e5-b8d3-eee145066b53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58f1eed4e72f40bda4929c01e5249bc3', 'request_id': 'req-86dee00e-fffe-47e5-b8d3-eee145066b53'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:35.704566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-86dee00e-fffe-47e5-b8d3-eee145066b53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58f1eed4e72f40bda4929c01e5249bc3', 'request_id': 'req-86dee00e-fffe-47e5-b8d3-eee145066b53'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:35.712927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-86dee00e-fffe-47e5-b8d3-eee145066b53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58f1eed4e72f40bda4929c01e5249bc3', 'request_id': 'req-86dee00e-fffe-47e5-b8d3-eee145066b53'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:35.726641 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-86dee00e-fffe-47e5-b8d3-eee145066b53 admin admin] The token cache is being invalidate because project 58f1eed4e72f40bda4929c01e5249bc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:33:35.727108 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-86dee00e-fffe-47e5-b8d3-eee145066b53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:35.728536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-86dee00e-fffe-47e5-b8d3-eee145066b53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:35.730833 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1179/2363] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:33:35 2022] DELETE /identity/v3/projects/58f1eed4e72f40bda4929c01e5249bc3 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:33:35.737172 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0d8a0-3d31-4c6b-988c-7ecffeb668d4 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:35.757383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0d8a0-3d31-4c6b-988c-7ecffeb668d4 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:35.789498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:35.845658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cc9c5-5bb8-471f-93ca-02ae147653e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:35.846489 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cc9c5-5bb8-471f-93ca-02ae147653e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:35.846906 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cc9c5-5bb8-471f-93ca-02ae147653e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:35.847294 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cc9c5-5bb8-471f-93ca-02ae147653e4 admin admin] PATH_INFO: `/v3/users/d90b6db2a68e4dbd865da6f24d015e68` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:35.848889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cc9c5-5bb8-471f-93ca-02ae147653e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d90b6db2a68e4dbd865da6f24d015e68)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:35.851801 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cc9c5-5bb8-471f-93ca-02ae147653e4 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:36.104240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:36.225176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-eb1cc9c5-5bb8-471f-93ca-02ae147653e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd90b6db2a68e4dbd865da6f24d015e68'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:36.389517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-eb1cc9c5-5bb8-471f-93ca-02ae147653e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd90b6db2a68e4dbd865da6f24d015e68'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:36.390216 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-eb1cc9c5-5bb8-471f-93ca-02ae147653e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd90b6db2a68e4dbd865da6f24d015e68'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:36.400841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-eb1cc9c5-5bb8-471f-93ca-02ae147653e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd90b6db2a68e4dbd865da6f24d015e68'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:36.401879 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-eb1cc9c5-5bb8-471f-93ca-02ae147653e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd90b6db2a68e4dbd865da6f24d015e68'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:36.429486 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1185/2364] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:33:35 2022] DELETE /identity/v3/users/d90b6db2a68e4dbd865da6f24d015e68 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:37.211316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dee00e-fffe-47e5-b8d3-eee145066b53 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:37.213172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-86dee00e-fffe-47e5-b8d3-eee145066b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:37.236328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dee00e-fffe-47e5-b8d3-eee145066b53 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:37.348785 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eabc90-2b4a-4db9-b215-858600fef1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:37.349448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eabc90-2b4a-4db9-b215-858600fef1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:37.349726 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eabc90-2b4a-4db9-b215-858600fef1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:37.350120 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eabc90-2b4a-4db9-b215-858600fef1fe admin admin] PATH_INFO: `/v3/projects/e84b04461df84544bfd3bf95942b3aec` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:37.351597 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eabc90-2b4a-4db9-b215-858600fef1fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e84b04461df84544bfd3bf95942b3aec)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:37.353912 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eabc90-2b4a-4db9-b215-858600fef1fe admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:37.604504 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-12eabc90-2b4a-4db9-b215-858600fef1fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e84b04461df84544bfd3bf95942b3aec', 'request_id': 'req-12eabc90-2b4a-4db9-b215-858600fef1fe'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:37.738341 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-12eabc90-2b4a-4db9-b215-858600fef1fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e84b04461df84544bfd3bf95942b3aec', 'request_id': 'req-12eabc90-2b4a-4db9-b215-858600fef1fe'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:37.749508 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-12eabc90-2b4a-4db9-b215-858600fef1fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e84b04461df84544bfd3bf95942b3aec', 'request_id': 'req-12eabc90-2b4a-4db9-b215-858600fef1fe'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:37.770477 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-12eabc90-2b4a-4db9-b215-858600fef1fe admin admin] The token cache is being invalidate because project e84b04461df84544bfd3bf95942b3aec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:33:37.771044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-12eabc90-2b4a-4db9-b215-858600fef1fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:37.772039 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-12eabc90-2b4a-4db9-b215-858600fef1fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:37.774447 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1180/2365] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:33:37 2022] DELETE /identity/v3/projects/e84b04461df84544bfd3bf95942b3aec => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:37.787864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cc9c5-5bb8-471f-93ca-02ae147653e4 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:37.790040 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-eb1cc9c5-5bb8-471f-93ca-02ae147653e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:37.816180 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cc9c5-5bb8-471f-93ca-02ae147653e4 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:37.921206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eabc90-2b4a-4db9-b215-858600fef1fe admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:37.924014 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-12eabc90-2b4a-4db9-b215-858600fef1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:37.952802 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c25543-ec7c-4523-ba0c-258330448fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:37.956801 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c25543-ec7c-4523-ba0c-258330448fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:37.957086 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c25543-ec7c-4523-ba0c-258330448fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:37.957551 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c25543-ec7c-4523-ba0c-258330448fa6 admin admin] PATH_INFO: `/v3/users/f74f0b86ef2f4a55830bdbc0ed618536` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:37.974853 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c25543-ec7c-4523-ba0c-258330448fa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f74f0b86ef2f4a55830bdbc0ed618536)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:37.974853 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c25543-ec7c-4523-ba0c-258330448fa6 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:38.070455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eabc90-2b4a-4db9-b215-858600fef1fe admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:38.077602 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65366f9a-b91a-488f-aa1b-3e6930dce1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:38.078327 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65366f9a-b91a-488f-aa1b-3e6930dce1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:38.078695 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65366f9a-b91a-488f-aa1b-3e6930dce1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:38.090279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65366f9a-b91a-488f-aa1b-3e6930dce1a9 admin admin] PATH_INFO: `/v3/users/05aa6d1a9eae4ddeacc3698e6a5c0124` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:38.090279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65366f9a-b91a-488f-aa1b-3e6930dce1a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05aa6d1a9eae4ddeacc3698e6a5c0124)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:38.090279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65366f9a-b91a-488f-aa1b-3e6930dce1a9 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:38.307731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e9c25543-ec7c-4523-ba0c-258330448fa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f74f0b86ef2f4a55830bdbc0ed618536'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:38.459988 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e9c25543-ec7c-4523-ba0c-258330448fa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f74f0b86ef2f4a55830bdbc0ed618536'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:38.461131 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e9c25543-ec7c-4523-ba0c-258330448fa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f74f0b86ef2f4a55830bdbc0ed618536'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:38.480945 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e9c25543-ec7c-4523-ba0c-258330448fa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f74f0b86ef2f4a55830bdbc0ed618536'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:38.482337 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e9c25543-ec7c-4523-ba0c-258330448fa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f74f0b86ef2f4a55830bdbc0ed618536'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:38.486045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-65366f9a-b91a-488f-aa1b-3e6930dce1a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05aa6d1a9eae4ddeacc3698e6a5c0124'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:38.514721 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-65366f9a-b91a-488f-aa1b-3e6930dce1a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05aa6d1a9eae4ddeacc3698e6a5c0124'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:38.523357 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1186/2366] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:33:37 2022] DELETE /identity/v3/users/f74f0b86ef2f4a55830bdbc0ed618536 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:38.800734 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-65366f9a-b91a-488f-aa1b-3e6930dce1a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05aa6d1a9eae4ddeacc3698e6a5c0124'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:38.801905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-65366f9a-b91a-488f-aa1b-3e6930dce1a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05aa6d1a9eae4ddeacc3698e6a5c0124'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:38.813639 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-65366f9a-b91a-488f-aa1b-3e6930dce1a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05aa6d1a9eae4ddeacc3698e6a5c0124'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:38.836525 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1181/2367] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:33:37 2022] DELETE /identity/v3/users/05aa6d1a9eae4ddeacc3698e6a5c0124 => generated 0 bytes in 910 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:33:38.836684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdc289-f9c0-436f-8e61-4871b7e426fe None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:38.837187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdc289-f9c0-436f-8e61-4871b7e426fe None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:38.837728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdc289-f9c0-436f-8e61-4871b7e426fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:38.860370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-dfbdc289-f9c0-436f-8e61-4871b7e426fe None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:38.861520 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-dfbdc289-f9c0-436f-8e61-4871b7e426fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:38.931066 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1187/2368] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:38.944396 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65366f9a-b91a-488f-aa1b-3e6930dce1a9 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:38.945860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-65366f9a-b91a-488f-aa1b-3e6930dce1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:39.024754 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65366f9a-b91a-488f-aa1b-3e6930dce1a9 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:39.036611 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba046474-7e6e-4d61-acf6-8d840a5113f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:39.038258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba046474-7e6e-4d61-acf6-8d840a5113f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:39.038802 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba046474-7e6e-4d61-acf6-8d840a5113f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:39.039295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba046474-7e6e-4d61-acf6-8d840a5113f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:39.057394 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba046474-7e6e-4d61-acf6-8d840a5113f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:39.060475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba046474-7e6e-4d61-acf6-8d840a5113f0 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:39.083719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1182/2369] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:33:39.477297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdc289-f9c0-436f-8e61-4871b7e426fe None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:39.478888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-dfbdc289-f9c0-436f-8e61-4871b7e426fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:39.496010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdc289-f9c0-436f-8e61-4871b7e426fe None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:39.508472 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f87ad2-3d35-4de2-b5a7-4527dd4d42b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:39.509387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f87ad2-3d35-4de2-b5a7-4527dd4d42b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:39.509849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f87ad2-3d35-4de2-b5a7-4527dd4d42b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:39.510330 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f87ad2-3d35-4de2-b5a7-4527dd4d42b4 admin admin] PATH_INFO: `/v3/projects/3f26a5938556468da708099a57b50b22` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:39.513714 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f87ad2-3d35-4de2-b5a7-4527dd4d42b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f26a5938556468da708099a57b50b22)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:39.518962 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f87ad2-3d35-4de2-b5a7-4527dd4d42b4 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:39.718930 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-51f87ad2-3d35-4de2-b5a7-4527dd4d42b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f26a5938556468da708099a57b50b22', 'request_id': 'req-51f87ad2-3d35-4de2-b5a7-4527dd4d42b4'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:39.797703 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba046474-7e6e-4d61-acf6-8d840a5113f0 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:39.799655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ba046474-7e6e-4d61-acf6-8d840a5113f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:39.812920 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-51f87ad2-3d35-4de2-b5a7-4527dd4d42b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f26a5938556468da708099a57b50b22', 'request_id': 'req-51f87ad2-3d35-4de2-b5a7-4527dd4d42b4'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:39.823118 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba046474-7e6e-4d61-acf6-8d840a5113f0 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:39.825509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-51f87ad2-3d35-4de2-b5a7-4527dd4d42b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f26a5938556468da708099a57b50b22', 'request_id': 'req-51f87ad2-3d35-4de2-b5a7-4527dd4d42b4'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:39.845914 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-51f87ad2-3d35-4de2-b5a7-4527dd4d42b4 admin admin] The token cache is being invalidate because project 3f26a5938556468da708099a57b50b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:33:39.845914 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-51f87ad2-3d35-4de2-b5a7-4527dd4d42b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:39.847216 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-51f87ad2-3d35-4de2-b5a7-4527dd4d42b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:39.855176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1188/2370] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:33:39 2022] DELETE /identity/v3/projects/3f26a5938556468da708099a57b50b22 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:39.856864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b15f0d-4caf-4c05-a703-525a5ef5fd77 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:39.857182 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b15f0d-4caf-4c05-a703-525a5ef5fd77 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:39.857496 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b15f0d-4caf-4c05-a703-525a5ef5fd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:39.888127 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-e1b15f0d-4caf-4c05-a703-525a5ef5fd77 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:39.890868 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-e1b15f0d-4caf-4c05-a703-525a5ef5fd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:39.924868 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:39.933697 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737d7a2-72cb-48f7-a639-1ec7e52de1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:39.934372 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737d7a2-72cb-48f7-a639-1ec7e52de1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:39.934691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737d7a2-72cb-48f7-a639-1ec7e52de1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:39.935116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737d7a2-72cb-48f7-a639-1ec7e52de1be admin admin] PATH_INFO: `/v3/projects/1780378af5d044f39c1211cfa4ce03ba` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:39.936483 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737d7a2-72cb-48f7-a639-1ec7e52de1be admin admin] RBAC: Authorizing `identity:delete_project(project_id=1780378af5d044f39c1211cfa4ce03ba)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:39.938423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737d7a2-72cb-48f7-a639-1ec7e52de1be admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:39.981519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:39.998033 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1189/2371] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:40.007956 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244021a-3f30-46d3-8c59-5fa865f1edeb None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:40.008239 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244021a-3f30-46d3-8c59-5fa865f1edeb None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:40.008499 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244021a-3f30-46d3-8c59-5fa865f1edeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:40.030802 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-8244021a-3f30-46d3-8c59-5fa865f1edeb None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:40.032065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-8244021a-3f30-46d3-8c59-5fa865f1edeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:40.045298 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1190/2372] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:40.046812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244021a-3f30-46d3-8c59-5fa865f1edeb None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:40.059304 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244021a-3f30-46d3-8c59-5fa865f1edeb None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:40.064772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0ac54-d471-4f58-a879-69f643f74dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:40.065265 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0ac54-d471-4f58-a879-69f643f74dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:40.065589 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0ac54-d471-4f58-a879-69f643f74dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:40.065818 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0ac54-d471-4f58-a879-69f643f74dc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:40.066765 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0ac54-d471-4f58-a879-69f643f74dc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:33:40.067072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0ac54-d471-4f58-a879-69f643f74dc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:40.068816 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0ac54-d471-4f58-a879-69f643f74dc2 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:40.089506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1191/2373] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:33:40.093917 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0ac54-d471-4f58-a879-69f643f74dc2 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:40.099135 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4737d7a2-72cb-48f7-a639-1ec7e52de1be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1780378af5d044f39c1211cfa4ce03ba', 'request_id': 'req-4737d7a2-72cb-48f7-a639-1ec7e52de1be'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:40.105228 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0ac54-d471-4f58-a879-69f643f74dc2 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:40.168202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88b0df-d0ee-42b8-8e29-08c7dcd163a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:40.169250 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88b0df-d0ee-42b8-8e29-08c7dcd163a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:40.169565 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88b0df-d0ee-42b8-8e29-08c7dcd163a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:40.169873 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88b0df-d0ee-42b8-8e29-08c7dcd163a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:40.170743 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88b0df-d0ee-42b8-8e29-08c7dcd163a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:40.173146 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88b0df-d0ee-42b8-8e29-08c7dcd163a8 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:40.185285 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4737d7a2-72cb-48f7-a639-1ec7e52de1be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1780378af5d044f39c1211cfa4ce03ba', 'request_id': 'req-4737d7a2-72cb-48f7-a639-1ec7e52de1be'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:40.193891 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4737d7a2-72cb-48f7-a639-1ec7e52de1be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1780378af5d044f39c1211cfa4ce03ba', 'request_id': 'req-4737d7a2-72cb-48f7-a639-1ec7e52de1be'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:40.212739 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4737d7a2-72cb-48f7-a639-1ec7e52de1be admin admin] The token cache is being invalidate because project 1780378af5d044f39c1211cfa4ce03ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:33:40.213033 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4737d7a2-72cb-48f7-a639-1ec7e52de1be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:40.214525 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4737d7a2-72cb-48f7-a639-1ec7e52de1be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:40.216240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1183/2374] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:33:39 2022] DELETE /identity/v3/projects/1780378af5d044f39c1211cfa4ce03ba => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:40.220290 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737d7a2-72cb-48f7-a639-1ec7e52de1be admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:40.221954 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4737d7a2-72cb-48f7-a639-1ec7e52de1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:40.236726 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737d7a2-72cb-48f7-a639-1ec7e52de1be admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:40.241739 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd52004-1bd5-42e3-8269-774c1cd8633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:40.242377 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd52004-1bd5-42e3-8269-774c1cd8633e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:40.242742 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd52004-1bd5-42e3-8269-774c1cd8633e admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:40.242989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd52004-1bd5-42e3-8269-774c1cd8633e admin admin] PATH_INFO: `/v3/users/5bc83a7fe02444c0a834241888151fca` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:40.244879 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd52004-1bd5-42e3-8269-774c1cd8633e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bc83a7fe02444c0a834241888151fca)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:40.246894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd52004-1bd5-42e3-8269-774c1cd8633e admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:40.308652 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1192/2375] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:33:40 2022] POST /identity/v3/projects => generated 367 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:40.311458 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88b0df-d0ee-42b8-8e29-08c7dcd163a8 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:40.314558 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-5e88b0df-d0ee-42b8-8e29-08c7dcd163a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:40.439004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88b0df-d0ee-42b8-8e29-08c7dcd163a8 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:40.444580 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b31f4-5a5f-46d4-9181-55939b17495a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:40.446066 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b31f4-5a5f-46d4-9181-55939b17495a admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:40.446517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b31f4-5a5f-46d4-9181-55939b17495a admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:40.447323 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b31f4-5a5f-46d4-9181-55939b17495a admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:40.448130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b31f4-5a5f-46d4-9181-55939b17495a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:40.450845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b31f4-5a5f-46d4-9181-55939b17495a admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:40.562373 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4bd52004-1bd5-42e3-8269-774c1cd8633e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bc83a7fe02444c0a834241888151fca'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:40.582973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1193/2376] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:33:40 2022] POST /identity/v3/users => generated 284 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:33:40.589896 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b31f4-5a5f-46d4-9181-55939b17495a admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:40.595513 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4bd52004-1bd5-42e3-8269-774c1cd8633e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bc83a7fe02444c0a834241888151fca'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:40.611504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b31f4-5a5f-46d4-9181-55939b17495a admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:40.618676 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356b79b-d4e1-4997-82ca-a5d500ee53fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:40.619540 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356b79b-d4e1-4997-82ca-a5d500ee53fa admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:40.619863 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356b79b-d4e1-4997-82ca-a5d500ee53fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:40.620300 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356b79b-d4e1-4997-82ca-a5d500ee53fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:40.621880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356b79b-d4e1-4997-82ca-a5d500ee53fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:40.624855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356b79b-d4e1-4997-82ca-a5d500ee53fa admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:40.639417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1194/2377] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:40.645835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356b79b-d4e1-4997-82ca-a5d500ee53fa admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:40.664325 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356b79b-d4e1-4997-82ca-a5d500ee53fa admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:40.679209 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab353ab5-dd64-461c-b520-1dfee301685b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:40.679913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab353ab5-dd64-461c-b520-1dfee301685b admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:40.680126 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab353ab5-dd64-461c-b520-1dfee301685b admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:40.680414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab353ab5-dd64-461c-b520-1dfee301685b admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:40.683985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab353ab5-dd64-461c-b520-1dfee301685b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:40.685641 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab353ab5-dd64-461c-b520-1dfee301685b admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:40.701130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1195/2378] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:33:40.706826 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab353ab5-dd64-461c-b520-1dfee301685b admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:40.719684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab353ab5-dd64-461c-b520-1dfee301685b admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:40.727985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c3e53-079d-4d56-ad33-1d8f0e154e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:40.729121 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c3e53-079d-4d56-ad33-1d8f0e154e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:40.729420 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c3e53-079d-4d56-ad33-1d8f0e154e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:40.730398 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c3e53-079d-4d56-ad33-1d8f0e154e84 admin admin] PATH_INFO: `/v3/projects/52fc6917d8c44d659adb611b06741889/users/6d6f8c19241944b5b76221fe67181c77/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:40.738961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4bd52004-1bd5-42e3-8269-774c1cd8633e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bc83a7fe02444c0a834241888151fca'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:40.740697 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4bd52004-1bd5-42e3-8269-774c1cd8633e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bc83a7fe02444c0a834241888151fca'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:40.753927 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c3e53-079d-4d56-ad33-1d8f0e154e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52fc6917d8c44d659adb611b06741889, user_id=6d6f8c19241944b5b76221fe67181c77, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:40.756950 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c3e53-079d-4d56-ad33-1d8f0e154e84 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:40.774317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4bd52004-1bd5-42e3-8269-774c1cd8633e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bc83a7fe02444c0a834241888151fca'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:40.786718 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1184/2379] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:33:40 2022] DELETE /identity/v3/users/5bc83a7fe02444c0a834241888151fca => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:33:40.945633 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eb43f-eab5-4efd-9217-5d396cef2c02 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:40.946362 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eb43f-eab5-4efd-9217-5d396cef2c02 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:40.946362 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eb43f-eab5-4efd-9217-5d396cef2c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:40.954400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1196/2380] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:33:40 2022] PUT /identity/v3/projects/52fc6917d8c44d659adb611b06741889/users/6d6f8c19241944b5b76221fe67181c77/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:33:40.979122 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-7a7eb43f-eab5-4efd-9217-5d396cef2c02 None None] MFA Rules not processed for user `6d6f8c19241944b5b76221fe67181c77`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:40.980461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-7a7eb43f-eab5-4efd-9217-5d396cef2c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:41.064723 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1185/2381] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:33:41.078100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c3e53-079d-4d56-ad33-1d8f0e154e84 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:41.080931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-881c3e53-079d-4d56-ad33-1d8f0e154e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:41.234059 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c3e53-079d-4d56-ad33-1d8f0e154e84 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:41.238716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5feb03-5f19-4f21-a0c9-a6c30402b26d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5b3a7a9a08e40718980143d7c4880ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:41.239529 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5feb03-5f19-4f21-a0c9-a6c30402b26d service glance] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:41.240043 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5feb03-5f19-4f21-a0c9-a6c30402b26d service glance] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:41.240318 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5feb03-5f19-4f21-a0c9-a6c30402b26d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:41.255246 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5feb03-5f19-4f21-a0c9-a6c30402b26d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:41.260379 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5feb03-5f19-4f21-a0c9-a6c30402b26d service glance] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:41.280184 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1197/2382] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:33:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:33:41.590570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7eb43f-eab5-4efd-9217-5d396cef2c02 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:41.592823 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-7a7eb43f-eab5-4efd-9217-5d396cef2c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:41.736149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7eb43f-eab5-4efd-9217-5d396cef2c02 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:41.742321 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ecbb2-6624-43fe-8834-65729b7e4646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:41.743321 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecbb2-6624-43fe-8834-65729b7e4646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:41.743478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecbb2-6624-43fe-8834-65729b7e4646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:41.743948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecbb2-6624-43fe-8834-65729b7e4646 admin admin] PATH_INFO: `/v3/projects/14f99a900a1c40bab3934f5cc4e64054` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:41.745295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ecbb2-6624-43fe-8834-65729b7e4646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14f99a900a1c40bab3934f5cc4e64054)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:41.747550 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ecbb2-6624-43fe-8834-65729b7e4646 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:41.946474 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-822ecbb2-6624-43fe-8834-65729b7e4646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f99a900a1c40bab3934f5cc4e64054', 'request_id': 'req-822ecbb2-6624-43fe-8834-65729b7e4646'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:42.092804 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-822ecbb2-6624-43fe-8834-65729b7e4646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f99a900a1c40bab3934f5cc4e64054', 'request_id': 'req-822ecbb2-6624-43fe-8834-65729b7e4646'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:42.105584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-822ecbb2-6624-43fe-8834-65729b7e4646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f99a900a1c40bab3934f5cc4e64054', 'request_id': 'req-822ecbb2-6624-43fe-8834-65729b7e4646'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:42.124109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-822ecbb2-6624-43fe-8834-65729b7e4646 admin admin] The token cache is being invalidate because project 14f99a900a1c40bab3934f5cc4e64054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:33:42.124793 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-822ecbb2-6624-43fe-8834-65729b7e4646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:42.125813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-822ecbb2-6624-43fe-8834-65729b7e4646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:42.128272 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1186/2383] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:33:41 2022] DELETE /identity/v3/projects/14f99a900a1c40bab3934f5cc4e64054 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:33:42.134382 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4428133-ed7f-40c0-a4f8-dc9edbd5a264 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:42.135269 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4428133-ed7f-40c0-a4f8-dc9edbd5a264 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:42.135461 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4428133-ed7f-40c0-a4f8-dc9edbd5a264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:42.158704 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-a4428133-ed7f-40c0-a4f8-dc9edbd5a264 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:42.159966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a4428133-ed7f-40c0-a4f8-dc9edbd5a264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:42.238082 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1198/2384] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:42.248702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62619b-2f12-489e-944f-b40bc0b00d46 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:42.249275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62619b-2f12-489e-944f-b40bc0b00d46 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:42.249709 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62619b-2f12-489e-944f-b40bc0b00d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:42.274745 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-4b62619b-2f12-489e-944f-b40bc0b00d46 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:42.276624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4b62619b-2f12-489e-944f-b40bc0b00d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:42.288851 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1187/2385] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:42.294414 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4428133-ed7f-40c0-a4f8-dc9edbd5a264 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:42.310362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4428133-ed7f-40c0-a4f8-dc9edbd5a264 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:42.327889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191517f6-7767-4313-9fe6-2d81779ec198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:42.328970 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191517f6-7767-4313-9fe6-2d81779ec198 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:42.331136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191517f6-7767-4313-9fe6-2d81779ec198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:42.331654 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191517f6-7767-4313-9fe6-2d81779ec198 admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:42.332942 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191517f6-7767-4313-9fe6-2d81779ec198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:33:42.333510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191517f6-7767-4313-9fe6-2d81779ec198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:42.339031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191517f6-7767-4313-9fe6-2d81779ec198 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:42.371524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1199/2386] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:33:42.371771 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62619b-2f12-489e-944f-b40bc0b00d46 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:42.394691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62619b-2f12-489e-944f-b40bc0b00d46 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:42.419572 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcae97e-81ed-4a97-9ad1-c9533ea85224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:42.419572 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcae97e-81ed-4a97-9ad1-c9533ea85224 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:42.419572 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcae97e-81ed-4a97-9ad1-c9533ea85224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:42.419572 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcae97e-81ed-4a97-9ad1-c9533ea85224 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:42.419935 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcae97e-81ed-4a97-9ad1-c9533ea85224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:42.426890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcae97e-81ed-4a97-9ad1-c9533ea85224 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:42.539289 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:42.621731 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1188/2387] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:33:42 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:42.630688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191517f6-7767-4313-9fe6-2d81779ec198 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:42.647467 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191517f6-7767-4313-9fe6-2d81779ec198 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:42.767942 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e07b7-397c-4392-b0c9-e31ed3baf08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:42.768746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e07b7-397c-4392-b0c9-e31ed3baf08e admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:42.769297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e07b7-397c-4392-b0c9-e31ed3baf08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:42.769751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e07b7-397c-4392-b0c9-e31ed3baf08e admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:42.771728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e07b7-397c-4392-b0c9-e31ed3baf08e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:42.775990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e07b7-397c-4392-b0c9-e31ed3baf08e admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:42.916517 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1200/2388] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:33:42 2022] POST /identity/v3/users => generated 292 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:33:42.921181 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcae97e-81ed-4a97-9ad1-c9533ea85224 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:42.932745 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcae97e-81ed-4a97-9ad1-c9533ea85224 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:42.939650 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3f7de-f263-4a86-a857-2e037f07599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:42.942005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3f7de-f263-4a86-a857-2e037f07599c admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:42.942005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3f7de-f263-4a86-a857-2e037f07599c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:42.942005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3f7de-f263-4a86-a857-2e037f07599c admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:42.942005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3f7de-f263-4a86-a857-2e037f07599c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:42.945333 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3f7de-f263-4a86-a857-2e037f07599c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:42.963630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1189/2389] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:42.972114 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e07b7-397c-4392-b0c9-e31ed3baf08e admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:42.991883 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e07b7-397c-4392-b0c9-e31ed3baf08e admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:42.997256 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5867b55-55ef-4c89-8037-3813b3943e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:42.997895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5867b55-55ef-4c89-8037-3813b3943e1c admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:42.998179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5867b55-55ef-4c89-8037-3813b3943e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:42.998453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5867b55-55ef-4c89-8037-3813b3943e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:42.999468 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5867b55-55ef-4c89-8037-3813b3943e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:43.001155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5867b55-55ef-4c89-8037-3813b3943e1c admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:43.016179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1201/2390] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:43.023358 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3f7de-f263-4a86-a857-2e037f07599c admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:43.041901 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3f7de-f263-4a86-a857-2e037f07599c admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:43.057485 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21faf53-4bdb-43c9-9afe-6e34ee45efe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:43.057749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21faf53-4bdb-43c9-9afe-6e34ee45efe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:43.058051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21faf53-4bdb-43c9-9afe-6e34ee45efe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:43.058440 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21faf53-4bdb-43c9-9afe-6e34ee45efe3 admin admin] PATH_INFO: `/v3/projects/7c7797a692c94a6eb441c1ff9bb62ca6/users/6f805b52d7864890a5b71d3f9e3cbeb2/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:43.118397 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21faf53-4bdb-43c9-9afe-6e34ee45efe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7797a692c94a6eb441c1ff9bb62ca6, user_id=6f805b52d7864890a5b71d3f9e3cbeb2, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:43.123911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21faf53-4bdb-43c9-9afe-6e34ee45efe3 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:43.268122 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1190/2391] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:33:43 2022] PUT /identity/v3/projects/7c7797a692c94a6eb441c1ff9bb62ca6/users/6f805b52d7864890a5b71d3f9e3cbeb2/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:43.273996 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbb8e4-a448-4ae5-8e58-3d28ed48fe5d None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:43.274654 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbb8e4-a448-4ae5-8e58-3d28ed48fe5d None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:43.274839 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbb8e4-a448-4ae5-8e58-3d28ed48fe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:43.339982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-5fdbb8e4-a448-4ae5-8e58-3d28ed48fe5d None None] MFA Rules not processed for user `6f805b52d7864890a5b71d3f9e3cbeb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:43.343434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-5fdbb8e4-a448-4ae5-8e58-3d28ed48fe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:43.449088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1202/2392] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:33:43.461635 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21faf53-4bdb-43c9-9afe-6e34ee45efe3 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:43.463642 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e21faf53-4bdb-43c9-9afe-6e34ee45efe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:43.565699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:43.580443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21faf53-4bdb-43c9-9afe-6e34ee45efe3 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:43.600957 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b42c3-2869-4b39-b3d3-ab3f3dea2c92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:43.603368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b42c3-2869-4b39-b3d3-ab3f3dea2c92 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:43.603872 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b42c3-2869-4b39-b3d3-ab3f3dea2c92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:43.604385 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b42c3-2869-4b39-b3d3-ab3f3dea2c92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:43.636593 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b42c3-2869-4b39-b3d3-ab3f3dea2c92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:43.639063 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b42c3-2869-4b39-b3d3-ab3f3dea2c92 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:43.654426 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1191/2393] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:33:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:33:46.779531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:48.190930 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:49.515234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:49.584554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:50.098049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:50.265271 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:50.835342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:51.867059 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:52.841097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:53.630890 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:53.695003 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbb8e4-a448-4ae5-8e58-3d28ed48fe5d None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:53.789637 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbb8e4-a448-4ae5-8e58-3d28ed48fe5d None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:53.797718 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ccbaf-dc7f-4688-81c3-a7d3e81f1df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:53.798407 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ccbaf-dc7f-4688-81c3-a7d3e81f1df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:53.798716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ccbaf-dc7f-4688-81c3-a7d3e81f1df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:53.799216 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ccbaf-dc7f-4688-81c3-a7d3e81f1df6 admin admin] PATH_INFO: `/v3/users/6f805b52d7864890a5b71d3f9e3cbeb2` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:53.800598 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ccbaf-dc7f-4688-81c3-a7d3e81f1df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f805b52d7864890a5b71d3f9e3cbeb2)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:53.802559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ccbaf-dc7f-4688-81c3-a7d3e81f1df6 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:54.230066 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e00ccbaf-dc7f-4688-81c3-a7d3e81f1df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f805b52d7864890a5b71d3f9e3cbeb2'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:54.353656 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e00ccbaf-dc7f-4688-81c3-a7d3e81f1df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f805b52d7864890a5b71d3f9e3cbeb2'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:54.354384 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e00ccbaf-dc7f-4688-81c3-a7d3e81f1df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f805b52d7864890a5b71d3f9e3cbeb2'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:54.364815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e00ccbaf-dc7f-4688-81c3-a7d3e81f1df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f805b52d7864890a5b71d3f9e3cbeb2'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:54.367336 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e00ccbaf-dc7f-4688-81c3-a7d3e81f1df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f805b52d7864890a5b71d3f9e3cbeb2'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:54.389692 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1203/2394] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:33:53 2022] DELETE /identity/v3/users/6f805b52d7864890a5b71d3f9e3cbeb2 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:54.395111 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8517c-3312-424e-a6bd-d44f0c72a7a1 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:54.407151 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8517c-3312-424e-a6bd-d44f0c72a7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:54.407151 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8517c-3312-424e-a6bd-d44f0c72a7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:54.416591 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-04d8517c-3312-424e-a6bd-d44f0c72a7a1 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:54.417953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-04d8517c-3312-424e-a6bd-d44f0c72a7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:54.489440 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1192/2395] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:54.499206 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ccbaf-dc7f-4688-81c3-a7d3e81f1df6 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:54.500664 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-e00ccbaf-dc7f-4688-81c3-a7d3e81f1df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:54.567919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ccbaf-dc7f-4688-81c3-a7d3e81f1df6 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:54.571992 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372e2d1-fe3c-4ac6-920c-1a5afe3876c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:54.572620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372e2d1-fe3c-4ac6-920c-1a5afe3876c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:54.572922 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372e2d1-fe3c-4ac6-920c-1a5afe3876c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:54.573720 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372e2d1-fe3c-4ac6-920c-1a5afe3876c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:54.583593 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372e2d1-fe3c-4ac6-920c-1a5afe3876c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:54.585041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372e2d1-fe3c-4ac6-920c-1a5afe3876c5 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:54.595833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1204/2396] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:33:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:33:54.646669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:54.816611 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:55.113293 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8517c-3312-424e-a6bd-d44f0c72a7a1 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:55.113293 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-04d8517c-3312-424e-a6bd-d44f0c72a7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:55.129305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8517c-3312-424e-a6bd-d44f0c72a7a1 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:55.137341 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a69a1c-e12b-4607-ae51-302b1a1d438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:55.138067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a69a1c-e12b-4607-ae51-302b1a1d438a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:55.138565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a69a1c-e12b-4607-ae51-302b1a1d438a admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:55.138888 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a69a1c-e12b-4607-ae51-302b1a1d438a admin admin] PATH_INFO: `/v3/projects/7c7797a692c94a6eb441c1ff9bb62ca6` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:55.140431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a69a1c-e12b-4607-ae51-302b1a1d438a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c7797a692c94a6eb441c1ff9bb62ca6)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:55.143070 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a69a1c-e12b-4607-ae51-302b1a1d438a admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:55.287891 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-66a69a1c-e12b-4607-ae51-302b1a1d438a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c7797a692c94a6eb441c1ff9bb62ca6', 'request_id': 'req-66a69a1c-e12b-4607-ae51-302b1a1d438a'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:55.412769 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-66a69a1c-e12b-4607-ae51-302b1a1d438a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c7797a692c94a6eb441c1ff9bb62ca6', 'request_id': 'req-66a69a1c-e12b-4607-ae51-302b1a1d438a'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:55.423274 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-66a69a1c-e12b-4607-ae51-302b1a1d438a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c7797a692c94a6eb441c1ff9bb62ca6', 'request_id': 'req-66a69a1c-e12b-4607-ae51-302b1a1d438a'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:55.441012 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-66a69a1c-e12b-4607-ae51-302b1a1d438a admin admin] The token cache is being invalidate because project 7c7797a692c94a6eb441c1ff9bb62ca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:33:55.441562 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-66a69a1c-e12b-4607-ae51-302b1a1d438a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:55.442404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-66a69a1c-e12b-4607-ae51-302b1a1d438a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:33:55.445446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1193/2397] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:33:55 2022] DELETE /identity/v3/projects/7c7797a692c94a6eb441c1ff9bb62ca6 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:55.450114 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79d869-191a-4a6d-ab7f-80d7b82ad991 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:55.450791 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79d869-191a-4a6d-ab7f-80d7b82ad991 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:55.451229 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79d869-191a-4a6d-ab7f-80d7b82ad991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:55.472388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-2f79d869-191a-4a6d-ab7f-80d7b82ad991 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:55.473747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-2f79d869-191a-4a6d-ab7f-80d7b82ad991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:55.578639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1205/2398] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:33:55.589632 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2395c-f835-4150-8d2a-93a638df7289 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:55.590169 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2395c-f835-4150-8d2a-93a638df7289 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:55.590665 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2395c-f835-4150-8d2a-93a638df7289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:55.625583 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-a7d2395c-f835-4150-8d2a-93a638df7289 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:55.627864 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a7d2395c-f835-4150-8d2a-93a638df7289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:55.641897 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1194/2399] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:33:55.646417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79d869-191a-4a6d-ab7f-80d7b82ad991 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:55.657824 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79d869-191a-4a6d-ab7f-80d7b82ad991 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:55.664106 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98579795-5a96-4f4b-967b-f0edd703a180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:55.664937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98579795-5a96-4f4b-967b-f0edd703a180 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:55.665209 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98579795-5a96-4f4b-967b-f0edd703a180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:55.665483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98579795-5a96-4f4b-967b-f0edd703a180 admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:55.666134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98579795-5a96-4f4b-967b-f0edd703a180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:33:55.666458 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98579795-5a96-4f4b-967b-f0edd703a180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:55.668772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98579795-5a96-4f4b-967b-f0edd703a180 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:55.683462 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1206/2400] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:33:55.687848 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2395c-f835-4150-8d2a-93a638df7289 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:55.699625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2395c-f835-4150-8d2a-93a638df7289 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:55.705470 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25b9d5-0b5f-4d20-aaae-f6e4ff316630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:55.706271 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25b9d5-0b5f-4d20-aaae-f6e4ff316630 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:55.706546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25b9d5-0b5f-4d20-aaae-f6e4ff316630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:55.706851 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25b9d5-0b5f-4d20-aaae-f6e4ff316630 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:55.707497 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25b9d5-0b5f-4d20-aaae-f6e4ff316630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:55.709555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25b9d5-0b5f-4d20-aaae-f6e4ff316630 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:55.863028 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1195/2401] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:33:55 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:55.867356 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98579795-5a96-4f4b-967b-f0edd703a180 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:55.882684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98579795-5a96-4f4b-967b-f0edd703a180 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:55.971873 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07b3c6-3ab6-4a23-916f-72dacf901db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:55.973299 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07b3c6-3ab6-4a23-916f-72dacf901db2 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:55.973709 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07b3c6-3ab6-4a23-916f-72dacf901db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:55.973994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07b3c6-3ab6-4a23-916f-72dacf901db2 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:55.976625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07b3c6-3ab6-4a23-916f-72dacf901db2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:55.979308 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07b3c6-3ab6-4a23-916f-72dacf901db2 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:55.979443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:56.104301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1207/2402] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:33:55 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:56.108453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25b9d5-0b5f-4d20-aaae-f6e4ff316630 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:56.119080 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25b9d5-0b5f-4d20-aaae-f6e4ff316630 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:56.123834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25c787-0eeb-4a5a-969a-8a1713414780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:56.124698 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25c787-0eeb-4a5a-969a-8a1713414780 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:56.124873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25c787-0eeb-4a5a-969a-8a1713414780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:56.125014 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25c787-0eeb-4a5a-969a-8a1713414780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:56.125651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25c787-0eeb-4a5a-969a-8a1713414780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:56.127305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25c787-0eeb-4a5a-969a-8a1713414780 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:56.138648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1196/2403] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:56.143902 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07b3c6-3ab6-4a23-916f-72dacf901db2 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:56.155121 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07b3c6-3ab6-4a23-916f-72dacf901db2 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:56.160035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ee6de-08e9-4b7d-9a79-3cbc44fbf709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:56.160630 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ee6de-08e9-4b7d-9a79-3cbc44fbf709 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:56.160905 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ee6de-08e9-4b7d-9a79-3cbc44fbf709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:56.161176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ee6de-08e9-4b7d-9a79-3cbc44fbf709 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:56.161909 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ee6de-08e9-4b7d-9a79-3cbc44fbf709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:56.163570 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ee6de-08e9-4b7d-9a79-3cbc44fbf709 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:56.178889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1208/2404] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:56.180988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25c787-0eeb-4a5a-969a-8a1713414780 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:56.191733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25c787-0eeb-4a5a-969a-8a1713414780 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:56.205024 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f65182-1667-448e-adb5-8cc57889f8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:56.205024 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f65182-1667-448e-adb5-8cc57889f8ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:56.205024 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f65182-1667-448e-adb5-8cc57889f8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:56.205024 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f65182-1667-448e-adb5-8cc57889f8ff admin admin] PATH_INFO: `/v3/projects/0c88f891b1f242f483bc2ca0e1733273/users/0f488de5fa0b4bcba7a8e6cdbef8e5ef/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:56.220925 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f65182-1667-448e-adb5-8cc57889f8ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c88f891b1f242f483bc2ca0e1733273, user_id=0f488de5fa0b4bcba7a8e6cdbef8e5ef, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:56.223682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f65182-1667-448e-adb5-8cc57889f8ff admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:56.344616 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1197/2405] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:33:56 2022] PUT /identity/v3/projects/0c88f891b1f242f483bc2ca0e1733273/users/0f488de5fa0b4bcba7a8e6cdbef8e5ef/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:56.420090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f292bf-addc-4bb3-bc6f-722f3b0762f0 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:56.420388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f292bf-addc-4bb3-bc6f-722f3b0762f0 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:56.422226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f292bf-addc-4bb3-bc6f-722f3b0762f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:56.458370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-13f292bf-addc-4bb3-bc6f-722f3b0762f0 None None] MFA Rules not processed for user `0f488de5fa0b4bcba7a8e6cdbef8e5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:56.459703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-13f292bf-addc-4bb3-bc6f-722f3b0762f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:56.509747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:56.537925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1209/2406] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:56.542465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f65182-1667-448e-adb5-8cc57889f8ff admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:56.607201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f65182-1667-448e-adb5-8cc57889f8ff admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:56.613170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89077c63-1a6c-4727-b802-0737ca86ed35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:56.613805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89077c63-1a6c-4727-b802-0737ca86ed35 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:56.614090 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89077c63-1a6c-4727-b802-0737ca86ed35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:56.614543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89077c63-1a6c-4727-b802-0737ca86ed35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:56.615333 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89077c63-1a6c-4727-b802-0737ca86ed35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:56.617340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89077c63-1a6c-4727-b802-0737ca86ed35 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:56.784136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f292bf-addc-4bb3-bc6f-722f3b0762f0 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:56.791162 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1198/2407] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:33:56 2022] POST /identity/v3/projects => generated 377 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:56.810554 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f292bf-addc-4bb3-bc6f-722f3b0762f0 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:56.911533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee86a0-efda-49c4-bc1f-5589b3c28c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:56.911533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee86a0-efda-49c4-bc1f-5589b3c28c81 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:56.911893 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee86a0-efda-49c4-bc1f-5589b3c28c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:56.911893 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee86a0-efda-49c4-bc1f-5589b3c28c81 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:56.912762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee86a0-efda-49c4-bc1f-5589b3c28c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:56.917528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee86a0-efda-49c4-bc1f-5589b3c28c81 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:57.060141 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1210/2408] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:33:56 2022] POST /identity/v3/users => generated 289 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:57.064646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89077c63-1a6c-4727-b802-0737ca86ed35 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:57.077020 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89077c63-1a6c-4727-b802-0737ca86ed35 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:57.083174 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670dceca-2490-4b83-b6bd-00b1920beaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:57.084353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dceca-2490-4b83-b6bd-00b1920beaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:57.084484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dceca-2490-4b83-b6bd-00b1920beaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:57.084737 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dceca-2490-4b83-b6bd-00b1920beaa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:57.085404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670dceca-2490-4b83-b6bd-00b1920beaa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:57.087478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670dceca-2490-4b83-b6bd-00b1920beaa5 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:57.103902 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1199/2409] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:57.109370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee86a0-efda-49c4-bc1f-5589b3c28c81 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:57.131990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee86a0-efda-49c4-bc1f-5589b3c28c81 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:57.139859 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b1237-7e57-4075-9c8f-6853b994e8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:57.141408 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b1237-7e57-4075-9c8f-6853b994e8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:57.141408 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b1237-7e57-4075-9c8f-6853b994e8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:57.142185 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b1237-7e57-4075-9c8f-6853b994e8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:57.144710 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b1237-7e57-4075-9c8f-6853b994e8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:57.146219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b1237-7e57-4075-9c8f-6853b994e8c0 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:57.161942 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1211/2410] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:33:57.168521 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670dceca-2490-4b83-b6bd-00b1920beaa5 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:57.186135 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670dceca-2490-4b83-b6bd-00b1920beaa5 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:57.192281 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e6b0d-f855-424b-a1d8-8855e4b7771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:57.193532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e6b0d-f855-424b-a1d8-8855e4b7771c admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:57.194028 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e6b0d-f855-424b-a1d8-8855e4b7771c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:57.194684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e6b0d-f855-424b-a1d8-8855e4b7771c admin admin] PATH_INFO: `/v3/projects/db91224d34534c2a9ca1a1c06be43aa7/users/988842a572204230ab02600e45b616b4/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:57.222212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e6b0d-f855-424b-a1d8-8855e4b7771c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db91224d34534c2a9ca1a1c06be43aa7, user_id=988842a572204230ab02600e45b616b4, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:57.226173 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e6b0d-f855-424b-a1d8-8855e4b7771c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:57.384741 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1200/2411] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:33:57 2022] PUT /identity/v3/projects/db91224d34534c2a9ca1a1c06be43aa7/users/988842a572204230ab02600e45b616b4/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:57.396308 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13dc3a-c0e7-4fc6-b4e2-3867716da886 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:57.396626 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13dc3a-c0e7-4fc6-b4e2-3867716da886 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:57.396948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13dc3a-c0e7-4fc6-b4e2-3867716da886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:57.432797 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-4d13dc3a-c0e7-4fc6-b4e2-3867716da886 None None] MFA Rules not processed for user `988842a572204230ab02600e45b616b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:57.433465 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-4d13dc3a-c0e7-4fc6-b4e2-3867716da886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:57.510275 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1212/2412] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:57.515824 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e6b0d-f855-424b-a1d8-8855e4b7771c admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:57.603941 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e6b0d-f855-424b-a1d8-8855e4b7771c admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:57.611284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d0ff5-97fe-4f39-af72-b7b8bbb96c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:57.611999 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d0ff5-97fe-4f39-af72-b7b8bbb96c05 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:57.612345 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d0ff5-97fe-4f39-af72-b7b8bbb96c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:57.612768 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d0ff5-97fe-4f39-af72-b7b8bbb96c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:57.613274 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d0ff5-97fe-4f39-af72-b7b8bbb96c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:57.616377 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d0ff5-97fe-4f39-af72-b7b8bbb96c05 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:57.781364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1201/2413] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:33:57 2022] POST /identity/v3/projects => generated 375 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:57.783868 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13dc3a-c0e7-4fc6-b4e2-3867716da886 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:57.805429 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13dc3a-c0e7-4fc6-b4e2-3867716da886 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:57.914816 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672373d-a000-47f3-8c3d-7d3ef193c08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:57.915859 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672373d-a000-47f3-8c3d-7d3ef193c08a admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:57.916358 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672373d-a000-47f3-8c3d-7d3ef193c08a admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:57.917313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672373d-a000-47f3-8c3d-7d3ef193c08a admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:57.918342 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672373d-a000-47f3-8c3d-7d3ef193c08a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:57.921846 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672373d-a000-47f3-8c3d-7d3ef193c08a admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:58.258648 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1213/2414] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:33:57 2022] POST /identity/v3/users => generated 294 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:33:58.263204 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d0ff5-97fe-4f39-af72-b7b8bbb96c05 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:58.277145 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d0ff5-97fe-4f39-af72-b7b8bbb96c05 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:58.308296 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c7315-325e-4f2f-90b6-c1c87290c655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:58.308296 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c7315-325e-4f2f-90b6-c1c87290c655 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:58.308296 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c7315-325e-4f2f-90b6-c1c87290c655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:58.308296 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c7315-325e-4f2f-90b6-c1c87290c655 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:58.308875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c7315-325e-4f2f-90b6-c1c87290c655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:58.308875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c7315-325e-4f2f-90b6-c1c87290c655 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:58.347049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1202/2415] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:58.356857 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672373d-a000-47f3-8c3d-7d3ef193c08a admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:58.373188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672373d-a000-47f3-8c3d-7d3ef193c08a admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:58.383728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc52785-51f7-4eca-beb7-a0df7bb89ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:58.409147 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc52785-51f7-4eca-beb7-a0df7bb89ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:58.409147 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc52785-51f7-4eca-beb7-a0df7bb89ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:58.409147 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc52785-51f7-4eca-beb7-a0df7bb89ad2 admin admin] PATH_INFO: `/v3/projects/faa94bb1e5c14f85b41f5a099c2d9cae/users/66058913a24d40ee97e1c3a50daa4254/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:58.443541 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc52785-51f7-4eca-beb7-a0df7bb89ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa94bb1e5c14f85b41f5a099c2d9cae, user_id=66058913a24d40ee97e1c3a50daa4254, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:58.451776 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc52785-51f7-4eca-beb7-a0df7bb89ad2 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:58.628439 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1214/2416] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:33:58 2022] PUT /identity/v3/projects/faa94bb1e5c14f85b41f5a099c2d9cae/users/66058913a24d40ee97e1c3a50daa4254/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:58.632787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c7315-325e-4f2f-90b6-c1c87290c655 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:58.653352 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c7315-325e-4f2f-90b6-c1c87290c655 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:58.785907 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4f722-f45c-4e04-b8f9-4862600c8537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:58.786844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f722-f45c-4e04-b8f9-4862600c8537 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:58.787395 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f722-f45c-4e04-b8f9-4862600c8537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:58.787692 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f722-f45c-4e04-b8f9-4862600c8537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:58.788456 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4f722-f45c-4e04-b8f9-4862600c8537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:58.790154 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4f722-f45c-4e04-b8f9-4862600c8537 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:58.802141 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1203/2417] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:33:58.806689 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc52785-51f7-4eca-beb7-a0df7bb89ad2 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:58.819815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc52785-51f7-4eca-beb7-a0df7bb89ad2 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:58.825200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634c655-6fa5-4cd7-b613-5440500c0cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:58.825982 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634c655-6fa5-4cd7-b613-5440500c0cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:58.830516 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634c655-6fa5-4cd7-b613-5440500c0cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:58.830516 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634c655-6fa5-4cd7-b613-5440500c0cd9 admin admin] PATH_INFO: `/v3/projects/faa94bb1e5c14f85b41f5a099c2d9cae/users/66058913a24d40ee97e1c3a50daa4254/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:58.830516 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634c655-6fa5-4cd7-b613-5440500c0cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa94bb1e5c14f85b41f5a099c2d9cae, user_id=66058913a24d40ee97e1c3a50daa4254, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:58.832309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634c655-6fa5-4cd7-b613-5440500c0cd9 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:58.850180 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1215/2418] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:33:58 2022] PUT /identity/v3/projects/faa94bb1e5c14f85b41f5a099c2d9cae/users/66058913a24d40ee97e1c3a50daa4254/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:33:58.868732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83213a10-e159-4d27-870e-c24182d65d48 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:58.869298 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83213a10-e159-4d27-870e-c24182d65d48 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:58.869834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83213a10-e159-4d27-870e-c24182d65d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:58.949899 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-83213a10-e159-4d27-870e-c24182d65d48 None None] MFA Rules not processed for user `66058913a24d40ee97e1c3a50daa4254`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:58.951519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-83213a10-e159-4d27-870e-c24182d65d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:59.129593 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1204/2419] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:33:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:33:59.145241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634c655-6fa5-4cd7-b613-5440500c0cd9 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:59.147206 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f634c655-6fa5-4cd7-b613-5440500c0cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:59.263610 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:59.282184 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634c655-6fa5-4cd7-b613-5440500c0cd9 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:33:59.287330 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8981d-211e-4978-96ab-aab6e6d52e18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:33:59.288141 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8981d-211e-4978-96ab-aab6e6d52e18 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:59.288424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8981d-211e-4978-96ab-aab6e6d52e18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:59.288708 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8981d-211e-4978-96ab-aab6e6d52e18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:59.463997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8981d-211e-4978-96ab-aab6e6d52e18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:33:59.467393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8981d-211e-4978-96ab-aab6e6d52e18 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:33:59.498401 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1216/2420] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:33:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:33:59.660143 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c50b7-33bd-4ff5-baa8-bc883a412e2e None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:33:59.661389 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c50b7-33bd-4ff5-baa8-bc883a412e2e None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:33:59.661713 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c50b7-33bd-4ff5-baa8-bc883a412e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:33:59.692094 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-751c50b7-33bd-4ff5-baa8-bc883a412e2e None None] MFA Rules not processed for user `f2cea4c08f324769bf6dcea58c9394b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:33:59.693665 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-751c50b7-33bd-4ff5-baa8-bc883a412e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:33:59.766845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:59.861844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1205/2421] 10.222.0.83 () {58 vars in 1009 bytes} [Fri Sep 23 01:33:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:33:59.934101 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8981d-211e-4978-96ab-aab6e6d52e18 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:33:59.935911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-3ee8981d-211e-4978-96ab-aab6e6d52e18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:00.047961 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8981d-211e-4978-96ab-aab6e6d52e18 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:00.053458 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed06fc-76bc-4fad-8cc2-78c9c4b2ddd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526c7ad227943d1a2bba7b5e2e039e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:00.054578 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed06fc-76bc-4fad-8cc2-78c9c4b2ddd9 service swift] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:00.055129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed06fc-76bc-4fad-8cc2-78c9c4b2ddd9 service swift] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:00.055612 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed06fc-76bc-4fad-8cc2-78c9c4b2ddd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:00.066524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed06fc-76bc-4fad-8cc2-78c9c4b2ddd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:00.069210 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed06fc-76bc-4fad-8cc2-78c9c4b2ddd9 service swift] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:00.081907 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1217/2422] 10.222.0.83 () {60 vars in 1384 bytes} [Fri Sep 23 01:33:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 01:34:01.819855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:02.134102 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:03.585089 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c50b7-33bd-4ff5-baa8-bc883a412e2e None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:03.589182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-751c50b7-33bd-4ff5-baa8-bc883a412e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:03.612087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:03.628592 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c50b7-33bd-4ff5-baa8-bc883a412e2e None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:03.636974 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163bde2-22ed-4438-8560-26b4eb21b244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:03.638025 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163bde2-22ed-4438-8560-26b4eb21b244 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:03.639441 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163bde2-22ed-4438-8560-26b4eb21b244 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:03.640073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163bde2-22ed-4438-8560-26b4eb21b244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:03.848139 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163bde2-22ed-4438-8560-26b4eb21b244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:03.849985 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163bde2-22ed-4438-8560-26b4eb21b244 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:03.861389 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1206/2423] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:34:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:34:05.514978 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:06.841637 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed06fc-76bc-4fad-8cc2-78c9c4b2ddd9 service swift] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:06.856033 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed06fc-76bc-4fad-8cc2-78c9c4b2ddd9 service swift] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:06.861307 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387999d-404a-446a-91b7-23bc84818c8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:06.862692 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387999d-404a-446a-91b7-23bc84818c8e service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:06.863454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387999d-404a-446a-91b7-23bc84818c8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:06.863776 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387999d-404a-446a-91b7-23bc84818c8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:06.878644 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387999d-404a-446a-91b7-23bc84818c8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:06.880012 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387999d-404a-446a-91b7-23bc84818c8e service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:06.896751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1218/2424] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:34:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:34:07.151351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97698aa-1721-4ff3-88f9-fadd6315cff9 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:07.152617 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97698aa-1721-4ff3-88f9-fadd6315cff9 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:07.152617 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97698aa-1721-4ff3-88f9-fadd6315cff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:07.268390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-f97698aa-1721-4ff3-88f9-fadd6315cff9 None None] MFA Rules not processed for user `67b89827871f45738162611b31a23509`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:34:07.270066 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f97698aa-1721-4ff3-88f9-fadd6315cff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:07.413088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1207/2425] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:34:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:34:07.520997 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:07.621991 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:07.738541 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387999d-404a-446a-91b7-23bc84818c8e service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:07.741192 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-6387999d-404a-446a-91b7-23bc84818c8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:07.927112 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387999d-404a-446a-91b7-23bc84818c8e service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:07.946402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfc7f7-639d-4029-bebb-9b44c5a2be2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:07.949151 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfc7f7-639d-4029-bebb-9b44c5a2be2c service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:07.949549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfc7f7-639d-4029-bebb-9b44c5a2be2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:07.950624 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfc7f7-639d-4029-bebb-9b44c5a2be2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:07.965630 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-fdcfc7f7-639d-4029-bebb-9b44c5a2be2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:08.134386 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfc7f7-639d-4029-bebb-9b44c5a2be2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:08.137954 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfc7f7-639d-4029-bebb-9b44c5a2be2c service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:08.170900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1219/2426] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:34:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:34:08.172291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:09.644564 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:10.590764 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:11.676666 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:12.492329 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:12.646775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:13.218788 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:13.456745 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:14.014480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97698aa-1721-4ff3-88f9-fadd6315cff9 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:14.016603 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f97698aa-1721-4ff3-88f9-fadd6315cff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:14.143709 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfc7f7-639d-4029-bebb-9b44c5a2be2c service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:14.266644 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:14.296476 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97698aa-1721-4ff3-88f9-fadd6315cff9 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:14.308827 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13b8fb-bc26-4e0e-a1fb-fc102d4e8f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:14.310811 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13b8fb-bc26-4e0e-a1fb-fc102d4e8f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:14.311664 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13b8fb-bc26-4e0e-a1fb-fc102d4e8f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:14.312388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13b8fb-bc26-4e0e-a1fb-fc102d4e8f86 admin admin] PATH_INFO: `/v3/users/6d6f8c19241944b5b76221fe67181c77` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:14.317882 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13b8fb-bc26-4e0e-a1fb-fc102d4e8f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d6f8c19241944b5b76221fe67181c77)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:14.322022 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13b8fb-bc26-4e0e-a1fb-fc102d4e8f86 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:14.356172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:14.428608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfc7f7-639d-4029-bebb-9b44c5a2be2c service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:14.428608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a817f-195a-41d4-aa84-9ba7f2f6f878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:14.428608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a817f-195a-41d4-aa84-9ba7f2f6f878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:14.428608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a817f-195a-41d4-aa84-9ba7f2f6f878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:14.429571 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a817f-195a-41d4-aa84-9ba7f2f6f878 admin admin] PATH_INFO: `/v3/users/0f488de5fa0b4bcba7a8e6cdbef8e5ef` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:14.429571 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a817f-195a-41d4-aa84-9ba7f2f6f878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f488de5fa0b4bcba7a8e6cdbef8e5ef)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:14.429571 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a817f-195a-41d4-aa84-9ba7f2f6f878 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:14.692025 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-df13b8fb-bc26-4e0e-a1fb-fc102d4e8f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d6f8c19241944b5b76221fe67181c77'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:14.707490 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-df13b8fb-bc26-4e0e-a1fb-fc102d4e8f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d6f8c19241944b5b76221fe67181c77'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:14.730144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-426a817f-195a-41d4-aa84-9ba7f2f6f878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f488de5fa0b4bcba7a8e6cdbef8e5ef'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:14.800891 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:14.803769 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-df13b8fb-bc26-4e0e-a1fb-fc102d4e8f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d6f8c19241944b5b76221fe67181c77'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:14.806977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-df13b8fb-bc26-4e0e-a1fb-fc102d4e8f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d6f8c19241944b5b76221fe67181c77'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:14.841081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-df13b8fb-bc26-4e0e-a1fb-fc102d4e8f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d6f8c19241944b5b76221fe67181c77'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:14.875225 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1208/2427] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:34:14 2022] DELETE /identity/v3/users/6d6f8c19241944b5b76221fe67181c77 => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:34:14.879865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb91cc-7ef8-4f9d-8e56-c285393131d2 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:14.884186 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb91cc-7ef8-4f9d-8e56-c285393131d2 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:14.884186 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb91cc-7ef8-4f9d-8e56-c285393131d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:14.936396 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-08eb91cc-7ef8-4f9d-8e56-c285393131d2 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:34:14.938673 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-08eb91cc-7ef8-4f9d-8e56-c285393131d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:14.938987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-426a817f-195a-41d4-aa84-9ba7f2f6f878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f488de5fa0b4bcba7a8e6cdbef8e5ef'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:14.940123 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-426a817f-195a-41d4-aa84-9ba7f2f6f878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f488de5fa0b4bcba7a8e6cdbef8e5ef'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:14.981589 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-426a817f-195a-41d4-aa84-9ba7f2f6f878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f488de5fa0b4bcba7a8e6cdbef8e5ef'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:14.983300 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-426a817f-195a-41d4-aa84-9ba7f2f6f878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f488de5fa0b4bcba7a8e6cdbef8e5ef'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:15.029078 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1220/2428] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:34:14 2022] DELETE /identity/v3/users/0f488de5fa0b4bcba7a8e6cdbef8e5ef => generated 0 bytes in 880 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:34:15.030577 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4daff-438e-4b3e-a3c2-bbb6f1124f54 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:15.030927 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4daff-438e-4b3e-a3c2-bbb6f1124f54 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:15.031187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4daff-438e-4b3e-a3c2-bbb6f1124f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:15.085222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-7fd4daff-438e-4b3e-a3c2-bbb6f1124f54 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:34:15.086730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-7fd4daff-438e-4b3e-a3c2-bbb6f1124f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:15.132253 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1209/2429] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:34:15.140454 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb91cc-7ef8-4f9d-8e56-c285393131d2 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:15.146650 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-08eb91cc-7ef8-4f9d-8e56-c285393131d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:15.183081 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1221/2430] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:34:15.196827 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4daff-438e-4b3e-a3c2-bbb6f1124f54 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:15.198870 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-7fd4daff-438e-4b3e-a3c2-bbb6f1124f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:15.258228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:15.292983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:15.301213 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4daff-438e-4b3e-a3c2-bbb6f1124f54 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:15.305783 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16260f08-e7fc-4264-b3a8-31029bb23c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:15.306706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16260f08-e7fc-4264-b3a8-31029bb23c46 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:15.307530 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16260f08-e7fc-4264-b3a8-31029bb23c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:15.308165 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16260f08-e7fc-4264-b3a8-31029bb23c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:15.319247 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16260f08-e7fc-4264-b3a8-31029bb23c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:15.320919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16260f08-e7fc-4264-b3a8-31029bb23c46 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:15.339004 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb91cc-7ef8-4f9d-8e56-c285393131d2 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:15.341267 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec8e88-cbb1-4aea-80cf-b8b57aa364c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:15.343197 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec8e88-cbb1-4aea-80cf-b8b57aa364c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:15.343877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec8e88-cbb1-4aea-80cf-b8b57aa364c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:15.344596 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec8e88-cbb1-4aea-80cf-b8b57aa364c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:15.344789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1222/2431] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:34:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:34:15.370332 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec8e88-cbb1-4aea-80cf-b8b57aa364c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:15.374702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec8e88-cbb1-4aea-80cf-b8b57aa364c6 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:15.398810 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1210/2432] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:34:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:34:15.834719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:15.903513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:16.075390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:16.204488 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16260f08-e7fc-4264-b3a8-31029bb23c46 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:16.208137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-16260f08-e7fc-4264-b3a8-31029bb23c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:16.259746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16260f08-e7fc-4264-b3a8-31029bb23c46 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:16.279426 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3823d-437b-473f-a1c4-7aa717a906d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:16.280334 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3823d-437b-473f-a1c4-7aa717a906d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:16.280629 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3823d-437b-473f-a1c4-7aa717a906d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:16.280884 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3823d-437b-473f-a1c4-7aa717a906d0 admin admin] PATH_INFO: `/v3/projects/52fc6917d8c44d659adb611b06741889` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:16.285225 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3823d-437b-473f-a1c4-7aa717a906d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52fc6917d8c44d659adb611b06741889)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:16.287601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3823d-437b-473f-a1c4-7aa717a906d0 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:16.344788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:16.370344 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec8e88-cbb1-4aea-80cf-b8b57aa364c6 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:16.377056 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-3aec8e88-cbb1-4aea-80cf-b8b57aa364c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:16.435254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec8e88-cbb1-4aea-80cf-b8b57aa364c6 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:16.435254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c13e19-5014-40a9-9c78-4791205e2e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:16.435254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c13e19-5014-40a9-9c78-4791205e2e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:16.435254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c13e19-5014-40a9-9c78-4791205e2e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:16.435576 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c13e19-5014-40a9-9c78-4791205e2e8c admin admin] PATH_INFO: `/v3/projects/0c88f891b1f242f483bc2ca0e1733273` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:16.435576 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c13e19-5014-40a9-9c78-4791205e2e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c88f891b1f242f483bc2ca0e1733273)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:16.435713 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c13e19-5014-40a9-9c78-4791205e2e8c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:16.481311 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-cbe3823d-437b-473f-a1c4-7aa717a906d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52fc6917d8c44d659adb611b06741889', 'request_id': 'req-cbe3823d-437b-473f-a1c4-7aa717a906d0'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:16.628142 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-cbe3823d-437b-473f-a1c4-7aa717a906d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52fc6917d8c44d659adb611b06741889', 'request_id': 'req-cbe3823d-437b-473f-a1c4-7aa717a906d0'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:16.637541 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-cbe3823d-437b-473f-a1c4-7aa717a906d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52fc6917d8c44d659adb611b06741889', 'request_id': 'req-cbe3823d-437b-473f-a1c4-7aa717a906d0'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:16.651184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d5c13e19-5014-40a9-9c78-4791205e2e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c88f891b1f242f483bc2ca0e1733273', 'request_id': 'req-d5c13e19-5014-40a9-9c78-4791205e2e8c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:16.652330 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-cbe3823d-437b-473f-a1c4-7aa717a906d0 admin admin] The token cache is being invalidate because project 52fc6917d8c44d659adb611b06741889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:34:16.652614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-cbe3823d-437b-473f-a1c4-7aa717a906d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:16.654051 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-cbe3823d-437b-473f-a1c4-7aa717a906d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:16.655968 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1223/2433] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:34:16 2022] DELETE /identity/v3/projects/52fc6917d8c44d659adb611b06741889 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:34:16.661512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee4a03-e616-4aa8-bbcd-f4940bd0afdd None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:16.661512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee4a03-e616-4aa8-bbcd-f4940bd0afdd None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:16.661836 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee4a03-e616-4aa8-bbcd-f4940bd0afdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:16.690388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-04ee4a03-e616-4aa8-bbcd-f4940bd0afdd None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:34:16.692418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-04ee4a03-e616-4aa8-bbcd-f4940bd0afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:16.742096 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d5c13e19-5014-40a9-9c78-4791205e2e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c88f891b1f242f483bc2ca0e1733273', 'request_id': 'req-d5c13e19-5014-40a9-9c78-4791205e2e8c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:16.752491 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d5c13e19-5014-40a9-9c78-4791205e2e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c88f891b1f242f483bc2ca0e1733273', 'request_id': 'req-d5c13e19-5014-40a9-9c78-4791205e2e8c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:16.775427 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d5c13e19-5014-40a9-9c78-4791205e2e8c admin admin] The token cache is being invalidate because project 0c88f891b1f242f483bc2ca0e1733273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:34:16.776375 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d5c13e19-5014-40a9-9c78-4791205e2e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:16.777096 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d5c13e19-5014-40a9-9c78-4791205e2e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:16.780080 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1211/2434] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:34:16 2022] DELETE /identity/v3/projects/0c88f891b1f242f483bc2ca0e1733273 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:34:16.781643 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1224/2435] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:34:16.789936 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3f455-16eb-45ec-b3fe-ef4ffa74ea7b None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:16.795999 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3f455-16eb-45ec-b3fe-ef4ffa74ea7b None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:16.795999 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3f455-16eb-45ec-b3fe-ef4ffa74ea7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:16.796236 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee4a03-e616-4aa8-bbcd-f4940bd0afdd None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:16.797519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-04ee4a03-e616-4aa8-bbcd-f4940bd0afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:16.815178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee4a03-e616-4aa8-bbcd-f4940bd0afdd None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:16.821324 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-34a3f455-16eb-45ec-b3fe-ef4ffa74ea7b None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:34:16.821622 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de414aa5-ec56-4978-b6ed-8e51aafa4b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:16.822300 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de414aa5-ec56-4978-b6ed-8e51aafa4b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:16.822693 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de414aa5-ec56-4978-b6ed-8e51aafa4b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:16.822964 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de414aa5-ec56-4978-b6ed-8e51aafa4b47 admin admin] PATH_INFO: `/v3/users/988842a572204230ab02600e45b616b4` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:16.823259 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-34a3f455-16eb-45ec-b3fe-ef4ffa74ea7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:16.824383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de414aa5-ec56-4978-b6ed-8e51aafa4b47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=988842a572204230ab02600e45b616b4)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:16.827263 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de414aa5-ec56-4978-b6ed-8e51aafa4b47 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:16.841100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1212/2436] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:34:16.846453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3f455-16eb-45ec-b3fe-ef4ffa74ea7b None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:16.867599 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3f455-16eb-45ec-b3fe-ef4ffa74ea7b None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:16.875070 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8710e9-c5a2-409c-a4e3-c11b14edcf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:16.876303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8710e9-c5a2-409c-a4e3-c11b14edcf9d admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:16.877027 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8710e9-c5a2-409c-a4e3-c11b14edcf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:16.877603 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8710e9-c5a2-409c-a4e3-c11b14edcf9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:16.878809 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8710e9-c5a2-409c-a4e3-c11b14edcf9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:34:16.879280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8710e9-c5a2-409c-a4e3-c11b14edcf9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:16.883068 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8710e9-c5a2-409c-a4e3-c11b14edcf9d admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:16.905571 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1213/2437] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:34:16.911857 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8710e9-c5a2-409c-a4e3-c11b14edcf9d admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:16.927220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8710e9-c5a2-409c-a4e3-c11b14edcf9d admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:16.935958 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3110b14-bd4e-46a9-825a-617b8dfc3540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:16.937210 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3110b14-bd4e-46a9-825a-617b8dfc3540 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:16.937669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3110b14-bd4e-46a9-825a-617b8dfc3540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:16.938232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3110b14-bd4e-46a9-825a-617b8dfc3540 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:16.939405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3110b14-bd4e-46a9-825a-617b8dfc3540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:16.944728 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3110b14-bd4e-46a9-825a-617b8dfc3540 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:17.114069 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1214/2438] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:34:16 2022] POST /identity/v3/projects => generated 381 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:34:17.116115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3110b14-bd4e-46a9-825a-617b8dfc3540 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:17.204618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-de414aa5-ec56-4978-b6ed-8e51aafa4b47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '988842a572204230ab02600e45b616b4'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:17.222771 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3110b14-bd4e-46a9-825a-617b8dfc3540 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:17.229576 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856da43-ab38-49e3-a1f0-0dadaa760a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:17.229797 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856da43-ab38-49e3-a1f0-0dadaa760a4e admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:17.236615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856da43-ab38-49e3-a1f0-0dadaa760a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:17.236615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856da43-ab38-49e3-a1f0-0dadaa760a4e admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:17.236615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856da43-ab38-49e3-a1f0-0dadaa760a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:17.236615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856da43-ab38-49e3-a1f0-0dadaa760a4e admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:17.269494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:17.302243 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-de414aa5-ec56-4978-b6ed-8e51aafa4b47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '988842a572204230ab02600e45b616b4'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:17.303251 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-de414aa5-ec56-4978-b6ed-8e51aafa4b47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '988842a572204230ab02600e45b616b4'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:17.315315 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-de414aa5-ec56-4978-b6ed-8e51aafa4b47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '988842a572204230ab02600e45b616b4'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:17.317015 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-de414aa5-ec56-4978-b6ed-8e51aafa4b47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '988842a572204230ab02600e45b616b4'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:17.340604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:17.348490 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1215/2439] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:34:17 2022] POST /identity/v3/users => generated 291 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:34:17.353418 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856da43-ab38-49e3-a1f0-0dadaa760a4e admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:17.357214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4856da43-ab38-49e3-a1f0-0dadaa760a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:17.364526 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1225/2440] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:34:16 2022] DELETE /identity/v3/users/988842a572204230ab02600e45b616b4 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:34:17.399974 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856da43-ab38-49e3-a1f0-0dadaa760a4e admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:17.544843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d0a75-b0b5-4c5b-8ad0-6b79d2b92b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:17.546556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d0a75-b0b5-4c5b-8ad0-6b79d2b92b71 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:17.546955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d0a75-b0b5-4c5b-8ad0-6b79d2b92b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:17.548239 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d0a75-b0b5-4c5b-8ad0-6b79d2b92b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:17.549134 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d0a75-b0b5-4c5b-8ad0-6b79d2b92b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:17.554052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d0a75-b0b5-4c5b-8ad0-6b79d2b92b71 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:17.585917 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1216/2441] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:34:17.591510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de414aa5-ec56-4978-b6ed-8e51aafa4b47 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:17.607371 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de414aa5-ec56-4978-b6ed-8e51aafa4b47 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:17.614744 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa1e13-fbb2-46a8-b742-97d6a622c444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:17.615880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa1e13-fbb2-46a8-b742-97d6a622c444 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:17.616492 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa1e13-fbb2-46a8-b742-97d6a622c444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:17.616920 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa1e13-fbb2-46a8-b742-97d6a622c444 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:17.618449 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa1e13-fbb2-46a8-b742-97d6a622c444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:17.620885 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa1e13-fbb2-46a8-b742-97d6a622c444 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:17.640429 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1226/2442] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:34:17.653594 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d0a75-b0b5-4c5b-8ad0-6b79d2b92b71 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:17.683344 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d0a75-b0b5-4c5b-8ad0-6b79d2b92b71 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:17.693924 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf1433-629d-4f97-b0b9-e9f60d743592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:17.698269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf1433-629d-4f97-b0b9-e9f60d743592 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:17.698269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf1433-629d-4f97-b0b9-e9f60d743592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:17.698269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf1433-629d-4f97-b0b9-e9f60d743592 admin admin] PATH_INFO: `/v3/projects/7649509ee74b4e3a9d4b275c913993cd/users/c88f23161cd447a2800244936f7faff9/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:17.744459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf1433-629d-4f97-b0b9-e9f60d743592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7649509ee74b4e3a9d4b275c913993cd, user_id=c88f23161cd447a2800244936f7faff9, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:17.748368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf1433-629d-4f97-b0b9-e9f60d743592 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:17.959136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:17.965718 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1217/2443] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:34:17 2022] PUT /identity/v3/projects/7649509ee74b4e3a9d4b275c913993cd/users/c88f23161cd447a2800244936f7faff9/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:34:17.971298 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611bb7-51e7-4b0e-b5df-56a59ede0331 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:17.971584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611bb7-51e7-4b0e-b5df-56a59ede0331 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:17.972867 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611bb7-51e7-4b0e-b5df-56a59ede0331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:18.022747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-0d611bb7-51e7-4b0e-b5df-56a59ede0331 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:34:18.022747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-0d611bb7-51e7-4b0e-b5df-56a59ede0331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:18.172042 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1227/2444] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:34:18.186902 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf1433-629d-4f97-b0b9-e9f60d743592 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:18.190558 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-94cf1433-629d-4f97-b0b9-e9f60d743592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:18.284444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf1433-629d-4f97-b0b9-e9f60d743592 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:18.288373 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3685ec-9fe3-40fd-8c9c-fec4de7aa32f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:18.289004 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3685ec-9fe3-40fd-8c9c-fec4de7aa32f service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:18.289340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3685ec-9fe3-40fd-8c9c-fec4de7aa32f service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:18.289713 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3685ec-9fe3-40fd-8c9c-fec4de7aa32f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:18.303998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3685ec-9fe3-40fd-8c9c-fec4de7aa32f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:18.306104 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3685ec-9fe3-40fd-8c9c-fec4de7aa32f service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:18.330807 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1218/2445] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:34:18.383588 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d611bb7-51e7-4b0e-b5df-56a59ede0331 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:18.387010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-0d611bb7-51e7-4b0e-b5df-56a59ede0331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:18.427889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d611bb7-51e7-4b0e-b5df-56a59ede0331 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:18.437425 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d8c52-0dbe-4dd0-bb23-8b58677f33fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:18.438396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d8c52-0dbe-4dd0-bb23-8b58677f33fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:18.439814 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d8c52-0dbe-4dd0-bb23-8b58677f33fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:18.440115 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d8c52-0dbe-4dd0-bb23-8b58677f33fb admin admin] PATH_INFO: `/v3/projects/db91224d34534c2a9ca1a1c06be43aa7` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:18.441473 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d8c52-0dbe-4dd0-bb23-8b58677f33fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=db91224d34534c2a9ca1a1c06be43aa7)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:18.444453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d8c52-0dbe-4dd0-bb23-8b58677f33fb admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:18.614912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-246d8c52-0dbe-4dd0-bb23-8b58677f33fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db91224d34534c2a9ca1a1c06be43aa7', 'request_id': 'req-246d8c52-0dbe-4dd0-bb23-8b58677f33fb'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:18.726169 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-246d8c52-0dbe-4dd0-bb23-8b58677f33fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db91224d34534c2a9ca1a1c06be43aa7', 'request_id': 'req-246d8c52-0dbe-4dd0-bb23-8b58677f33fb'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:18.735229 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-246d8c52-0dbe-4dd0-bb23-8b58677f33fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db91224d34534c2a9ca1a1c06be43aa7', 'request_id': 'req-246d8c52-0dbe-4dd0-bb23-8b58677f33fb'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:18.768076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-246d8c52-0dbe-4dd0-bb23-8b58677f33fb admin admin] The token cache is being invalidate because project db91224d34534c2a9ca1a1c06be43aa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:34:18.768076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-246d8c52-0dbe-4dd0-bb23-8b58677f33fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:18.768076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-246d8c52-0dbe-4dd0-bb23-8b58677f33fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:18.768076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1228/2446] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:34:18 2022] DELETE /identity/v3/projects/db91224d34534c2a9ca1a1c06be43aa7 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:34:18.772410 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3685ec-9fe3-40fd-8c9c-fec4de7aa32f service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:18.798517 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3685ec-9fe3-40fd-8c9c-fec4de7aa32f service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:19.017844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b266a4c-324b-4926-81ef-c6b042a8d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:19.021284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b266a4c-324b-4926-81ef-c6b042a8d49a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:19.023406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b266a4c-324b-4926-81ef-c6b042a8d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:19.024890 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b266a4c-324b-4926-81ef-c6b042a8d49a admin admin] PATH_INFO: `/v3/users/66058913a24d40ee97e1c3a50daa4254` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:19.031870 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b266a4c-324b-4926-81ef-c6b042a8d49a admin admin] RBAC: Authorizing `identity:delete_user(user_id=66058913a24d40ee97e1c3a50daa4254)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:19.034346 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b266a4c-324b-4926-81ef-c6b042a8d49a admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:19.628097 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-9b266a4c-324b-4926-81ef-c6b042a8d49a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66058913a24d40ee97e1c3a50daa4254'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:19.641607 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-9b266a4c-324b-4926-81ef-c6b042a8d49a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66058913a24d40ee97e1c3a50daa4254'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:19.749699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-9b266a4c-324b-4926-81ef-c6b042a8d49a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66058913a24d40ee97e1c3a50daa4254'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:19.749699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-9b266a4c-324b-4926-81ef-c6b042a8d49a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66058913a24d40ee97e1c3a50daa4254'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:19.756131 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-9b266a4c-324b-4926-81ef-c6b042a8d49a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66058913a24d40ee97e1c3a50daa4254'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:19.782638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1219/2447] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:34:18 2022] DELETE /identity/v3/users/66058913a24d40ee97e1c3a50daa4254 => generated 0 bytes in 1011 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:34:20.341385 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40a648-3cd3-4b54-b7fa-eead2d77990b None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:20.342167 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40a648-3cd3-4b54-b7fa-eead2d77990b None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:20.342461 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40a648-3cd3-4b54-b7fa-eead2d77990b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:20.376185 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-ec40a648-3cd3-4b54-b7fa-eead2d77990b None None] MFA Rules not processed for user `1541fedac9514a2eb65e8da0cc609fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:34:20.380117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ec40a648-3cd3-4b54-b7fa-eead2d77990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:20.472835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:20.554635 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c830e-53ce-421f-a5dc-3464f64d4cc1 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:20.554933 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c830e-53ce-421f-a5dc-3464f64d4cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:20.555393 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c830e-53ce-421f-a5dc-3464f64d4cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:20.557677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1229/2448] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:34:20.616086 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-573c830e-53ce-421f-a5dc-3464f64d4cc1 None None] MFA Rules not processed for user `c88f23161cd447a2800244936f7faff9`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:34:20.620350 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-573c830e-53ce-421f-a5dc-3464f64d4cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:20.642328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:20.656883 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40a648-3cd3-4b54-b7fa-eead2d77990b None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:20.659698 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ec40a648-3cd3-4b54-b7fa-eead2d77990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:20.778918 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1220/2449] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:34:20.795738 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c830e-53ce-421f-a5dc-3464f64d4cc1 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:20.797999 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-573c830e-53ce-421f-a5dc-3464f64d4cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:20.876216 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40a648-3cd3-4b54-b7fa-eead2d77990b None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:20.883503 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7757f81-ce24-4c21-8d06-48b5c5e7f1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:20.884900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7757f81-ce24-4c21-8d06-48b5c5e7f1ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:20.885386 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7757f81-ce24-4c21-8d06-48b5c5e7f1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:20.885860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7757f81-ce24-4c21-8d06-48b5c5e7f1ea admin admin] PATH_INFO: `/v3/projects/faa94bb1e5c14f85b41f5a099c2d9cae` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:20.887663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7757f81-ce24-4c21-8d06-48b5c5e7f1ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa94bb1e5c14f85b41f5a099c2d9cae)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:20.891136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7757f81-ce24-4c21-8d06-48b5c5e7f1ea admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:20.956041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c830e-53ce-421f-a5dc-3464f64d4cc1 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:20.963565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b762d-950a-4aa2-9aa2-5d685b1fce86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:20.964500 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b762d-950a-4aa2-9aa2-5d685b1fce86 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:20.976468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b762d-950a-4aa2-9aa2-5d685b1fce86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:20.977152 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b762d-950a-4aa2-9aa2-5d685b1fce86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:20.997662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b762d-950a-4aa2-9aa2-5d685b1fce86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:21.000609 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b762d-950a-4aa2-9aa2-5d685b1fce86 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:21.020474 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1221/2450] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:34:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:34:21.091585 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-c7757f81-ce24-4c21-8d06-48b5c5e7f1ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa94bb1e5c14f85b41f5a099c2d9cae', 'request_id': 'req-c7757f81-ce24-4c21-8d06-48b5c5e7f1ea'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:21.252608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-c7757f81-ce24-4c21-8d06-48b5c5e7f1ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa94bb1e5c14f85b41f5a099c2d9cae', 'request_id': 'req-c7757f81-ce24-4c21-8d06-48b5c5e7f1ea'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:21.263576 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-c7757f81-ce24-4c21-8d06-48b5c5e7f1ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa94bb1e5c14f85b41f5a099c2d9cae', 'request_id': 'req-c7757f81-ce24-4c21-8d06-48b5c5e7f1ea'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:21.283613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-c7757f81-ce24-4c21-8d06-48b5c5e7f1ea admin admin] The token cache is being invalidate because project faa94bb1e5c14f85b41f5a099c2d9cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:34:21.283977 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-c7757f81-ce24-4c21-8d06-48b5c5e7f1ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:21.284740 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-c7757f81-ce24-4c21-8d06-48b5c5e7f1ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:21.301770 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1230/2451] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:34:20 2022] DELETE /identity/v3/projects/faa94bb1e5c14f85b41f5a099c2d9cae => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:34:23.149162 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd733-b6d8-4323-95e3-488401255d4c None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:23.151066 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd733-b6d8-4323-95e3-488401255d4c None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:23.152072 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd733-b6d8-4323-95e3-488401255d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:23.204072 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-93dcd733-b6d8-4323-95e3-488401255d4c None None] MFA Rules not processed for user `c88f23161cd447a2800244936f7faff9`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:34:23.208320 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-93dcd733-b6d8-4323-95e3-488401255d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:23.388931 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1222/2452] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:34:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:34:27.045446 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f09c3a-adfc-4122-9274-df5c17df2ea2 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:27.046036 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f09c3a-adfc-4122-9274-df5c17df2ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:27.046464 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f09c3a-adfc-4122-9274-df5c17df2ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:27.082234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-32f09c3a-adfc-4122-9274-df5c17df2ea2 None None] MFA Rules not processed for user `f2cea4c08f324769bf6dcea58c9394b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:34:27.084430 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-32f09c3a-adfc-4122-9274-df5c17df2ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:27.175607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1231/2453] 10.222.0.83 () {58 vars in 967 bytes} [Fri Sep 23 01:34:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:34:27.193256 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcd733-b6d8-4323-95e3-488401255d4c None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:27.195133 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-93dcd733-b6d8-4323-95e3-488401255d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:27.331802 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:27.339303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcd733-b6d8-4323-95e3-488401255d4c None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:27.344630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769b4ac-2927-4234-ab03-cb70f15537d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526c7ad227943d1a2bba7b5e2e039e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:27.345361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769b4ac-2927-4234-ab03-cb70f15537d1 service swift] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:27.345643 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769b4ac-2927-4234-ab03-cb70f15537d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:27.345910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769b4ac-2927-4234-ab03-cb70f15537d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:27.356121 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769b4ac-2927-4234-ab03-cb70f15537d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:27.359557 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769b4ac-2927-4234-ab03-cb70f15537d1 service swift] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:27.367230 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1223/2454] 10.222.0.83 () {60 vars in 1384 bytes} [Fri Sep 23 01:34:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 01:34:31.732040 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f09c3a-adfc-4122-9274-df5c17df2ea2 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:31.733581 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-32f09c3a-adfc-4122-9274-df5c17df2ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:31.784651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:31.873953 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f09c3a-adfc-4122-9274-df5c17df2ea2 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:31.879908 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f579f-e6cc-4c2e-97c9-ec6ad13e1d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:31.880833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f579f-e6cc-4c2e-97c9-ec6ad13e1d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:31.881479 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f579f-e6cc-4c2e-97c9-ec6ad13e1d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:31.881904 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f579f-e6cc-4c2e-97c9-ec6ad13e1d6a admin admin] PATH_INFO: `/v3/users/ef68150915d34826ab861dfbe6d4e3dc` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:31.883660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f579f-e6cc-4c2e-97c9-ec6ad13e1d6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef68150915d34826ab861dfbe6d4e3dc)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:31.886664 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f579f-e6cc-4c2e-97c9-ec6ad13e1d6a admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:32.145755 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f31f579f-e6cc-4c2e-97c9-ec6ad13e1d6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef68150915d34826ab861dfbe6d4e3dc'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:32.238131 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f31f579f-e6cc-4c2e-97c9-ec6ad13e1d6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef68150915d34826ab861dfbe6d4e3dc'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:32.239121 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f31f579f-e6cc-4c2e-97c9-ec6ad13e1d6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef68150915d34826ab861dfbe6d4e3dc'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:32.250970 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f31f579f-e6cc-4c2e-97c9-ec6ad13e1d6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef68150915d34826ab861dfbe6d4e3dc'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:32.252238 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f31f579f-e6cc-4c2e-97c9-ec6ad13e1d6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef68150915d34826ab861dfbe6d4e3dc'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:32.281190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1232/2455] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:34:31 2022] DELETE /identity/v3/users/ef68150915d34826ab861dfbe6d4e3dc => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:34:32.742022 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769b4ac-2927-4234-ab03-cb70f15537d1 service swift] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:32.759252 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769b4ac-2927-4234-ab03-cb70f15537d1 service swift] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:32.844494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6615136-e62f-406a-9ff7-4a5c673909f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:32.845260 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6615136-e62f-406a-9ff7-4a5c673909f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:32.845540 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6615136-e62f-406a-9ff7-4a5c673909f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:32.845930 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6615136-e62f-406a-9ff7-4a5c673909f8 admin admin] PATH_INFO: `/v3/projects/fcf8637049864e26a8af15e6fd3e1f1f` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:32.847343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6615136-e62f-406a-9ff7-4a5c673909f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf8637049864e26a8af15e6fd3e1f1f)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:32.849608 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6615136-e62f-406a-9ff7-4a5c673909f8 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:33.028150 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a6615136-e62f-406a-9ff7-4a5c673909f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf8637049864e26a8af15e6fd3e1f1f', 'request_id': 'req-a6615136-e62f-406a-9ff7-4a5c673909f8'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:33.154961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a6615136-e62f-406a-9ff7-4a5c673909f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf8637049864e26a8af15e6fd3e1f1f', 'request_id': 'req-a6615136-e62f-406a-9ff7-4a5c673909f8'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:33.164332 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a6615136-e62f-406a-9ff7-4a5c673909f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf8637049864e26a8af15e6fd3e1f1f', 'request_id': 'req-a6615136-e62f-406a-9ff7-4a5c673909f8'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:33.181289 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a6615136-e62f-406a-9ff7-4a5c673909f8 admin admin] The token cache is being invalidate because project fcf8637049864e26a8af15e6fd3e1f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:34:33.181703 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a6615136-e62f-406a-9ff7-4a5c673909f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:33.183162 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a6615136-e62f-406a-9ff7-4a5c673909f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:33.185117 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1224/2456] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:34:32 2022] DELETE /identity/v3/projects/fcf8637049864e26a8af15e6fd3e1f1f => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:34:33.193545 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af8cde-b806-433c-a75c-c6117385b3c4 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:33.194088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af8cde-b806-433c-a75c-c6117385b3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:33.194722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af8cde-b806-433c-a75c-c6117385b3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:33.216993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-b2af8cde-b806-433c-a75c-c6117385b3c4 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:34:33.218814 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b2af8cde-b806-433c-a75c-c6117385b3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:33.298807 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1233/2457] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:34:33.305940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a94f2-ae91-48f8-9df3-ecf159e3f006 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:33.306481 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a94f2-ae91-48f8-9df3-ecf159e3f006 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:33.308869 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a94f2-ae91-48f8-9df3-ecf159e3f006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:33.333608 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-726a94f2-ae91-48f8-9df3-ecf159e3f006 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:34:33.335045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-726a94f2-ae91-48f8-9df3-ecf159e3f006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:33.347485 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1225/2458] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:34:33.354092 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af8cde-b806-433c-a75c-c6117385b3c4 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:33.365417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af8cde-b806-433c-a75c-c6117385b3c4 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:33.372425 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70f6b3-87dc-4a73-8fe1-2c45df1333ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:33.373162 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70f6b3-87dc-4a73-8fe1-2c45df1333ff admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:33.373513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70f6b3-87dc-4a73-8fe1-2c45df1333ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:33.373860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70f6b3-87dc-4a73-8fe1-2c45df1333ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:33.374632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70f6b3-87dc-4a73-8fe1-2c45df1333ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:34:33.375037 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70f6b3-87dc-4a73-8fe1-2c45df1333ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:33.376865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70f6b3-87dc-4a73-8fe1-2c45df1333ff admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:33.391092 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1234/2459] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:34:33.395673 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a94f2-ae91-48f8-9df3-ecf159e3f006 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:33.408187 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a94f2-ae91-48f8-9df3-ecf159e3f006 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:33.414396 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ecd1a-9c5e-49bf-915d-c0ae2d0c3447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:33.415626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ecd1a-9c5e-49bf-915d-c0ae2d0c3447 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:33.415927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ecd1a-9c5e-49bf-915d-c0ae2d0c3447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:33.416780 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ecd1a-9c5e-49bf-915d-c0ae2d0c3447 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:33.417531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ecd1a-9c5e-49bf-915d-c0ae2d0c3447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:33.421426 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ecd1a-9c5e-49bf-915d-c0ae2d0c3447 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:33.579740 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1226/2460] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:34:33 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:34:33.594353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70f6b3-87dc-4a73-8fe1-2c45df1333ff admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:33.597297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70f6b3-87dc-4a73-8fe1-2c45df1333ff admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:33.622907 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:33.664877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0132f-a99e-4747-8291-ed81f1130779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:33.665521 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0132f-a99e-4747-8291-ed81f1130779 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:33.666070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0132f-a99e-4747-8291-ed81f1130779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:33.667054 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0132f-a99e-4747-8291-ed81f1130779 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:33.667984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0132f-a99e-4747-8291-ed81f1130779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:33.671067 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0132f-a99e-4747-8291-ed81f1130779 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:33.957996 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1235/2461] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:34:33 2022] POST /identity/v3/users => generated 288 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:34:33.962638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ecd1a-9c5e-49bf-915d-c0ae2d0c3447 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:33.974980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ecd1a-9c5e-49bf-915d-c0ae2d0c3447 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:33.980666 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4044f-1e25-40e7-abeb-8aea768bcb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:33.981305 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4044f-1e25-40e7-abeb-8aea768bcb5e admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:33.981584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4044f-1e25-40e7-abeb-8aea768bcb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:33.981863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4044f-1e25-40e7-abeb-8aea768bcb5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:33.982530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4044f-1e25-40e7-abeb-8aea768bcb5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:33.984473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4044f-1e25-40e7-abeb-8aea768bcb5e admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:33.996506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1227/2462] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:34:34.000942 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0132f-a99e-4747-8291-ed81f1130779 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:34.011753 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0132f-a99e-4747-8291-ed81f1130779 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:34.025441 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcbb1e-f8a5-4f6f-950c-1bcf83e78d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:34.026564 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcbb1e-f8a5-4f6f-950c-1bcf83e78d98 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:34.026880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcbb1e-f8a5-4f6f-950c-1bcf83e78d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:34.027135 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcbb1e-f8a5-4f6f-950c-1bcf83e78d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:34.027803 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcbb1e-f8a5-4f6f-950c-1bcf83e78d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:34.029449 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcbb1e-f8a5-4f6f-950c-1bcf83e78d98 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:34.041996 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1236/2463] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:34:34.046367 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4044f-1e25-40e7-abeb-8aea768bcb5e admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:34.057664 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4044f-1e25-40e7-abeb-8aea768bcb5e admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:34.062981 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007529cd-0a63-48a6-ac98-d4cb7bd5dc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:34.063668 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007529cd-0a63-48a6-ac98-d4cb7bd5dc1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:34.064023 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007529cd-0a63-48a6-ac98-d4cb7bd5dc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:34.064391 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007529cd-0a63-48a6-ac98-d4cb7bd5dc1b admin admin] PATH_INFO: `/v3/projects/c10c7c306cca4264a26fec6a6d9fd344/users/f52867a1284b4d4e8ff6e1c756308a19/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:34.090198 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007529cd-0a63-48a6-ac98-d4cb7bd5dc1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10c7c306cca4264a26fec6a6d9fd344, user_id=f52867a1284b4d4e8ff6e1c756308a19, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:34.092898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007529cd-0a63-48a6-ac98-d4cb7bd5dc1b admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:34.196765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1228/2464] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:34:34 2022] PUT /identity/v3/projects/c10c7c306cca4264a26fec6a6d9fd344/users/f52867a1284b4d4e8ff6e1c756308a19/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:34:34.208041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ee7eb-fb27-482b-8ebe-cf31e562bffd None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:34.208583 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ee7eb-fb27-482b-8ebe-cf31e562bffd None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:34.208677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ee7eb-fb27-482b-8ebe-cf31e562bffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:34.243627 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-a64ee7eb-fb27-482b-8ebe-cf31e562bffd None None] MFA Rules not processed for user `f52867a1284b4d4e8ff6e1c756308a19`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:34:34.245408 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a64ee7eb-fb27-482b-8ebe-cf31e562bffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:34.326096 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1237/2465] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:34:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:34:34.337429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007529cd-0a63-48a6-ac98-d4cb7bd5dc1b admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:34.339444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-007529cd-0a63-48a6-ac98-d4cb7bd5dc1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:34.361166 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:34.407148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007529cd-0a63-48a6-ac98-d4cb7bd5dc1b admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:34.411050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd0c8e-6635-4754-917a-5c092e9b9aeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:34.411663 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd0c8e-6635-4754-917a-5c092e9b9aeb service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:34.411935 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd0c8e-6635-4754-917a-5c092e9b9aeb service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:34.412224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd0c8e-6635-4754-917a-5c092e9b9aeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:34.421806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd0c8e-6635-4754-917a-5c092e9b9aeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:34.423625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd0c8e-6635-4754-917a-5c092e9b9aeb service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:34.435368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1229/2466] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:34:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:34:44.322102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=55,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:44.467088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=19 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:47.015898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ee7eb-fb27-482b-8ebe-cf31e562bffd None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:47.093334 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ee7eb-fb27-482b-8ebe-cf31e562bffd None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:47.098579 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b835b78-63de-4b2b-8f89-e6b17bb24378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:47.099389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b835b78-63de-4b2b-8f89-e6b17bb24378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:47.099672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b835b78-63de-4b2b-8f89-e6b17bb24378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:47.099949 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b835b78-63de-4b2b-8f89-e6b17bb24378 admin admin] PATH_INFO: `/v3/users/f52867a1284b4d4e8ff6e1c756308a19` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:47.101209 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b835b78-63de-4b2b-8f89-e6b17bb24378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f52867a1284b4d4e8ff6e1c756308a19)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:47.103238 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b835b78-63de-4b2b-8f89-e6b17bb24378 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:47.372438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-5b835b78-63de-4b2b-8f89-e6b17bb24378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f52867a1284b4d4e8ff6e1c756308a19'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:47.480775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-5b835b78-63de-4b2b-8f89-e6b17bb24378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f52867a1284b4d4e8ff6e1c756308a19'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:47.481416 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-5b835b78-63de-4b2b-8f89-e6b17bb24378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f52867a1284b4d4e8ff6e1c756308a19'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:47.490565 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-5b835b78-63de-4b2b-8f89-e6b17bb24378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f52867a1284b4d4e8ff6e1c756308a19'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:47.491321 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-5b835b78-63de-4b2b-8f89-e6b17bb24378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f52867a1284b4d4e8ff6e1c756308a19'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:47.510558 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1238/2467] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:34:47 2022] DELETE /identity/v3/users/f52867a1284b4d4e8ff6e1c756308a19 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:34:47.515761 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdc94f-fc2e-4844-98e9-2ed2b8741753 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:47.519340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdc94f-fc2e-4844-98e9-2ed2b8741753 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:47.519340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdc94f-fc2e-4844-98e9-2ed2b8741753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:47.536035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-6cfdc94f-fc2e-4844-98e9-2ed2b8741753 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:34:47.537309 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6cfdc94f-fc2e-4844-98e9-2ed2b8741753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:47.603988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1230/2468] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:34:47.614240 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b835b78-63de-4b2b-8f89-e6b17bb24378 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:47.615770 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-5b835b78-63de-4b2b-8f89-e6b17bb24378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:47.678330 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b835b78-63de-4b2b-8f89-e6b17bb24378 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:47.682074 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113ab01-f6e2-4bbe-bd15-64c4acaef0d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:47.682768 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113ab01-f6e2-4bbe-bd15-64c4acaef0d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:47.683054 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113ab01-f6e2-4bbe-bd15-64c4acaef0d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:47.683851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113ab01-f6e2-4bbe-bd15-64c4acaef0d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:47.693962 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113ab01-f6e2-4bbe-bd15-64c4acaef0d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:47.695751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113ab01-f6e2-4bbe-bd15-64c4acaef0d0 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:47.707340 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1239/2469] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:34:48.190717 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdc94f-fc2e-4844-98e9-2ed2b8741753 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:48.192167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6cfdc94f-fc2e-4844-98e9-2ed2b8741753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:48.207938 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdc94f-fc2e-4844-98e9-2ed2b8741753 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:48.215290 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f09ab-0fc1-4d58-95de-3d9c4b22d6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:48.216411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f09ab-0fc1-4d58-95de-3d9c4b22d6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:48.217434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f09ab-0fc1-4d58-95de-3d9c4b22d6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:48.217434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f09ab-0fc1-4d58-95de-3d9c4b22d6e6 admin admin] PATH_INFO: `/v3/projects/c10c7c306cca4264a26fec6a6d9fd344` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:48.219984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f09ab-0fc1-4d58-95de-3d9c4b22d6e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c10c7c306cca4264a26fec6a6d9fd344)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:48.223973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f09ab-0fc1-4d58-95de-3d9c4b22d6e6 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:48.379141 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-221f09ab-0fc1-4d58-95de-3d9c4b22d6e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c10c7c306cca4264a26fec6a6d9fd344', 'request_id': 'req-221f09ab-0fc1-4d58-95de-3d9c4b22d6e6'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:48.473654 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-221f09ab-0fc1-4d58-95de-3d9c4b22d6e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c10c7c306cca4264a26fec6a6d9fd344', 'request_id': 'req-221f09ab-0fc1-4d58-95de-3d9c4b22d6e6'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:48.483241 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-221f09ab-0fc1-4d58-95de-3d9c4b22d6e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c10c7c306cca4264a26fec6a6d9fd344', 'request_id': 'req-221f09ab-0fc1-4d58-95de-3d9c4b22d6e6'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:48.496521 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-221f09ab-0fc1-4d58-95de-3d9c4b22d6e6 admin admin] The token cache is being invalidate because project c10c7c306cca4264a26fec6a6d9fd344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:34:48.496814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-221f09ab-0fc1-4d58-95de-3d9c4b22d6e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:48.497489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-221f09ab-0fc1-4d58-95de-3d9c4b22d6e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:34:48.499079 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1231/2470] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:34:48 2022] DELETE /identity/v3/projects/c10c7c306cca4264a26fec6a6d9fd344 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:34:56.630996 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113ab01-f6e2-4bbe-bd15-64c4acaef0d0 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:34:56.632475 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-c113ab01-f6e2-4bbe-bd15-64c4acaef0d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:56.645061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113ab01-f6e2-4bbe-bd15-64c4acaef0d0 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:34:56.665975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:56.704142 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ce8bc-7ec5-4067-a285-005ba7a58eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:34:56.704937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ce8bc-7ec5-4067-a285-005ba7a58eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:34:56.705316 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ce8bc-7ec5-4067-a285-005ba7a58eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:34:56.705693 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ce8bc-7ec5-4067-a285-005ba7a58eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:34:56.707813 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-648ce8bc-7ec5-4067-a285-005ba7a58eb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:34:56.789246 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ce8bc-7ec5-4067-a285-005ba7a58eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:34:56.790741 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ce8bc-7ec5-4067-a285-005ba7a58eb2 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:34:56.804745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1240/2471] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:34:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:34:58.493332 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:01.929702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b96c9-1ee5-46d1-a044-524b80c10b9c None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:01.930364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b96c9-1ee5-46d1-a044-524b80c10b9c None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:01.930364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b96c9-1ee5-46d1-a044-524b80c10b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:01.950880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-607b96c9-1ee5-46d1-a044-524b80c10b9c None None] MFA Rules not processed for user `e7bd32cb680e4d9aa9bbaa32c94e68de`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:35:01.952098 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-607b96c9-1ee5-46d1-a044-524b80c10b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:02.008644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1232/2472] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:35:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:35:02.047748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ce8bc-7ec5-4067-a285-005ba7a58eb2 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:02.049169 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-648ce8bc-7ec5-4067-a285-005ba7a58eb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:02.111233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ce8bc-7ec5-4067-a285-005ba7a58eb2 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:02.115077 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ace225-e187-4d42-9312-c50947954937 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5b3a7a9a08e40718980143d7c4880ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:02.115713 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ace225-e187-4d42-9312-c50947954937 service glance] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:02.115990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ace225-e187-4d42-9312-c50947954937 service glance] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:02.116257 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ace225-e187-4d42-9312-c50947954937 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:02.118010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-10ace225-e187-4d42-9312-c50947954937 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:02.132021 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ace225-e187-4d42-9312-c50947954937 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:02.133453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ace225-e187-4d42-9312-c50947954937 service glance] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:02.145214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1241/2473] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:35:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:35:05.818817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fea03-e30f-4766-a8f0-82e9ae8dded0 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:05.819538 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fea03-e30f-4766-a8f0-82e9ae8dded0 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:05.819538 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fea03-e30f-4766-a8f0-82e9ae8dded0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:05.845138 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-479fea03-e30f-4766-a8f0-82e9ae8dded0 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:35:05.847605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-479fea03-e30f-4766-a8f0-82e9ae8dded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:05.950052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1233/2474] 10.222.0.88 () {58 vars in 1016 bytes} [Fri Sep 23 01:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:35:05.982231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ace225-e187-4d42-9312-c50947954937 service glance] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:05.985003 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-10ace225-e187-4d42-9312-c50947954937 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:06.012267 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ace225-e187-4d42-9312-c50947954937 service glance] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:06.022397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f700e-69b2-412c-b8c7-0c20abb5853c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:06.023390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f700e-69b2-412c-b8c7-0c20abb5853c service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:06.023882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f700e-69b2-412c-b8c7-0c20abb5853c service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:06.024454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f700e-69b2-412c-b8c7-0c20abb5853c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:06.040937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f700e-69b2-412c-b8c7-0c20abb5853c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:06.044260 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f700e-69b2-412c-b8c7-0c20abb5853c service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:06.060876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1242/2475] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:35:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:35:11.477295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e030e-027b-4e58-9c81-e036da6a82d7 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:11.478063 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e030e-027b-4e58-9c81-e036da6a82d7 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:11.478299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e030e-027b-4e58-9c81-e036da6a82d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:11.521176 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-6e1e030e-027b-4e58-9c81-e036da6a82d7 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:35:11.522705 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6e1e030e-027b-4e58-9c81-e036da6a82d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:11.531482 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1234/2476] 10.222.0.88 () {58 vars in 1016 bytes} [Fri Sep 23 01:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:35:11.560009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f700e-69b2-412c-b8c7-0c20abb5853c service nova] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:11.578239 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f700e-69b2-412c-b8c7-0c20abb5853c service nova] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:11.587650 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216e4ff-1b2a-4eab-b463-08036a72112d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:11.588667 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216e4ff-1b2a-4eab-b463-08036a72112d service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:11.589063 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216e4ff-1b2a-4eab-b463-08036a72112d service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:11.589531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216e4ff-1b2a-4eab-b463-08036a72112d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:11.604476 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216e4ff-1b2a-4eab-b463-08036a72112d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:11.605793 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216e4ff-1b2a-4eab-b463-08036a72112d service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:11.621649 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1243/2477] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:35:13.190690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e030e-027b-4e58-9c81-e036da6a82d7 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:13.213249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e030e-027b-4e58-9c81-e036da6a82d7 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:13.219819 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558ff38-d20e-4459-9984-362fcc7bb106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:13.220498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558ff38-d20e-4459-9984-362fcc7bb106 service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:13.220820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558ff38-d20e-4459-9984-362fcc7bb106 service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:13.221175 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558ff38-d20e-4459-9984-362fcc7bb106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:13.223669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-8558ff38-d20e-4459-9984-362fcc7bb106 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:13.312694 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558ff38-d20e-4459-9984-362fcc7bb106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:13.314454 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558ff38-d20e-4459-9984-362fcc7bb106 service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:13.329276 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1235/2478] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:35:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:35:16.322801 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4a981-794e-4188-bc17-07532fff0961 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:16.323559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4a981-794e-4188-bc17-07532fff0961 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:16.323834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4a981-794e-4188-bc17-07532fff0961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:16.362906 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-a3d4a981-794e-4188-bc17-07532fff0961 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:35:16.364535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a3d4a981-794e-4188-bc17-07532fff0961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:16.375059 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1244/2479] 10.222.0.88 () {58 vars in 1016 bytes} [Fri Sep 23 01:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:35:16.463748 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558ff38-d20e-4459-9984-362fcc7bb106 service nova] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:16.484215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558ff38-d20e-4459-9984-362fcc7bb106 service nova] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:16.494459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df99b3c-60f3-4446-986f-e7226ed39025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:16.495837 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df99b3c-60f3-4446-986f-e7226ed39025 service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:16.496138 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df99b3c-60f3-4446-986f-e7226ed39025 service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:16.496511 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df99b3c-60f3-4446-986f-e7226ed39025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:16.507851 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df99b3c-60f3-4446-986f-e7226ed39025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:16.513898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df99b3c-60f3-4446-986f-e7226ed39025 service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:16.520342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1236/2480] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:35:21.231986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4a981-794e-4188-bc17-07532fff0961 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:21.250215 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4a981-794e-4188-bc17-07532fff0961 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:21.257663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb5eb4-d214-4e50-b6b0-2127925a324d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:21.260855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb5eb4-d214-4e50-b6b0-2127925a324d service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:21.260855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb5eb4-d214-4e50-b6b0-2127925a324d service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:21.260855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb5eb4-d214-4e50-b6b0-2127925a324d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:21.261893 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a8eb5eb4-d214-4e50-b6b0-2127925a324d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:21.277658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb5eb4-d214-4e50-b6b0-2127925a324d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:21.280040 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb5eb4-d214-4e50-b6b0-2127925a324d service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:21.290874 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1245/2481] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:35:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:35:22.208814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d8e24-356f-4631-a40c-78149d34f620 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:22.209974 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d8e24-356f-4631-a40c-78149d34f620 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:22.209974 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d8e24-356f-4631-a40c-78149d34f620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:22.243300 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-243d8e24-356f-4631-a40c-78149d34f620 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:35:22.244882 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-243d8e24-356f-4631-a40c-78149d34f620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:22.254475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1237/2482] 10.222.0.88 () {58 vars in 1016 bytes} [Fri Sep 23 01:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:35:22.275612 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb5eb4-d214-4e50-b6b0-2127925a324d service nova] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:22.277731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a8eb5eb4-d214-4e50-b6b0-2127925a324d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:22.294984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb5eb4-d214-4e50-b6b0-2127925a324d service nova] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:22.301485 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb061da9-c1c2-40d1-922a-81f542c72b97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:22.302422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb061da9-c1c2-40d1-922a-81f542c72b97 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:22.303218 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb061da9-c1c2-40d1-922a-81f542c72b97 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:22.303679 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb061da9-c1c2-40d1-922a-81f542c72b97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:22.320646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb061da9-c1c2-40d1-922a-81f542c72b97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:22.322713 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb061da9-c1c2-40d1-922a-81f542c72b97 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:22.374777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1246/2483] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:35:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:35:25.152581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d8e24-356f-4631-a40c-78149d34f620 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:25.157012 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-243d8e24-356f-4631-a40c-78149d34f620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:25.183206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:25.231366 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d8e24-356f-4631-a40c-78149d34f620 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:25.239853 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd40e74-942f-415a-961f-66204df93362 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:25.239853 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd40e74-942f-415a-961f-66204df93362 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:25.240133 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd40e74-942f-415a-961f-66204df93362 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:25.240412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd40e74-942f-415a-961f-66204df93362 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:25.242404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-6cd40e74-942f-415a-961f-66204df93362 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:25.331133 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd40e74-942f-415a-961f-66204df93362 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:25.333817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd40e74-942f-415a-961f-66204df93362 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:25.347982 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1238/2484] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:35:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:35:25.368271 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb061da9-c1c2-40d1-922a-81f542c72b97 service nova] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:25.373724 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-bb061da9-c1c2-40d1-922a-81f542c72b97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:25.397293 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb061da9-c1c2-40d1-922a-81f542c72b97 service nova] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:25.402407 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a1f6c-d912-4d71-a2c6-555739eb0127 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:25.403845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a1f6c-d912-4d71-a2c6-555739eb0127 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:25.404589 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a1f6c-d912-4d71-a2c6-555739eb0127 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:25.405033 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a1f6c-d912-4d71-a2c6-555739eb0127 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:25.413004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:25.420188 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a1f6c-d912-4d71-a2c6-555739eb0127 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:25.422456 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a1f6c-d912-4d71-a2c6-555739eb0127 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:25.438685 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1247/2485] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:35:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:35:28.697331 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82defc-1607-473e-b9f6-c7a75f9b2f58 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:28.697921 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82defc-1607-473e-b9f6-c7a75f9b2f58 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:28.697921 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82defc-1607-473e-b9f6-c7a75f9b2f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:28.726022 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-ce82defc-1607-473e-b9f6-c7a75f9b2f58 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:35:28.728378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ce82defc-1607-473e-b9f6-c7a75f9b2f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:28.743486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1239/2486] 10.222.0.88 () {58 vars in 1016 bytes} [Fri Sep 23 01:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:35:28.771387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a1f6c-d912-4d71-a2c6-555739eb0127 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:28.785398 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a1f6c-d912-4d71-a2c6-555739eb0127 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:28.791111 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88956eb-4b17-4506-8a57-fc2c444bbed1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:28.791730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88956eb-4b17-4506-8a57-fc2c444bbed1 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:28.792600 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88956eb-4b17-4506-8a57-fc2c444bbed1 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:28.792877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88956eb-4b17-4506-8a57-fc2c444bbed1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:28.802313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88956eb-4b17-4506-8a57-fc2c444bbed1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:28.804056 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88956eb-4b17-4506-8a57-fc2c444bbed1 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:28.815263 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1248/2487] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:35:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:35:36.285841 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517f646-b5a1-4f26-997d-bff3e5788ac6 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:36.286844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517f646-b5a1-4f26-997d-bff3e5788ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:36.287314 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517f646-b5a1-4f26-997d-bff3e5788ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:36.333069 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-b517f646-b5a1-4f26-997d-bff3e5788ac6 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:35:36.334740 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b517f646-b5a1-4f26-997d-bff3e5788ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:36.354949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1240/2488] 10.222.0.88 () {58 vars in 1016 bytes} [Fri Sep 23 01:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:35:36.385001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88956eb-4b17-4506-8a57-fc2c444bbed1 service nova] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:36.413702 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88956eb-4b17-4506-8a57-fc2c444bbed1 service nova] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:36.432143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c73b74-7f9b-43d9-a7ba-6005e2555aee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:36.432143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c73b74-7f9b-43d9-a7ba-6005e2555aee service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:36.432143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c73b74-7f9b-43d9-a7ba-6005e2555aee service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:36.432143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c73b74-7f9b-43d9-a7ba-6005e2555aee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:36.444646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c73b74-7f9b-43d9-a7ba-6005e2555aee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:36.446455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c73b74-7f9b-43d9-a7ba-6005e2555aee service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:36.462236 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1249/2489] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:35:44.016435 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac994f-5184-4094-a8fd-1c2defd19c81 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:44.017022 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac994f-5184-4094-a8fd-1c2defd19c81 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:44.017022 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac994f-5184-4094-a8fd-1c2defd19c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:44.038153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-7eac994f-5184-4094-a8fd-1c2defd19c81 None None] MFA Rules not processed for user `67b89827871f45738162611b31a23509`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:35:44.039561 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-7eac994f-5184-4094-a8fd-1c2defd19c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:44.047735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1241/2490] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:35:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:35:44.654640 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c73b74-7f9b-43d9-a7ba-6005e2555aee service nova] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:44.656696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d3c73b74-7f9b-43d9-a7ba-6005e2555aee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:44.669914 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c73b74-7f9b-43d9-a7ba-6005e2555aee service nova] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:44.673777 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da31c37-a716-49ed-9d95-c3a42964cfb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:44.674387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da31c37-a716-49ed-9d95-c3a42964cfb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:44.674698 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da31c37-a716-49ed-9d95-c3a42964cfb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:44.674972 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da31c37-a716-49ed-9d95-c3a42964cfb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:44.676727 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-7da31c37-a716-49ed-9d95-c3a42964cfb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:44.687604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da31c37-a716-49ed-9d95-c3a42964cfb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:44.689012 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da31c37-a716-49ed-9d95-c3a42964cfb1 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:44.702722 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1250/2491] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:35:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:35:45.306647 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac994f-5184-4094-a8fd-1c2defd19c81 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:45.310243 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-7eac994f-5184-4094-a8fd-1c2defd19c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:45.398418 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac994f-5184-4094-a8fd-1c2defd19c81 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:45.403883 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981a86b-f17d-4a17-98ee-dfedcfb49a8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eab2cbff5984fa6a8e715ed6553db82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:45.404616 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981a86b-f17d-4a17-98ee-dfedcfb49a8c service placement] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:45.405014 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981a86b-f17d-4a17-98ee-dfedcfb49a8c service placement] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:45.407421 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981a86b-f17d-4a17-98ee-dfedcfb49a8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:45.407421 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4981a86b-f17d-4a17-98ee-dfedcfb49a8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:45.420378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981a86b-f17d-4a17-98ee-dfedcfb49a8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:45.422042 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981a86b-f17d-4a17-98ee-dfedcfb49a8c service placement] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:45.434177 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1242/2492] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:35:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:35:51.544215 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da31c37-a716-49ed-9d95-c3a42964cfb1 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:51.560706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da31c37-a716-49ed-9d95-c3a42964cfb1 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:51.568330 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda6e40-9093-466d-a3ac-a749c44838be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:51.569608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda6e40-9093-466d-a3ac-a749c44838be service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:51.570108 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda6e40-9093-466d-a3ac-a749c44838be service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:51.570661 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda6e40-9093-466d-a3ac-a749c44838be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:51.574372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-beda6e40-9093-466d-a3ac-a749c44838be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:51.692115 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda6e40-9093-466d-a3ac-a749c44838be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:51.692115 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda6e40-9093-466d-a3ac-a749c44838be service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:51.692115 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1251/2493] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:35:55.003237 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981a86b-f17d-4a17-98ee-dfedcfb49a8c service placement] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:55.013943 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981a86b-f17d-4a17-98ee-dfedcfb49a8c service placement] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:55.018005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec5777-268f-4e4d-9256-e34e3f629923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:55.024378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec5777-268f-4e4d-9256-e34e3f629923 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:55.024378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec5777-268f-4e4d-9256-e34e3f629923 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:55.024378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec5777-268f-4e4d-9256-e34e3f629923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:55.024378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-c2ec5777-268f-4e4d-9256-e34e3f629923 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:55.032885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec5777-268f-4e4d-9256-e34e3f629923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:55.034267 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec5777-268f-4e4d-9256-e34e3f629923 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:55.045876 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1243/2494] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:35:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:35:56.189487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda6e40-9093-466d-a3ac-a749c44838be service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:56.216356 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=28 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:56.226139 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda6e40-9093-466d-a3ac-a749c44838be service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:56.254124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aba97d-0d17-432e-8682-e8a00f86641b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:56.255429 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aba97d-0d17-432e-8682-e8a00f86641b service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:56.255902 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aba97d-0d17-432e-8682-e8a00f86641b service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:56.256364 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aba97d-0d17-432e-8682-e8a00f86641b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:56.261827 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-50aba97d-0d17-432e-8682-e8a00f86641b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:56.295504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aba97d-0d17-432e-8682-e8a00f86641b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:56.297155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aba97d-0d17-432e-8682-e8a00f86641b service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:56.315817 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1252/2495] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:35:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:35:57.185847 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec5777-268f-4e4d-9256-e34e3f629923 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:57.187455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-c2ec5777-268f-4e4d-9256-e34e3f629923 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:57.197069 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=88 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:57.204274 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec5777-268f-4e4d-9256-e34e3f629923 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:57.210184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531fede-78e1-4fb0-89a3-90344829f3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:57.210897 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531fede-78e1-4fb0-89a3-90344829f3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:57.211180 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531fede-78e1-4fb0-89a3-90344829f3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:57.211453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531fede-78e1-4fb0-89a3-90344829f3e6 admin admin] PATH_INFO: `/v3/users/1541fedac9514a2eb65e8da0cc609fd2` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:57.212812 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531fede-78e1-4fb0-89a3-90344829f3e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1541fedac9514a2eb65e8da0cc609fd2)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:57.214887 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531fede-78e1-4fb0-89a3-90344829f3e6 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:57.508076 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d531fede-78e1-4fb0-89a3-90344829f3e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1541fedac9514a2eb65e8da0cc609fd2'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:35:57.525527 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d531fede-78e1-4fb0-89a3-90344829f3e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1541fedac9514a2eb65e8da0cc609fd2'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:35:57.656945 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d531fede-78e1-4fb0-89a3-90344829f3e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1541fedac9514a2eb65e8da0cc609fd2'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:35:57.657581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d531fede-78e1-4fb0-89a3-90344829f3e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1541fedac9514a2eb65e8da0cc609fd2'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:35:57.667589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-d531fede-78e1-4fb0-89a3-90344829f3e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1541fedac9514a2eb65e8da0cc609fd2'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:35:57.674803 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1244/2496] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:35:57 2022] DELETE /identity/v3/users/1541fedac9514a2eb65e8da0cc609fd2 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:35:57.984636 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aba97d-0d17-432e-8682-e8a00f86641b service nova] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:57.998022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aba97d-0d17-432e-8682-e8a00f86641b service nova] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:58.080196 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911650bc-8483-4cef-86cf-0f75afddc0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:58.080809 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911650bc-8483-4cef-86cf-0f75afddc0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:58.081084 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911650bc-8483-4cef-86cf-0f75afddc0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:58.081353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911650bc-8483-4cef-86cf-0f75afddc0ff admin admin] PATH_INFO: `/v3/projects/f0f4fc2c13b049f88634df7b8c0770d1` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:58.082503 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911650bc-8483-4cef-86cf-0f75afddc0ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f4fc2c13b049f88634df7b8c0770d1)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:58.084573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911650bc-8483-4cef-86cf-0f75afddc0ff admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:58.218461 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-911650bc-8483-4cef-86cf-0f75afddc0ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f4fc2c13b049f88634df7b8c0770d1', 'request_id': 'req-911650bc-8483-4cef-86cf-0f75afddc0ff'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:35:58.317010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-911650bc-8483-4cef-86cf-0f75afddc0ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f4fc2c13b049f88634df7b8c0770d1', 'request_id': 'req-911650bc-8483-4cef-86cf-0f75afddc0ff'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:35:58.323761 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-911650bc-8483-4cef-86cf-0f75afddc0ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f4fc2c13b049f88634df7b8c0770d1', 'request_id': 'req-911650bc-8483-4cef-86cf-0f75afddc0ff'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:35:58.335933 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-911650bc-8483-4cef-86cf-0f75afddc0ff admin admin] The token cache is being invalidate because project f0f4fc2c13b049f88634df7b8c0770d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:35:58.336220 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-911650bc-8483-4cef-86cf-0f75afddc0ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:35:58.336886 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-911650bc-8483-4cef-86cf-0f75afddc0ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:35:58.338973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1253/2497] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:35:57 2022] DELETE /identity/v3/projects/f0f4fc2c13b049f88634df7b8c0770d1 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:35:58.344159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5de093-ade7-49ca-a9ed-d1e80cc351e2 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:58.344673 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5de093-ade7-49ca-a9ed-d1e80cc351e2 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:58.344817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5de093-ade7-49ca-a9ed-d1e80cc351e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:58.365276 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-3e5de093-ade7-49ca-a9ed-d1e80cc351e2 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:35:58.366490 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-3e5de093-ade7-49ca-a9ed-d1e80cc351e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:58.433990 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1245/2498] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:35:58.442466 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b8c7f-89c5-43f3-bac8-aa6a7b265d3a None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:58.442786 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b8c7f-89c5-43f3-bac8-aa6a7b265d3a None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:58.443252 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b8c7f-89c5-43f3-bac8-aa6a7b265d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:58.465515 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-8f8b8c7f-89c5-43f3-bac8-aa6a7b265d3a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:35:58.466900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-8f8b8c7f-89c5-43f3-bac8-aa6a7b265d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:58.476570 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1254/2499] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:35:58.480933 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5de093-ade7-49ca-a9ed-d1e80cc351e2 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:58.491604 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5de093-ade7-49ca-a9ed-d1e80cc351e2 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:58.496518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05361259-87a9-4f46-9079-ce6fc211d687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:58.497104 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05361259-87a9-4f46-9079-ce6fc211d687 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:58.497383 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05361259-87a9-4f46-9079-ce6fc211d687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:58.497681 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05361259-87a9-4f46-9079-ce6fc211d687 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:58.498371 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05361259-87a9-4f46-9079-ce6fc211d687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:35:58.498729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05361259-87a9-4f46-9079-ce6fc211d687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:58.500337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05361259-87a9-4f46-9079-ce6fc211d687 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:58.513167 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1246/2500] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:35:58.517461 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b8c7f-89c5-43f3-bac8-aa6a7b265d3a None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:58.527954 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b8c7f-89c5-43f3-bac8-aa6a7b265d3a None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:58.533012 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdfa93-0098-4db8-a23d-a89c4c8b546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:58.533705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdfa93-0098-4db8-a23d-a89c4c8b546e admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:58.534051 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdfa93-0098-4db8-a23d-a89c4c8b546e admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:58.534388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdfa93-0098-4db8-a23d-a89c4c8b546e admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:58.535134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdfa93-0098-4db8-a23d-a89c4c8b546e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:58.537133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdfa93-0098-4db8-a23d-a89c4c8b546e admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:58.673531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1255/2501] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:35:58 2022] POST /identity/v3/projects => generated 389 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:35:58.674955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05361259-87a9-4f46-9079-ce6fc211d687 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:58.687061 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05361259-87a9-4f46-9079-ce6fc211d687 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:58.750052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de34147-9044-4e21-aa37-38d9d42d9ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:58.750397 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de34147-9044-4e21-aa37-38d9d42d9ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:58.750397 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de34147-9044-4e21-aa37-38d9d42d9ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:58.750732 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de34147-9044-4e21-aa37-38d9d42d9ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:58.751272 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de34147-9044-4e21-aa37-38d9d42d9ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:58.753281 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de34147-9044-4e21-aa37-38d9d42d9ca9 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:58.763276 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:58.893222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1247/2502] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:35:58 2022] POST /identity/v3/users => generated 295 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:35:58.897969 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdfa93-0098-4db8-a23d-a89c4c8b546e admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:58.911204 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdfa93-0098-4db8-a23d-a89c4c8b546e admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:58.924955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b83a50-3d54-4842-aab1-e4924ab3b902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:58.924955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b83a50-3d54-4842-aab1-e4924ab3b902 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:58.924955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b83a50-3d54-4842-aab1-e4924ab3b902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:58.924955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b83a50-3d54-4842-aab1-e4924ab3b902 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:58.925792 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b83a50-3d54-4842-aab1-e4924ab3b902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:58.925792 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b83a50-3d54-4842-aab1-e4924ab3b902 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:58.937447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1256/2503] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:35:58.942906 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de34147-9044-4e21-aa37-38d9d42d9ca9 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:58.955713 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de34147-9044-4e21-aa37-38d9d42d9ca9 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:58.963730 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8802668-088c-4f3e-92df-c67155fe8928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:58.964404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8802668-088c-4f3e-92df-c67155fe8928 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:58.964716 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8802668-088c-4f3e-92df-c67155fe8928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:58.964988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8802668-088c-4f3e-92df-c67155fe8928 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:58.968294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8802668-088c-4f3e-92df-c67155fe8928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:58.968294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8802668-088c-4f3e-92df-c67155fe8928 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:58.997343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1248/2504] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:35:59.001312 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b83a50-3d54-4842-aab1-e4924ab3b902 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:59.022242 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b83a50-3d54-4842-aab1-e4924ab3b902 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:59.029764 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acf9f1-cbc4-431f-a2ae-3f62a2158626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:59.030472 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acf9f1-cbc4-431f-a2ae-3f62a2158626 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:59.030790 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acf9f1-cbc4-431f-a2ae-3f62a2158626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:59.031071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acf9f1-cbc4-431f-a2ae-3f62a2158626 admin admin] PATH_INFO: `/v3/projects/6ee88a9c3cac404fa07e13ba0ca7ab05/users/6dd52c257878410f97776b2a1739bca8/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:59.052605 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acf9f1-cbc4-431f-a2ae-3f62a2158626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee88a9c3cac404fa07e13ba0ca7ab05, user_id=6dd52c257878410f97776b2a1739bca8, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:59.055632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acf9f1-cbc4-431f-a2ae-3f62a2158626 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:59.166786 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1257/2505] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:35:58 2022] PUT /identity/v3/projects/6ee88a9c3cac404fa07e13ba0ca7ab05/users/6dd52c257878410f97776b2a1739bca8/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:35:59.172958 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54fb64-f2eb-4dfe-a2fe-e53add613a0c None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:59.172958 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54fb64-f2eb-4dfe-a2fe-e53add613a0c None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:59.172958 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54fb64-f2eb-4dfe-a2fe-e53add613a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:59.194369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-dd54fb64-f2eb-4dfe-a2fe-e53add613a0c None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:35:59.195754 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-dd54fb64-f2eb-4dfe-a2fe-e53add613a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:59.285624 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1249/2506] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:35:59.297086 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acf9f1-cbc4-431f-a2ae-3f62a2158626 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:35:59.300432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-50acf9f1-cbc4-431f-a2ae-3f62a2158626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:35:59.330911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:59.372980 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acf9f1-cbc4-431f-a2ae-3f62a2158626 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:35:59.377589 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409d549-ef02-4158-a20c-85c6e6eae6d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:35:59.378265 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409d549-ef02-4158-a20c-85c6e6eae6d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:35:59.378549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409d549-ef02-4158-a20c-85c6e6eae6d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:35:59.378857 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409d549-ef02-4158-a20c-85c6e6eae6d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:35:59.389710 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409d549-ef02-4158-a20c-85c6e6eae6d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:35:59.391228 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409d549-ef02-4158-a20c-85c6e6eae6d6 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:35:59.414487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1258/2507] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:35:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:36:00.491708 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935839a9-6cbc-48c1-9a62-21db7af730b1 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:00.492250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935839a9-6cbc-48c1-9a62-21db7af730b1 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:00.492250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935839a9-6cbc-48c1-9a62-21db7af730b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:00.512518 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-935839a9-6cbc-48c1-9a62-21db7af730b1 None None] MFA Rules not processed for user `c88f23161cd447a2800244936f7faff9`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:36:00.513760 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-935839a9-6cbc-48c1-9a62-21db7af730b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:00.575038 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1250/2508] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:36:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:36:00.867639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409d549-ef02-4158-a20c-85c6e6eae6d6 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:00.876726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409d549-ef02-4158-a20c-85c6e6eae6d6 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:00.880663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b31f7-a9d0-4085-977f-ffb0657d46f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:00.881313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b31f7-a9d0-4085-977f-ffb0657d46f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:00.881592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b31f7-a9d0-4085-977f-ffb0657d46f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:00.881862 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b31f7-a9d0-4085-977f-ffb0657d46f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:00.883625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-544b31f7-a9d0-4085-977f-ffb0657d46f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:00.898392 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b31f7-a9d0-4085-977f-ffb0657d46f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:00.898392 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b31f7-a9d0-4085-977f-ffb0657d46f5 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:00.906202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1259/2509] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:36:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:36:06.307913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a7d4e-c4c6-444d-956b-47a03b68641a None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:06.308501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a7d4e-c4c6-444d-956b-47a03b68641a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:06.308501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a7d4e-c4c6-444d-956b-47a03b68641a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:06.349954 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-043a7d4e-c4c6-444d-956b-47a03b68641a None None] MFA Rules not processed for user `6dd52c257878410f97776b2a1739bca8`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:36:06.351460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-043a7d4e-c4c6-444d-956b-47a03b68641a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:06.434021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1251/2510] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:36:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:36:06.449211 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b31f7-a9d0-4085-977f-ffb0657d46f5 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:06.450862 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-544b31f7-a9d0-4085-977f-ffb0657d46f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:06.564359 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b31f7-a9d0-4085-977f-ffb0657d46f5 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:06.570546 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64812e2d-ea4e-489b-9b26-9b6aa08e8a00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:06.571195 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64812e2d-ea4e-489b-9b26-9b6aa08e8a00 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:06.571664 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64812e2d-ea4e-489b-9b26-9b6aa08e8a00 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:06.572102 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64812e2d-ea4e-489b-9b26-9b6aa08e8a00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:06.582068 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64812e2d-ea4e-489b-9b26-9b6aa08e8a00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:06.583838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64812e2d-ea4e-489b-9b26-9b6aa08e8a00 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:06.595814 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1260/2511] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:36:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:36:10.687320 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b95af8-cf22-4a23-8f82-b20903a6ff56 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:10.687904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b95af8-cf22-4a23-8f82-b20903a6ff56 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:10.687904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b95af8-cf22-4a23-8f82-b20903a6ff56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:10.714902 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:10.719689 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-10b95af8-cf22-4a23-8f82-b20903a6ff56 None None] MFA Rules not processed for user `6dd52c257878410f97776b2a1739bca8`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:36:10.720924 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-10b95af8-cf22-4a23-8f82-b20903a6ff56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:10.753176 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1252/2512] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:36:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:36:13.872456 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64812e2d-ea4e-489b-9b26-9b6aa08e8a00 service nova] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:13.919543 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64812e2d-ea4e-489b-9b26-9b6aa08e8a00 service nova] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:13.925671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70878e83-ba27-4dc7-9be6-d42d00c57824 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:13.926298 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70878e83-ba27-4dc7-9be6-d42d00c57824 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:13.926646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70878e83-ba27-4dc7-9be6-d42d00c57824 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:13.926923 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70878e83-ba27-4dc7-9be6-d42d00c57824 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:13.928791 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-70878e83-ba27-4dc7-9be6-d42d00c57824 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:13.958322 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70878e83-ba27-4dc7-9be6-d42d00c57824 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:13.960479 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70878e83-ba27-4dc7-9be6-d42d00c57824 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:13.972585 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1261/2513] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:36:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:36:21.571022 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=8 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:23.057329 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105abf68-5e44-4327-be5a-adf855c8b543 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:23.058024 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105abf68-5e44-4327-be5a-adf855c8b543 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:23.058024 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105abf68-5e44-4327-be5a-adf855c8b543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:23.137940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-105abf68-5e44-4327-be5a-adf855c8b543 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:36:23.139136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-105abf68-5e44-4327-be5a-adf855c8b543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:23.171157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1253/2514] 10.222.0.88 () {58 vars in 1016 bytes} [Fri Sep 23 01:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:36:23.226262 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70878e83-ba27-4dc7-9be6-d42d00c57824 service nova] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:23.238703 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70878e83-ba27-4dc7-9be6-d42d00c57824 service nova] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:23.244394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7cf6f-b646-4a07-98ed-47fbb7b79d81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:23.245056 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7cf6f-b646-4a07-98ed-47fbb7b79d81 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:23.245344 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7cf6f-b646-4a07-98ed-47fbb7b79d81 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:23.245612 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7cf6f-b646-4a07-98ed-47fbb7b79d81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:23.255015 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7cf6f-b646-4a07-98ed-47fbb7b79d81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:23.256639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7cf6f-b646-4a07-98ed-47fbb7b79d81 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:23.268180 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1262/2515] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:36:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:36:28.511643 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0e88b-8ee2-4b3c-807b-b075308b8689 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:28.512565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0e88b-8ee2-4b3c-807b-b075308b8689 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:28.512842 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0e88b-8ee2-4b3c-807b-b075308b8689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:28.534003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-0fd0e88b-8ee2-4b3c-807b-b075308b8689 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:36:28.535372 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-0fd0e88b-8ee2-4b3c-807b-b075308b8689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:28.544636 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1254/2516] 10.222.0.88 () {58 vars in 1016 bytes} [Fri Sep 23 01:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:36:28.589351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7cf6f-b646-4a07-98ed-47fbb7b79d81 service nova] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:28.591028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ffc7cf6f-b646-4a07-98ed-47fbb7b79d81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:28.609416 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7cf6f-b646-4a07-98ed-47fbb7b79d81 service nova] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:28.616089 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0eba22-8f48-4f7e-99f7-96ec102e1263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:28.616716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0eba22-8f48-4f7e-99f7-96ec102e1263 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:28.616998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0eba22-8f48-4f7e-99f7-96ec102e1263 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:28.617361 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0eba22-8f48-4f7e-99f7-96ec102e1263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:28.626788 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0eba22-8f48-4f7e-99f7-96ec102e1263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:28.628423 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0eba22-8f48-4f7e-99f7-96ec102e1263 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:28.639730 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1263/2517] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:36:29.779436 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0e88b-8ee2-4b3c-807b-b075308b8689 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:29.793039 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0e88b-8ee2-4b3c-807b-b075308b8689 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:29.798554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a64cf9-67f4-4055-a2bc-958c6e5df57c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:29.799194 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a64cf9-67f4-4055-a2bc-958c6e5df57c service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:29.799464 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a64cf9-67f4-4055-a2bc-958c6e5df57c service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:29.799733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a64cf9-67f4-4055-a2bc-958c6e5df57c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:29.801508 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-72a64cf9-67f4-4055-a2bc-958c6e5df57c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:29.814552 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a64cf9-67f4-4055-a2bc-958c6e5df57c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:29.816254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a64cf9-67f4-4055-a2bc-958c6e5df57c service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:29.830003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1255/2518] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:36:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:36:34.294936 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc8cd3-35a9-4067-ba3c-766e6bc2a4d7 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:34.296237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc8cd3-35a9-4067-ba3c-766e6bc2a4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:34.296237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc8cd3-35a9-4067-ba3c-766e6bc2a4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:34.305196 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=96 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:34.318191 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-dbfc8cd3-35a9-4067-ba3c-766e6bc2a4d7 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:36:34.319490 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-dbfc8cd3-35a9-4067-ba3c-766e6bc2a4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:34.332713 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1264/2519] 10.222.0.88 () {58 vars in 1016 bytes} [Fri Sep 23 01:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:36:34.354818 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a64cf9-67f4-4055-a2bc-958c6e5df57c service nova] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:34.367550 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a64cf9-67f4-4055-a2bc-958c6e5df57c service nova] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:34.374328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3282a0-88c1-49f1-a856-5cca532db194 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:34.374996 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3282a0-88c1-49f1-a856-5cca532db194 service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:34.375284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3282a0-88c1-49f1-a856-5cca532db194 service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:34.375559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3282a0-88c1-49f1-a856-5cca532db194 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:34.385675 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3282a0-88c1-49f1-a856-5cca532db194 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:34.387328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3282a0-88c1-49f1-a856-5cca532db194 service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:34.397845 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1256/2520] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:36:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:36:40.126688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4cf28-6e5e-4c69-b4fe-1ce31e6149d8 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:40.127733 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4cf28-6e5e-4c69-b4fe-1ce31e6149d8 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:40.127733 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4cf28-6e5e-4c69-b4fe-1ce31e6149d8 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:40.128857 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1265/2521] 10.222.0.83 () {54 vars in 921 bytes} [Fri Sep 23 01:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:36:40.135682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05cf07-4cb0-437e-bbe2-edf580127429 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:40.136751 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05cf07-4cb0-437e-bbe2-edf580127429 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:40.137033 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05cf07-4cb0-437e-bbe2-edf580127429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:40.199527 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-3b05cf07-4cb0-437e-bbe2-edf580127429 None None] MFA Rules not processed for user `be2b2806686c4a15b1ace8b6245c4e28`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:36:40.201200 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-3b05cf07-4cb0-437e-bbe2-edf580127429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:40.229791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1257/2522] 10.222.0.83 () {58 vars in 1018 bytes} [Fri Sep 23 01:36:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:36:40.251562 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4cf28-6e5e-4c69-b4fe-1ce31e6149d8 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:40.271039 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4cf28-6e5e-4c69-b4fe-1ce31e6149d8 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:40.278114 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8dfcaf-e25e-43ca-ba0c-99c361ac4473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:40.279135 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dfcaf-e25e-43ca-ba0c-99c361ac4473 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:40.279851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dfcaf-e25e-43ca-ba0c-99c361ac4473 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:40.280246 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dfcaf-e25e-43ca-ba0c-99c361ac4473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:40.293449 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8dfcaf-e25e-43ca-ba0c-99c361ac4473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:40.295159 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8dfcaf-e25e-43ca-ba0c-99c361ac4473 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:40.306668 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1266/2523] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:36:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:36:40.469991 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2054ac3-0c54-4b8a-ab6e-184e827f8c35 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:40.471275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2054ac3-0c54-4b8a-ab6e-184e827f8c35 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:40.471730 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2054ac3-0c54-4b8a-ab6e-184e827f8c35 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:40.474042 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1258/2524] 10.222.0.83 () {54 vars in 921 bytes} [Fri Sep 23 01:36:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:36:40.482901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11f01d-8d90-40f4-ad3f-64e38c296646 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:40.483227 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11f01d-8d90-40f4-ad3f-64e38c296646 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:40.483543 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11f01d-8d90-40f4-ad3f-64e38c296646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:40.519849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-2d11f01d-8d90-40f4-ad3f-64e38c296646 None None] MFA Rules not processed for user `824648d693af4b44ae5df853a3d258f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:36:40.522347 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-2d11f01d-8d90-40f4-ad3f-64e38c296646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:40.541611 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1267/2525] 10.222.0.83 () {58 vars in 1018 bytes} [Fri Sep 23 01:36:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:36:40.556852 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2054ac3-0c54-4b8a-ab6e-184e827f8c35 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:40.560560 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b2054ac3-0c54-4b8a-ab6e-184e827f8c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:40.588531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2054ac3-0c54-4b8a-ab6e-184e827f8c35 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:40.595758 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbe75e-a1a3-4627-afe7-2d8a95098fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:40.604830 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbe75e-a1a3-4627-afe7-2d8a95098fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:40.604830 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbe75e-a1a3-4627-afe7-2d8a95098fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:40.604830 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbe75e-a1a3-4627-afe7-2d8a95098fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:40.612900 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbe75e-a1a3-4627-afe7-2d8a95098fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:40.614549 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbe75e-a1a3-4627-afe7-2d8a95098fe2 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:40.633798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1259/2526] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:36:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:36:40.858743 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fd200-3dc3-46e8-91ff-a85dc812539d None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:40.859161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fd200-3dc3-46e8-91ff-a85dc812539d None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:40.859850 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fd200-3dc3-46e8-91ff-a85dc812539d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:40.888898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-910fd200-3dc3-46e8-91ff-a85dc812539d None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:36:40.891578 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-910fd200-3dc3-46e8-91ff-a85dc812539d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:40.911396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1268/2527] 10.222.0.88 () {58 vars in 1016 bytes} [Fri Sep 23 01:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:36:40.933454 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbe75e-a1a3-4627-afe7-2d8a95098fe2 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:40.949717 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbe75e-a1a3-4627-afe7-2d8a95098fe2 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:40.959606 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666c95d-0cdc-463a-aa1f-6b97b1129df6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:40.960868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666c95d-0cdc-463a-aa1f-6b97b1129df6 service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:40.961361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666c95d-0cdc-463a-aa1f-6b97b1129df6 service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:40.961948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666c95d-0cdc-463a-aa1f-6b97b1129df6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:40.977416 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666c95d-0cdc-463a-aa1f-6b97b1129df6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:40.980612 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666c95d-0cdc-463a-aa1f-6b97b1129df6 service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:41.006826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1260/2528] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:36:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:36:45.212266 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d650-0bc3-4189-b1ef-cb1927027683 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:45.214258 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d650-0bc3-4189-b1ef-cb1927027683 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:45.215066 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d650-0bc3-4189-b1ef-cb1927027683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:45.250896 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-b935d650-0bc3-4189-b1ef-cb1927027683 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:36:45.252620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b935d650-0bc3-4189-b1ef-cb1927027683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:45.265985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1269/2529] 10.222.0.88 () {58 vars in 1016 bytes} [Fri Sep 23 01:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:36:45.304327 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666c95d-0cdc-463a-aa1f-6b97b1129df6 service nova] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:45.326171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666c95d-0cdc-463a-aa1f-6b97b1129df6 service nova] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:45.336885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf32f8-59d0-4e32-a428-7426828bb8d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:45.338101 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf32f8-59d0-4e32-a428-7426828bb8d1 service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:45.338862 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf32f8-59d0-4e32-a428-7426828bb8d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:45.339561 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf32f8-59d0-4e32-a428-7426828bb8d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:45.358081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf32f8-59d0-4e32-a428-7426828bb8d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:45.360184 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf32f8-59d0-4e32-a428-7426828bb8d1 service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:45.373556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1261/2530] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:36:47.946345 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935d650-0bc3-4189-b1ef-cb1927027683 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:47.958617 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935d650-0bc3-4189-b1ef-cb1927027683 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:47.963571 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee198703-25f5-439f-ae80-14813a00d5c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:47.964203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee198703-25f5-439f-ae80-14813a00d5c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:47.964531 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee198703-25f5-439f-ae80-14813a00d5c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:47.964802 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee198703-25f5-439f-ae80-14813a00d5c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:47.966783 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ee198703-25f5-439f-ae80-14813a00d5c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:47.982918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee198703-25f5-439f-ae80-14813a00d5c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:47.984526 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee198703-25f5-439f-ae80-14813a00d5c5 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:47.996462 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1270/2531] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:36:52.184526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf32f8-59d0-4e32-a428-7426828bb8d1 service nova] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:52.186568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-40cf32f8-59d0-4e32-a428-7426828bb8d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:52.195595 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=80 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:52.201932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf32f8-59d0-4e32-a428-7426828bb8d1 service nova] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:52.208201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f1e4e-c6ce-4add-90e2-a0a442298216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:52.208837 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f1e4e-c6ce-4add-90e2-a0a442298216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:52.209353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f1e4e-c6ce-4add-90e2-a0a442298216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:52.209630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f1e4e-c6ce-4add-90e2-a0a442298216 admin admin] PATH_INFO: `/v3/users/e7bd32cb680e4d9aa9bbaa32c94e68de` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:52.211449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f1e4e-c6ce-4add-90e2-a0a442298216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7bd32cb680e4d9aa9bbaa32c94e68de)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:52.215254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f1e4e-c6ce-4add-90e2-a0a442298216 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:52.457307 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-077f1e4e-c6ce-4add-90e2-a0a442298216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7bd32cb680e4d9aa9bbaa32c94e68de'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:52.472356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-077f1e4e-c6ce-4add-90e2-a0a442298216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7bd32cb680e4d9aa9bbaa32c94e68de'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:52.538960 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-077f1e4e-c6ce-4add-90e2-a0a442298216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7bd32cb680e4d9aa9bbaa32c94e68de'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:52.539630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-077f1e4e-c6ce-4add-90e2-a0a442298216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7bd32cb680e4d9aa9bbaa32c94e68de'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:52.549594 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-077f1e4e-c6ce-4add-90e2-a0a442298216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7bd32cb680e4d9aa9bbaa32c94e68de'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:52.556653 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1262/2532] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:36:52 2022] DELETE /identity/v3/users/e7bd32cb680e4d9aa9bbaa32c94e68de => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:36:52.964067 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee198703-25f5-439f-ae80-14813a00d5c5 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:52.978084 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee198703-25f5-439f-ae80-14813a00d5c5 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:53.045458 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f63c1-83ca-444d-9032-8a2597a67bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:53.046105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f63c1-83ca-444d-9032-8a2597a67bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:53.046382 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f63c1-83ca-444d-9032-8a2597a67bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:53.046692 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f63c1-83ca-444d-9032-8a2597a67bc6 admin admin] PATH_INFO: `/v3/projects/c6eb69ff09b040bfb8d93798e76393d6` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:53.047847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f63c1-83ca-444d-9032-8a2597a67bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6eb69ff09b040bfb8d93798e76393d6)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:53.049782 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f63c1-83ca-444d-9032-8a2597a67bc6 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:53.228010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1e5f63c1-83ca-444d-9032-8a2597a67bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6eb69ff09b040bfb8d93798e76393d6', 'request_id': 'req-1e5f63c1-83ca-444d-9032-8a2597a67bc6'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:53.319704 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1e5f63c1-83ca-444d-9032-8a2597a67bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6eb69ff09b040bfb8d93798e76393d6', 'request_id': 'req-1e5f63c1-83ca-444d-9032-8a2597a67bc6'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:53.329213 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1e5f63c1-83ca-444d-9032-8a2597a67bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6eb69ff09b040bfb8d93798e76393d6', 'request_id': 'req-1e5f63c1-83ca-444d-9032-8a2597a67bc6'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:53.341669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1e5f63c1-83ca-444d-9032-8a2597a67bc6 admin admin] The token cache is being invalidate because project c6eb69ff09b040bfb8d93798e76393d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:36:53.341909 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1e5f63c1-83ca-444d-9032-8a2597a67bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:53.342536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1e5f63c1-83ca-444d-9032-8a2597a67bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:53.344645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1271/2533] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:36:52 2022] DELETE /identity/v3/projects/c6eb69ff09b040bfb8d93798e76393d6 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:36:53.350684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b8a4e-a48f-4190-9146-a7a779f22ed4 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:53.351271 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b8a4e-a48f-4190-9146-a7a779f22ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:53.351530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b8a4e-a48f-4190-9146-a7a779f22ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:53.378692 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-d47b8a4e-a48f-4190-9146-a7a779f22ed4 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:36:53.380563 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-d47b8a4e-a48f-4190-9146-a7a779f22ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:53.456263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1263/2534] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:36:53.464882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f2803-ffe7-4055-b0df-7b4296678c02 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:53.465263 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f2803-ffe7-4055-b0df-7b4296678c02 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:53.465608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f2803-ffe7-4055-b0df-7b4296678c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:53.497011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-8b4f2803-ffe7-4055-b0df-7b4296678c02 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:36:53.498606 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-8b4f2803-ffe7-4055-b0df-7b4296678c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:53.507545 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1272/2535] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:36:53.511966 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b8a4e-a48f-4190-9146-a7a779f22ed4 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:53.522960 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b8a4e-a48f-4190-9146-a7a779f22ed4 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:53.527753 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57dcbc-eb8e-4620-8093-262559140a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:53.528368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57dcbc-eb8e-4620-8093-262559140a64 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:53.528640 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57dcbc-eb8e-4620-8093-262559140a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:53.528905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57dcbc-eb8e-4620-8093-262559140a64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:53.529558 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57dcbc-eb8e-4620-8093-262559140a64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:36:53.529904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57dcbc-eb8e-4620-8093-262559140a64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:53.531538 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57dcbc-eb8e-4620-8093-262559140a64 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:53.545214 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1264/2536] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:36:53.550058 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f2803-ffe7-4055-b0df-7b4296678c02 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:53.561650 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f2803-ffe7-4055-b0df-7b4296678c02 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:53.567418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b835b-c528-41ef-be2e-b849e38ddad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:53.567981 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b835b-c528-41ef-be2e-b849e38ddad3 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:53.568440 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b835b-c528-41ef-be2e-b849e38ddad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:53.569237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b835b-c528-41ef-be2e-b849e38ddad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:53.569889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b835b-c528-41ef-be2e-b849e38ddad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:53.571918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b835b-c528-41ef-be2e-b849e38ddad3 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:53.785259 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1273/2537] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:36:53 2022] POST /identity/v3/projects => generated 403 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:36:53.786523 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57dcbc-eb8e-4620-8093-262559140a64 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:53.797918 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57dcbc-eb8e-4620-8093-262559140a64 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:53.864288 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf7f6c-10d4-4dd4-b4a5-1515c68c2dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:53.864904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf7f6c-10d4-4dd4-b4a5-1515c68c2dce admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:53.865186 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf7f6c-10d4-4dd4-b4a5-1515c68c2dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:53.865461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf7f6c-10d4-4dd4-b4a5-1515c68c2dce admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:53.866111 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf7f6c-10d4-4dd4-b4a5-1515c68c2dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:53.868382 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf7f6c-10d4-4dd4-b4a5-1515c68c2dce admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:53.878552 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:54.051905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1265/2538] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:36:53 2022] POST /identity/v3/users => generated 302 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:36:54.052536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b835b-c528-41ef-be2e-b849e38ddad3 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:54.059166 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:54.076292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b835b-c528-41ef-be2e-b849e38ddad3 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:54.081804 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6a3f2-bb9c-4f2a-a6cc-75aee5ca2dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:54.082380 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6a3f2-bb9c-4f2a-a6cc-75aee5ca2dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:54.082788 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6a3f2-bb9c-4f2a-a6cc-75aee5ca2dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:54.083128 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6a3f2-bb9c-4f2a-a6cc-75aee5ca2dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:54.083846 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6a3f2-bb9c-4f2a-a6cc-75aee5ca2dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:54.085654 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6a3f2-bb9c-4f2a-a6cc-75aee5ca2dd1 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:54.096316 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1274/2539] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:36:54.100349 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf7f6c-10d4-4dd4-b4a5-1515c68c2dce admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:54.110823 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf7f6c-10d4-4dd4-b4a5-1515c68c2dce admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:54.116132 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c78a63-13e4-42be-b73a-63ee52d4554f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:54.116740 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c78a63-13e4-42be-b73a-63ee52d4554f admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:54.117046 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c78a63-13e4-42be-b73a-63ee52d4554f admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:54.117321 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c78a63-13e4-42be-b73a-63ee52d4554f admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:54.117971 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c78a63-13e4-42be-b73a-63ee52d4554f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:54.120257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c78a63-13e4-42be-b73a-63ee52d4554f admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:54.132211 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1266/2540] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:36:54.137065 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6a3f2-bb9c-4f2a-a6cc-75aee5ca2dd1 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:54.146952 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6a3f2-bb9c-4f2a-a6cc-75aee5ca2dd1 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:54.152192 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6ffc1-d076-4731-8a08-6b853c5635c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:54.152853 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6ffc1-d076-4731-8a08-6b853c5635c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:54.153134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6ffc1-d076-4731-8a08-6b853c5635c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:54.153406 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6ffc1-d076-4731-8a08-6b853c5635c8 admin admin] PATH_INFO: `/v3/projects/6187eb46af2948eab678e21383b10101/users/e6b29fbd0b8d4ca3bfef2dd3d264da27/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:54.168244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6ffc1-d076-4731-8a08-6b853c5635c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6187eb46af2948eab678e21383b10101, user_id=e6b29fbd0b8d4ca3bfef2dd3d264da27, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:54.170939 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6ffc1-d076-4731-8a08-6b853c5635c8 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:54.246107 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1275/2541] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:36:54 2022] PUT /identity/v3/projects/6187eb46af2948eab678e21383b10101/users/e6b29fbd0b8d4ca3bfef2dd3d264da27/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:36:54.258211 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1e4de-0509-44de-92dc-71e6c27d3781 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:54.258492 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1e4de-0509-44de-92dc-71e6c27d3781 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:54.258817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1e4de-0509-44de-92dc-71e6c27d3781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:54.288658 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-2aa1e4de-0509-44de-92dc-71e6c27d3781 None None] MFA Rules not processed for user `e6b29fbd0b8d4ca3bfef2dd3d264da27`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:36:54.289892 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-2aa1e4de-0509-44de-92dc-71e6c27d3781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:54.363029 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1267/2542] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:36:54 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:36:54.367851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6ffc1-d076-4731-8a08-6b853c5635c8 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:54.431567 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6ffc1-d076-4731-8a08-6b853c5635c8 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:54.436402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fd406-ff6c-43bc-a7b0-1c9fb60a6c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:54.437021 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fd406-ff6c-43bc-a7b0-1c9fb60a6c0f admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:54.437303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fd406-ff6c-43bc-a7b0-1c9fb60a6c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:54.437578 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fd406-ff6c-43bc-a7b0-1c9fb60a6c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:54.438224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fd406-ff6c-43bc-a7b0-1c9fb60a6c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:54.440248 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fd406-ff6c-43bc-a7b0-1c9fb60a6c0f admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:54.567256 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1276/2543] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:36:54 2022] POST /identity/v3/projects => generated 403 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:36:54.571547 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1e4de-0509-44de-92dc-71e6c27d3781 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:54.582989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1e4de-0509-44de-92dc-71e6c27d3781 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:54.640479 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea9452-a464-4040-9df4-5ac779e4200e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:54.641006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea9452-a464-4040-9df4-5ac779e4200e admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:54.641286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea9452-a464-4040-9df4-5ac779e4200e admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:54.641559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea9452-a464-4040-9df4-5ac779e4200e admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:54.642221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea9452-a464-4040-9df4-5ac779e4200e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:54.644239 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea9452-a464-4040-9df4-5ac779e4200e admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:54.771306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1268/2544] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:36:54 2022] POST /identity/v3/users => generated 308 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:36:54.776396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fd406-ff6c-43bc-a7b0-1c9fb60a6c0f admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:54.787295 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fd406-ff6c-43bc-a7b0-1c9fb60a6c0f admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:54.792935 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a07d7-b983-42b2-a6a6-e58c25e47832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:54.795144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a07d7-b983-42b2-a6a6-e58c25e47832 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:54.795144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a07d7-b983-42b2-a6a6-e58c25e47832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:54.795144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a07d7-b983-42b2-a6a6-e58c25e47832 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:54.795144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a07d7-b983-42b2-a6a6-e58c25e47832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:54.796487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a07d7-b983-42b2-a6a6-e58c25e47832 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:54.808360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1277/2545] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:36:54.812733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea9452-a464-4040-9df4-5ac779e4200e admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:54.823467 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea9452-a464-4040-9df4-5ac779e4200e admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:54.829154 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0461e-6631-477c-93cf-c34152436ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:54.830256 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0461e-6631-477c-93cf-c34152436ade admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:54.830799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0461e-6631-477c-93cf-c34152436ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:54.831272 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0461e-6631-477c-93cf-c34152436ade admin admin] PATH_INFO: `/v3/projects/6d6ce6a79e6b43049e8bc15d32f84247/users/6897c84a7d46488db4999d1ccef7e6a5/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:54.848095 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0461e-6631-477c-93cf-c34152436ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d6ce6a79e6b43049e8bc15d32f84247, user_id=6897c84a7d46488db4999d1ccef7e6a5, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:54.850896 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0461e-6631-477c-93cf-c34152436ade admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:54.990613 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1269/2546] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:36:54 2022] PUT /identity/v3/projects/6d6ce6a79e6b43049e8bc15d32f84247/users/6897c84a7d46488db4999d1ccef7e6a5/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:36:54.995101 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a07d7-b983-42b2-a6a6-e58c25e47832 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:55.005419 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a07d7-b983-42b2-a6a6-e58c25e47832 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:55.064443 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048967c3-3c94-4339-9cac-a5a9271a0397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:55.065277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048967c3-3c94-4339-9cac-a5a9271a0397 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:55.065397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048967c3-3c94-4339-9cac-a5a9271a0397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:55.065588 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048967c3-3c94-4339-9cac-a5a9271a0397 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:55.066236 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048967c3-3c94-4339-9cac-a5a9271a0397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:55.068535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048967c3-3c94-4339-9cac-a5a9271a0397 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:55.080516 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1278/2547] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:36:55.084622 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0461e-6631-477c-93cf-c34152436ade admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:55.096365 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0461e-6631-477c-93cf-c34152436ade admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:55.101401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052250fb-575b-414f-88c6-39b6446673b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:55.102066 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052250fb-575b-414f-88c6-39b6446673b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:55.102348 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052250fb-575b-414f-88c6-39b6446673b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:55.102655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052250fb-575b-414f-88c6-39b6446673b9 admin admin] PATH_INFO: `/v3/projects/6d6ce6a79e6b43049e8bc15d32f84247/users/6897c84a7d46488db4999d1ccef7e6a5/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:55.104662 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052250fb-575b-414f-88c6-39b6446673b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d6ce6a79e6b43049e8bc15d32f84247, user_id=6897c84a7d46488db4999d1ccef7e6a5, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:55.107352 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052250fb-575b-414f-88c6-39b6446673b9 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:55.118341 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1270/2548] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:36:55 2022] PUT /identity/v3/projects/6d6ce6a79e6b43049e8bc15d32f84247/users/6897c84a7d46488db4999d1ccef7e6a5/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:36:55.129574 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f825c1-d91f-488a-b3aa-65e1950f4c4e None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:55.129904 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f825c1-d91f-488a-b3aa-65e1950f4c4e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:55.130177 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f825c1-d91f-488a-b3aa-65e1950f4c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:55.163626 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-60f825c1-d91f-488a-b3aa-65e1950f4c4e None None] MFA Rules not processed for user `6897c84a7d46488db4999d1ccef7e6a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:36:55.165408 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-60f825c1-d91f-488a-b3aa-65e1950f4c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:55.208838 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:55.269622 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1279/2549] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:36:55 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:36:55.284525 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052250fb-575b-414f-88c6-39b6446673b9 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:55.286284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-052250fb-575b-414f-88c6-39b6446673b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:55.315079 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:55.373928 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052250fb-575b-414f-88c6-39b6446673b9 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:55.378967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629d341-ef0b-45ce-8b11-93f315074b9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:55.379629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629d341-ef0b-45ce-8b11-93f315074b9f service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:55.380021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629d341-ef0b-45ce-8b11-93f315074b9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:55.380475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629d341-ef0b-45ce-8b11-93f315074b9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:55.391339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629d341-ef0b-45ce-8b11-93f315074b9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:55.392806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629d341-ef0b-45ce-8b11-93f315074b9f service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:55.404543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1271/2550] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:36:55 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:36:55.577396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f825c1-d91f-488a-b3aa-65e1950f4c4e None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:55.642009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f825c1-d91f-488a-b3aa-65e1950f4c4e None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:55.646905 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4f610-0368-419c-8c0f-8df027b7e9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:55.647543 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4f610-0368-419c-8c0f-8df027b7e9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:55.647824 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4f610-0368-419c-8c0f-8df027b7e9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:55.648098 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4f610-0368-419c-8c0f-8df027b7e9ba admin admin] PATH_INFO: `/v3/users/e6b29fbd0b8d4ca3bfef2dd3d264da27` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:55.649236 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4f610-0368-419c-8c0f-8df027b7e9ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b29fbd0b8d4ca3bfef2dd3d264da27)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:55.651233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4f610-0368-419c-8c0f-8df027b7e9ba admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:55.890364 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-38a4f610-0368-419c-8c0f-8df027b7e9ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b29fbd0b8d4ca3bfef2dd3d264da27'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:56.005240 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-38a4f610-0368-419c-8c0f-8df027b7e9ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b29fbd0b8d4ca3bfef2dd3d264da27'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:56.005868 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-38a4f610-0368-419c-8c0f-8df027b7e9ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b29fbd0b8d4ca3bfef2dd3d264da27'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:56.015000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-38a4f610-0368-419c-8c0f-8df027b7e9ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b29fbd0b8d4ca3bfef2dd3d264da27'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:56.015649 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-38a4f610-0368-419c-8c0f-8df027b7e9ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b29fbd0b8d4ca3bfef2dd3d264da27'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:56.034453 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1280/2551] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:36:55 2022] DELETE /identity/v3/users/e6b29fbd0b8d4ca3bfef2dd3d264da27 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:36:56.042311 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cdf07-0f18-42d1-8e77-d9734208fcd3 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:56.042311 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cdf07-0f18-42d1-8e77-d9734208fcd3 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:56.042311 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cdf07-0f18-42d1-8e77-d9734208fcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:56.064003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-e27cdf07-0f18-42d1-8e77-d9734208fcd3 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:36:56.065403 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e27cdf07-0f18-42d1-8e77-d9734208fcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:56.141143 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1272/2552] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:36:56.151481 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4f610-0368-419c-8c0f-8df027b7e9ba admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:56.153206 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-38a4f610-0368-419c-8c0f-8df027b7e9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:56.205726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:56.222516 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4f610-0368-419c-8c0f-8df027b7e9ba admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:56.226375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3eb0d4-5c4e-43fe-92ba-3d1ea2e47c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:56.227022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3eb0d4-5c4e-43fe-92ba-3d1ea2e47c62 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:56.227300 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3eb0d4-5c4e-43fe-92ba-3d1ea2e47c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:56.227569 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3eb0d4-5c4e-43fe-92ba-3d1ea2e47c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:56.238144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3eb0d4-5c4e-43fe-92ba-3d1ea2e47c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:56.239615 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3eb0d4-5c4e-43fe-92ba-3d1ea2e47c62 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:56.250971 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1281/2553] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:36:56.750171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cdf07-0f18-42d1-8e77-d9734208fcd3 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:56.751723 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e27cdf07-0f18-42d1-8e77-d9734208fcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:56.766012 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cdf07-0f18-42d1-8e77-d9734208fcd3 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:56.772647 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d50061-016a-46ad-aa72-6ed16aa6fe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:56.782942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d50061-016a-46ad-aa72-6ed16aa6fe39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:56.782942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d50061-016a-46ad-aa72-6ed16aa6fe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:56.782942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d50061-016a-46ad-aa72-6ed16aa6fe39 admin admin] PATH_INFO: `/v3/projects/6187eb46af2948eab678e21383b10101` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:56.782942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d50061-016a-46ad-aa72-6ed16aa6fe39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6187eb46af2948eab678e21383b10101)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:56.782942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d50061-016a-46ad-aa72-6ed16aa6fe39 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:56.958033 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-07d50061-016a-46ad-aa72-6ed16aa6fe39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6187eb46af2948eab678e21383b10101', 'request_id': 'req-07d50061-016a-46ad-aa72-6ed16aa6fe39'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:57.035786 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-07d50061-016a-46ad-aa72-6ed16aa6fe39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6187eb46af2948eab678e21383b10101', 'request_id': 'req-07d50061-016a-46ad-aa72-6ed16aa6fe39'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:57.042856 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-07d50061-016a-46ad-aa72-6ed16aa6fe39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6187eb46af2948eab678e21383b10101', 'request_id': 'req-07d50061-016a-46ad-aa72-6ed16aa6fe39'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:57.054687 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-07d50061-016a-46ad-aa72-6ed16aa6fe39 admin admin] The token cache is being invalidate because project 6187eb46af2948eab678e21383b10101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:36:57.054979 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-07d50061-016a-46ad-aa72-6ed16aa6fe39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:57.055643 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-07d50061-016a-46ad-aa72-6ed16aa6fe39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:57.057295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1273/2554] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:36:56 2022] DELETE /identity/v3/projects/6187eb46af2948eab678e21383b10101 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:36:57.061462 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3eb0d4-5c4e-43fe-92ba-3d1ea2e47c62 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:57.072115 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3eb0d4-5c4e-43fe-92ba-3d1ea2e47c62 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:57.137200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c957d4-1b7a-45f8-b8a1-2d6cd2e946a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:57.137852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c957d4-1b7a-45f8-b8a1-2d6cd2e946a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:57.138162 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c957d4-1b7a-45f8-b8a1-2d6cd2e946a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:57.138432 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c957d4-1b7a-45f8-b8a1-2d6cd2e946a9 admin admin] PATH_INFO: `/v3/users/6897c84a7d46488db4999d1ccef7e6a5` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:57.139744 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c957d4-1b7a-45f8-b8a1-2d6cd2e946a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6897c84a7d46488db4999d1ccef7e6a5)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:57.141821 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c957d4-1b7a-45f8-b8a1-2d6cd2e946a9 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:57.433527 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-63c957d4-1b7a-45f8-b8a1-2d6cd2e946a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6897c84a7d46488db4999d1ccef7e6a5'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:57.592895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-63c957d4-1b7a-45f8-b8a1-2d6cd2e946a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6897c84a7d46488db4999d1ccef7e6a5'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:57.592895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-63c957d4-1b7a-45f8-b8a1-2d6cd2e946a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6897c84a7d46488db4999d1ccef7e6a5'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:57.601559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-63c957d4-1b7a-45f8-b8a1-2d6cd2e946a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6897c84a7d46488db4999d1ccef7e6a5'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:57.602794 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-63c957d4-1b7a-45f8-b8a1-2d6cd2e946a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6897c84a7d46488db4999d1ccef7e6a5'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:57.629514 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1282/2555] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:36:57 2022] DELETE /identity/v3/users/6897c84a7d46488db4999d1ccef7e6a5 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:36:58.259775 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d50061-016a-46ad-aa72-6ed16aa6fe39 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:58.261373 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-07d50061-016a-46ad-aa72-6ed16aa6fe39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:58.275232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d50061-016a-46ad-aa72-6ed16aa6fe39 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:58.323830 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:58.367905 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41e51b-5b9f-46d3-ac85-476060ff1fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:58.369477 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41e51b-5b9f-46d3-ac85-476060ff1fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:58.369815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41e51b-5b9f-46d3-ac85-476060ff1fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:58.369991 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41e51b-5b9f-46d3-ac85-476060ff1fbb admin admin] PATH_INFO: `/v3/projects/6d6ce6a79e6b43049e8bc15d32f84247` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:58.372155 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41e51b-5b9f-46d3-ac85-476060ff1fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d6ce6a79e6b43049e8bc15d32f84247)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:58.376648 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41e51b-5b9f-46d3-ac85-476060ff1fbb admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:58.505901 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-7c41e51b-5b9f-46d3-ac85-476060ff1fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d6ce6a79e6b43049e8bc15d32f84247', 'request_id': 'req-7c41e51b-5b9f-46d3-ac85-476060ff1fbb'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:58.576197 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-7c41e51b-5b9f-46d3-ac85-476060ff1fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d6ce6a79e6b43049e8bc15d32f84247', 'request_id': 'req-7c41e51b-5b9f-46d3-ac85-476060ff1fbb'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:58.582454 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-7c41e51b-5b9f-46d3-ac85-476060ff1fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d6ce6a79e6b43049e8bc15d32f84247', 'request_id': 'req-7c41e51b-5b9f-46d3-ac85-476060ff1fbb'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:58.594509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-7c41e51b-5b9f-46d3-ac85-476060ff1fbb admin admin] The token cache is being invalidate because project 6d6ce6a79e6b43049e8bc15d32f84247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:36:58.594913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-7c41e51b-5b9f-46d3-ac85-476060ff1fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:58.595514 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-7c41e51b-5b9f-46d3-ac85-476060ff1fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:36:58.597064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1274/2556] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:36:58 2022] DELETE /identity/v3/projects/6d6ce6a79e6b43049e8bc15d32f84247 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:36:58.601973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe9b18-9d3e-466b-aa90-fcca66a8ef8f None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:58.602487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe9b18-9d3e-466b-aa90-fcca66a8ef8f None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:58.602621 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe9b18-9d3e-466b-aa90-fcca66a8ef8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:58.626903 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-45fe9b18-9d3e-466b-aa90-fcca66a8ef8f None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:36:58.628127 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-45fe9b18-9d3e-466b-aa90-fcca66a8ef8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:58.693283 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1283/2557] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:36:58.701347 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f0c62-f86b-43a0-8a4c-6d6922e66ab8 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:58.705765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f0c62-f86b-43a0-8a4c-6d6922e66ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:58.705765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f0c62-f86b-43a0-8a4c-6d6922e66ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:58.724766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-b66f0c62-f86b-43a0-8a4c-6d6922e66ab8 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:36:58.727682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b66f0c62-f86b-43a0-8a4c-6d6922e66ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:58.741917 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1275/2558] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:36:58.747153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe9b18-9d3e-466b-aa90-fcca66a8ef8f None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:58.753472 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:58.757586 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe9b18-9d3e-466b-aa90-fcca66a8ef8f None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:58.762419 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc60bd-3523-4524-83e2-4850517a27aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:58.763083 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc60bd-3523-4524-83e2-4850517a27aa admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:58.763401 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc60bd-3523-4524-83e2-4850517a27aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:58.763626 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc60bd-3523-4524-83e2-4850517a27aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:58.764280 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc60bd-3523-4524-83e2-4850517a27aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:36:58.764576 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc60bd-3523-4524-83e2-4850517a27aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:58.766171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc60bd-3523-4524-83e2-4850517a27aa admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:58.782428 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1284/2559] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:36:58.787056 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f0c62-f86b-43a0-8a4c-6d6922e66ab8 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:58.798061 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f0c62-f86b-43a0-8a4c-6d6922e66ab8 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:58.803617 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8effdd4-ec32-4eaf-a7ea-ec63d632fb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:58.804312 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8effdd4-ec32-4eaf-a7ea-ec63d632fb2b admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:58.804586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8effdd4-ec32-4eaf-a7ea-ec63d632fb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:58.804881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8effdd4-ec32-4eaf-a7ea-ec63d632fb2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:58.805521 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8effdd4-ec32-4eaf-a7ea-ec63d632fb2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:58.808376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8effdd4-ec32-4eaf-a7ea-ec63d632fb2b admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:58.921942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1276/2560] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:36:58 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:36:58.923177 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc60bd-3523-4524-83e2-4850517a27aa admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:58.933981 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc60bd-3523-4524-83e2-4850517a27aa admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:58.993978 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c31d6-5596-4d63-98dd-2fc76c3612cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:58.994702 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c31d6-5596-4d63-98dd-2fc76c3612cd admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:58.994996 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c31d6-5596-4d63-98dd-2fc76c3612cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:58.995267 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c31d6-5596-4d63-98dd-2fc76c3612cd admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:58.995934 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c31d6-5596-4d63-98dd-2fc76c3612cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:58.997908 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c31d6-5596-4d63-98dd-2fc76c3612cd admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:59.061819 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1285/2561] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:36:58 2022] POST /identity/v3/users => generated 291 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:36:59.063023 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8effdd4-ec32-4eaf-a7ea-ec63d632fb2b admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:59.080922 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8effdd4-ec32-4eaf-a7ea-ec63d632fb2b admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:59.086052 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1008ff4-6b80-4358-82bf-c636076399e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:59.086775 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1008ff4-6b80-4358-82bf-c636076399e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:59.087735 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1008ff4-6b80-4358-82bf-c636076399e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:59.087985 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1008ff4-6b80-4358-82bf-c636076399e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:59.088693 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1008ff4-6b80-4358-82bf-c636076399e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:59.090447 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1008ff4-6b80-4358-82bf-c636076399e2 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:59.107659 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1277/2562] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:36:59.111897 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c31d6-5596-4d63-98dd-2fc76c3612cd admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:59.122695 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c31d6-5596-4d63-98dd-2fc76c3612cd admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:59.128131 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e127a-5d65-4380-9d87-ea8aebb0edde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:59.128746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e127a-5d65-4380-9d87-ea8aebb0edde admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:59.129027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e127a-5d65-4380-9d87-ea8aebb0edde admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:59.129303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e127a-5d65-4380-9d87-ea8aebb0edde admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:59.129954 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e127a-5d65-4380-9d87-ea8aebb0edde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:59.131609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e127a-5d65-4380-9d87-ea8aebb0edde admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:59.145139 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1286/2563] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:36:59.150427 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1008ff4-6b80-4358-82bf-c636076399e2 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:59.161423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1008ff4-6b80-4358-82bf-c636076399e2 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:59.169004 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1d580-fe79-478a-b9cb-2cfa90f6ee00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:59.169937 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1d580-fe79-478a-b9cb-2cfa90f6ee00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:59.170222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1d580-fe79-478a-b9cb-2cfa90f6ee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:59.170497 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1d580-fe79-478a-b9cb-2cfa90f6ee00 admin admin] PATH_INFO: `/v3/projects/5d231eedd95f4a00ba6e93f2b47455b8/users/61f00611b9c74276b1a0c2a65f9a8ed1/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:59.190026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1d580-fe79-478a-b9cb-2cfa90f6ee00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d231eedd95f4a00ba6e93f2b47455b8, user_id=61f00611b9c74276b1a0c2a65f9a8ed1, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:59.193021 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1d580-fe79-478a-b9cb-2cfa90f6ee00 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:59.281635 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1278/2564] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:36:59 2022] PUT /identity/v3/projects/5d231eedd95f4a00ba6e93f2b47455b8/users/61f00611b9c74276b1a0c2a65f9a8ed1/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:36:59.294397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6723745-d068-4b74-91a8-eafbe5e2d2a4 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:59.294831 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6723745-d068-4b74-91a8-eafbe5e2d2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:59.295126 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6723745-d068-4b74-91a8-eafbe5e2d2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:59.328462 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-a6723745-d068-4b74-91a8-eafbe5e2d2a4 None None] MFA Rules not processed for user `61f00611b9c74276b1a0c2a65f9a8ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:36:59.329623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a6723745-d068-4b74-91a8-eafbe5e2d2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:36:59.402211 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1287/2565] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:36:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:36:59.407050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1d580-fe79-478a-b9cb-2cfa90f6ee00 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:59.466717 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:59.473204 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1d580-fe79-478a-b9cb-2cfa90f6ee00 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:59.480070 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b29814-497a-450a-b862-455b3d0c024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:59.480788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b29814-497a-450a-b862-455b3d0c024d admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:59.481066 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b29814-497a-450a-b862-455b3d0c024d admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:59.481351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b29814-497a-450a-b862-455b3d0c024d admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:59.482042 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b29814-497a-450a-b862-455b3d0c024d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:59.484047 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b29814-497a-450a-b862-455b3d0c024d admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:59.609412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1279/2566] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:36:59 2022] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:36:59.613925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6723745-d068-4b74-91a8-eafbe5e2d2a4 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:59.624991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6723745-d068-4b74-91a8-eafbe5e2d2a4 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:59.694005 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5d39d-e396-4ed0-b3f3-27719f98a8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:59.694657 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5d39d-e396-4ed0-b3f3-27719f98a8ed admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:59.694941 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5d39d-e396-4ed0-b3f3-27719f98a8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:59.695215 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5d39d-e396-4ed0-b3f3-27719f98a8ed admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:59.695903 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5d39d-e396-4ed0-b3f3-27719f98a8ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:59.698570 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5d39d-e396-4ed0-b3f3-27719f98a8ed admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:59.707776 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:59.792775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1288/2567] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:36:59 2022] POST /identity/v3/users => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:36:59.797161 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b29814-497a-450a-b862-455b3d0c024d admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:59.815609 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b29814-497a-450a-b862-455b3d0c024d admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:59.823540 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fa49c-df3c-4258-9893-8e707da5ce71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:59.824246 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fa49c-df3c-4258-9893-8e707da5ce71 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:59.824526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fa49c-df3c-4258-9893-8e707da5ce71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:59.824802 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fa49c-df3c-4258-9893-8e707da5ce71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:59.825462 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fa49c-df3c-4258-9893-8e707da5ce71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:59.827193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fa49c-df3c-4258-9893-8e707da5ce71 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:36:59.838337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1280/2568] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:36:59.843526 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5d39d-e396-4ed0-b3f3-27719f98a8ed admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:36:59.857405 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5d39d-e396-4ed0-b3f3-27719f98a8ed admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:36:59.862579 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b620fbd-2910-4336-b4cd-6101187a797e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:36:59.863493 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b620fbd-2910-4336-b4cd-6101187a797e admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:36:59.863899 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b620fbd-2910-4336-b4cd-6101187a797e admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:36:59.864047 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b620fbd-2910-4336-b4cd-6101187a797e admin admin] PATH_INFO: `/v3/projects/2d66e4649cc04c55be67a0180d44955f/users/630ac832e57a4187a0903df6b47fda95/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:36:59.881257 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b620fbd-2910-4336-b4cd-6101187a797e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d66e4649cc04c55be67a0180d44955f, user_id=630ac832e57a4187a0903df6b47fda95, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:36:59.884579 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b620fbd-2910-4336-b4cd-6101187a797e admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:00.002784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1289/2569] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:36:59 2022] PUT /identity/v3/projects/2d66e4649cc04c55be67a0180d44955f/users/630ac832e57a4187a0903df6b47fda95/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:00.007189 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fa49c-df3c-4258-9893-8e707da5ce71 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:00.019188 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fa49c-df3c-4258-9893-8e707da5ce71 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:00.078928 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb0d2c-6a31-4669-aa53-9f2570ae9b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:00.079475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb0d2c-6a31-4669-aa53-9f2570ae9b8e admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:00.079756 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb0d2c-6a31-4669-aa53-9f2570ae9b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:00.080044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb0d2c-6a31-4669-aa53-9f2570ae9b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:00.080689 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb0d2c-6a31-4669-aa53-9f2570ae9b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:00.082291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb0d2c-6a31-4669-aa53-9f2570ae9b8e admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:00.093401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1281/2570] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:37:00.097665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b620fbd-2910-4336-b4cd-6101187a797e admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:00.109819 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b620fbd-2910-4336-b4cd-6101187a797e admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:00.115186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24071d-9f66-40ec-bd66-cbbf02f2fcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:00.115869 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24071d-9f66-40ec-bd66-cbbf02f2fcb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:00.116148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24071d-9f66-40ec-bd66-cbbf02f2fcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:00.116425 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24071d-9f66-40ec-bd66-cbbf02f2fcb9 admin admin] PATH_INFO: `/v3/projects/2d66e4649cc04c55be67a0180d44955f/users/630ac832e57a4187a0903df6b47fda95/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:00.119161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24071d-9f66-40ec-bd66-cbbf02f2fcb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d66e4649cc04c55be67a0180d44955f, user_id=630ac832e57a4187a0903df6b47fda95, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:00.121845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24071d-9f66-40ec-bd66-cbbf02f2fcb9 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:00.133758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1290/2571] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:37:00 2022] PUT /identity/v3/projects/2d66e4649cc04c55be67a0180d44955f/users/630ac832e57a4187a0903df6b47fda95/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:00.144067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de3646-b625-41b9-8b5a-8442171fcaf2 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:00.144395 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de3646-b625-41b9-8b5a-8442171fcaf2 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:00.144631 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de3646-b625-41b9-8b5a-8442171fcaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:00.177542 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-36de3646-b625-41b9-8b5a-8442171fcaf2 None None] MFA Rules not processed for user `630ac832e57a4187a0903df6b47fda95`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:00.179783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-36de3646-b625-41b9-8b5a-8442171fcaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:00.300383 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1282/2572] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:00.312460 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24071d-9f66-40ec-bd66-cbbf02f2fcb9 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:00.314218 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-5c24071d-9f66-40ec-bd66-cbbf02f2fcb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:00.385934 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24071d-9f66-40ec-bd66-cbbf02f2fcb9 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:00.389905 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447d960-462b-47f4-919c-781d0bb4b5f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:00.390524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447d960-462b-47f4-919c-781d0bb4b5f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:00.390835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447d960-462b-47f4-919c-781d0bb4b5f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:00.391109 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447d960-462b-47f4-919c-781d0bb4b5f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:00.401672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447d960-462b-47f4-919c-781d0bb4b5f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:00.403171 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447d960-462b-47f4-919c-781d0bb4b5f6 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:00.413040 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1291/2573] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:37:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:37:00.522289 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de3646-b625-41b9-8b5a-8442171fcaf2 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:00.532414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de3646-b625-41b9-8b5a-8442171fcaf2 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:00.536099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5887ad1-a6d8-423b-a131-a9764bc35594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:00.536752 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5887ad1-a6d8-423b-a131-a9764bc35594 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:00.537103 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5887ad1-a6d8-423b-a131-a9764bc35594 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:00.537325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5887ad1-a6d8-423b-a131-a9764bc35594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:00.590886 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:00.604889 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5887ad1-a6d8-423b-a131-a9764bc35594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:00.604889 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5887ad1-a6d8-423b-a131-a9764bc35594 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:00.615250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1283/2574] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:37:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:37:04.276906 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447d960-462b-47f4-919c-781d0bb4b5f6 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:04.378372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447d960-462b-47f4-919c-781d0bb4b5f6 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:04.383851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b272b9e-d592-4c6d-a8a1-80a51dd58d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:04.385126 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b272b9e-d592-4c6d-a8a1-80a51dd58d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:04.385403 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b272b9e-d592-4c6d-a8a1-80a51dd58d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:04.385706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b272b9e-d592-4c6d-a8a1-80a51dd58d68 admin admin] PATH_INFO: `/v3/users/61f00611b9c74276b1a0c2a65f9a8ed1` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:04.388833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b272b9e-d592-4c6d-a8a1-80a51dd58d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61f00611b9c74276b1a0c2a65f9a8ed1)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:04.389015 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b272b9e-d592-4c6d-a8a1-80a51dd58d68 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:04.637729 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3b272b9e-d592-4c6d-a8a1-80a51dd58d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61f00611b9c74276b1a0c2a65f9a8ed1'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:04.710471 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3b272b9e-d592-4c6d-a8a1-80a51dd58d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61f00611b9c74276b1a0c2a65f9a8ed1'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:04.711222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3b272b9e-d592-4c6d-a8a1-80a51dd58d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61f00611b9c74276b1a0c2a65f9a8ed1'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:04.713931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:INSERT=6,keystone:SELECT=86,keystone:DELETE=8 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:04.720624 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3b272b9e-d592-4c6d-a8a1-80a51dd58d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61f00611b9c74276b1a0c2a65f9a8ed1'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:04.721506 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3b272b9e-d592-4c6d-a8a1-80a51dd58d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61f00611b9c74276b1a0c2a65f9a8ed1'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:04.748682 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1292/2575] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:37:04 2022] DELETE /identity/v3/users/61f00611b9c74276b1a0c2a65f9a8ed1 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:04.754287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a388c2-63c8-4ed0-be04-b52b249ed0a5 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:04.755013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a388c2-63c8-4ed0-be04-b52b249ed0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:04.755013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a388c2-63c8-4ed0-be04-b52b249ed0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:04.776088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-c0a388c2-63c8-4ed0-be04-b52b249ed0a5 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:04.777316 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-c0a388c2-63c8-4ed0-be04-b52b249ed0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:04.838404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1284/2576] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:04.849886 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b272b9e-d592-4c6d-a8a1-80a51dd58d68 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:04.851363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-3b272b9e-d592-4c6d-a8a1-80a51dd58d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:04.917113 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b272b9e-d592-4c6d-a8a1-80a51dd58d68 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:04.920767 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375a9bd-76b7-4aac-905d-f082330c953f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:04.929887 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375a9bd-76b7-4aac-905d-f082330c953f service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:04.929887 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375a9bd-76b7-4aac-905d-f082330c953f service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:04.929887 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375a9bd-76b7-4aac-905d-f082330c953f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:04.931966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375a9bd-76b7-4aac-905d-f082330c953f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:04.933426 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375a9bd-76b7-4aac-905d-f082330c953f service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:04.943029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1293/2577] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:37:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:37:05.478724 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a388c2-63c8-4ed0-be04-b52b249ed0a5 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:05.480367 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-c0a388c2-63c8-4ed0-be04-b52b249ed0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:05.493314 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a388c2-63c8-4ed0-be04-b52b249ed0a5 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:05.503073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1f0c2-ac1c-4120-8889-9ddcf01a1274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:05.504202 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1f0c2-ac1c-4120-8889-9ddcf01a1274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:05.504673 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1f0c2-ac1c-4120-8889-9ddcf01a1274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:05.505744 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1f0c2-ac1c-4120-8889-9ddcf01a1274 admin admin] PATH_INFO: `/v3/projects/5d231eedd95f4a00ba6e93f2b47455b8` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:05.508440 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1f0c2-ac1c-4120-8889-9ddcf01a1274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d231eedd95f4a00ba6e93f2b47455b8)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:05.512641 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1f0c2-ac1c-4120-8889-9ddcf01a1274 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:05.755136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-9fd1f0c2-ac1c-4120-8889-9ddcf01a1274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d231eedd95f4a00ba6e93f2b47455b8', 'request_id': 'req-9fd1f0c2-ac1c-4120-8889-9ddcf01a1274'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:05.901723 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-9fd1f0c2-ac1c-4120-8889-9ddcf01a1274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d231eedd95f4a00ba6e93f2b47455b8', 'request_id': 'req-9fd1f0c2-ac1c-4120-8889-9ddcf01a1274'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:05.915208 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-9fd1f0c2-ac1c-4120-8889-9ddcf01a1274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d231eedd95f4a00ba6e93f2b47455b8', 'request_id': 'req-9fd1f0c2-ac1c-4120-8889-9ddcf01a1274'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:05.937198 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-9fd1f0c2-ac1c-4120-8889-9ddcf01a1274 admin admin] The token cache is being invalidate because project 5d231eedd95f4a00ba6e93f2b47455b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:37:05.937574 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-9fd1f0c2-ac1c-4120-8889-9ddcf01a1274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:05.942049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-9fd1f0c2-ac1c-4120-8889-9ddcf01a1274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:05.942049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1285/2578] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:37:05 2022] DELETE /identity/v3/projects/5d231eedd95f4a00ba6e93f2b47455b8 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:05.948126 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375a9bd-76b7-4aac-905d-f082330c953f service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:05.965736 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375a9bd-76b7-4aac-905d-f082330c953f service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:06.059486 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795428ba-216f-44d9-ad5d-00dc1b6fe5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:06.060835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795428ba-216f-44d9-ad5d-00dc1b6fe5f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:06.061588 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795428ba-216f-44d9-ad5d-00dc1b6fe5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:06.062719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795428ba-216f-44d9-ad5d-00dc1b6fe5f5 admin admin] PATH_INFO: `/v3/users/630ac832e57a4187a0903df6b47fda95` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:06.065211 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795428ba-216f-44d9-ad5d-00dc1b6fe5f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=630ac832e57a4187a0903df6b47fda95)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:06.070975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795428ba-216f-44d9-ad5d-00dc1b6fe5f5 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:06.431887 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-795428ba-216f-44d9-ad5d-00dc1b6fe5f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630ac832e57a4187a0903df6b47fda95'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:06.573377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-795428ba-216f-44d9-ad5d-00dc1b6fe5f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630ac832e57a4187a0903df6b47fda95'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:06.573773 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-795428ba-216f-44d9-ad5d-00dc1b6fe5f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630ac832e57a4187a0903df6b47fda95'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:06.583162 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-795428ba-216f-44d9-ad5d-00dc1b6fe5f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630ac832e57a4187a0903df6b47fda95'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:06.587970 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-795428ba-216f-44d9-ad5d-00dc1b6fe5f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630ac832e57a4187a0903df6b47fda95'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:06.603836 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:06.612452 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1294/2579] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:37:05 2022] DELETE /identity/v3/users/630ac832e57a4187a0903df6b47fda95 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:07.205117 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1f0c2-ac1c-4120-8889-9ddcf01a1274 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:07.207423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-9fd1f0c2-ac1c-4120-8889-9ddcf01a1274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:07.229351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1f0c2-ac1c-4120-8889-9ddcf01a1274 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:07.344092 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b568c-22b1-4e11-ba8a-71bc523075f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:07.344773 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b568c-22b1-4e11-ba8a-71bc523075f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:07.345065 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b568c-22b1-4e11-ba8a-71bc523075f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:07.345562 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b568c-22b1-4e11-ba8a-71bc523075f2 admin admin] PATH_INFO: `/v3/projects/2d66e4649cc04c55be67a0180d44955f` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:07.347256 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b568c-22b1-4e11-ba8a-71bc523075f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d66e4649cc04c55be67a0180d44955f)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:07.349354 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b568c-22b1-4e11-ba8a-71bc523075f2 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:07.373047 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:07.529468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-8e8b568c-22b1-4e11-ba8a-71bc523075f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d66e4649cc04c55be67a0180d44955f', 'request_id': 'req-8e8b568c-22b1-4e11-ba8a-71bc523075f2'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:07.704178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-8e8b568c-22b1-4e11-ba8a-71bc523075f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d66e4649cc04c55be67a0180d44955f', 'request_id': 'req-8e8b568c-22b1-4e11-ba8a-71bc523075f2'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:07.710649 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-8e8b568c-22b1-4e11-ba8a-71bc523075f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d66e4649cc04c55be67a0180d44955f', 'request_id': 'req-8e8b568c-22b1-4e11-ba8a-71bc523075f2'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:07.722968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-8e8b568c-22b1-4e11-ba8a-71bc523075f2 admin admin] The token cache is being invalidate because project 2d66e4649cc04c55be67a0180d44955f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:37:07.723274 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-8e8b568c-22b1-4e11-ba8a-71bc523075f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:07.723940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-8e8b568c-22b1-4e11-ba8a-71bc523075f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:07.725516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1286/2580] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:37:07 2022] DELETE /identity/v3/projects/2d66e4649cc04c55be67a0180d44955f => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:37:07.731653 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2e517-3c0e-42c7-b29d-337a908c2d3a None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:07.732252 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2e517-3c0e-42c7-b29d-337a908c2d3a None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:07.732252 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2e517-3c0e-42c7-b29d-337a908c2d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:07.756996 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-0ff2e517-3c0e-42c7-b29d-337a908c2d3a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:07.758276 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-0ff2e517-3c0e-42c7-b29d-337a908c2d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:07.832408 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1295/2581] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:07.841495 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b11f00-52d4-4f19-8bfa-030cfd4d189a None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:07.842137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b11f00-52d4-4f19-8bfa-030cfd4d189a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:07.842686 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b11f00-52d4-4f19-8bfa-030cfd4d189a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:07.866277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-40b11f00-52d4-4f19-8bfa-030cfd4d189a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:07.867543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-40b11f00-52d4-4f19-8bfa-030cfd4d189a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:07.876973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1287/2582] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:07.882117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2e517-3c0e-42c7-b29d-337a908c2d3a None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:07.894998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2e517-3c0e-42c7-b29d-337a908c2d3a None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:07.905326 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1c77d-f1a4-409c-94cb-f5a27188e251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:07.906032 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1c77d-f1a4-409c-94cb-f5a27188e251 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:07.906342 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1c77d-f1a4-409c-94cb-f5a27188e251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:07.906662 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1c77d-f1a4-409c-94cb-f5a27188e251 admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:07.907485 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1c77d-f1a4-409c-94cb-f5a27188e251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:37:07.907862 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1c77d-f1a4-409c-94cb-f5a27188e251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:07.909757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1c77d-f1a4-409c-94cb-f5a27188e251 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:07.923374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1296/2583] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:37:07.934147 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b11f00-52d4-4f19-8bfa-030cfd4d189a None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:07.944115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b11f00-52d4-4f19-8bfa-030cfd4d189a None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:07.950504 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c412df-c767-4ca4-9746-8989bb37cfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:07.951168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c412df-c767-4ca4-9746-8989bb37cfe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:07.951446 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c412df-c767-4ca4-9746-8989bb37cfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:07.951716 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c412df-c767-4ca4-9746-8989bb37cfe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:07.952376 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c412df-c767-4ca4-9746-8989bb37cfe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:07.954380 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c412df-c767-4ca4-9746-8989bb37cfe6 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:08.142954 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1288/2584] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:37:07 2022] POST /identity/v3/projects => generated 377 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:37:08.147156 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1c77d-f1a4-409c-94cb-f5a27188e251 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:08.159723 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1c77d-f1a4-409c-94cb-f5a27188e251 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:08.233100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d567e-62c6-4b94-8ddd-e1aaff843fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:08.233748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d567e-62c6-4b94-8ddd-e1aaff843fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:08.234026 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d567e-62c6-4b94-8ddd-e1aaff843fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:08.234294 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d567e-62c6-4b94-8ddd-e1aaff843fe5 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:08.234976 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d567e-62c6-4b94-8ddd-e1aaff843fe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:08.237285 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d567e-62c6-4b94-8ddd-e1aaff843fe5 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:08.422612 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1297/2585] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:37:08 2022] POST /identity/v3/users => generated 289 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:37:08.427138 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c412df-c767-4ca4-9746-8989bb37cfe6 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:08.440583 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c412df-c767-4ca4-9746-8989bb37cfe6 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:08.445429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57651145-3fdd-4345-aebe-1f1f3ee3017c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:08.446060 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57651145-3fdd-4345-aebe-1f1f3ee3017c admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:08.447181 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57651145-3fdd-4345-aebe-1f1f3ee3017c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:08.447301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57651145-3fdd-4345-aebe-1f1f3ee3017c admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:08.447919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57651145-3fdd-4345-aebe-1f1f3ee3017c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:08.449696 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57651145-3fdd-4345-aebe-1f1f3ee3017c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:08.463700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1289/2586] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:37:08.468650 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d567e-62c6-4b94-8ddd-e1aaff843fe5 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:08.482505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d567e-62c6-4b94-8ddd-e1aaff843fe5 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:08.491546 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e71731-526e-4cb1-9a04-a0940c00a1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:08.492447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e71731-526e-4cb1-9a04-a0940c00a1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:08.492751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e71731-526e-4cb1-9a04-a0940c00a1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:08.493001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e71731-526e-4cb1-9a04-a0940c00a1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:08.494230 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e71731-526e-4cb1-9a04-a0940c00a1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:08.495975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e71731-526e-4cb1-9a04-a0940c00a1d1 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:08.515915 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1298/2587] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:37:08.517215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57651145-3fdd-4345-aebe-1f1f3ee3017c admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:08.529814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57651145-3fdd-4345-aebe-1f1f3ee3017c admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:08.534843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1409273-71b5-4ff7-99fb-4704a94b4d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:08.535583 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1409273-71b5-4ff7-99fb-4704a94b4d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:08.535903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1409273-71b5-4ff7-99fb-4704a94b4d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:08.536172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1409273-71b5-4ff7-99fb-4704a94b4d40 admin admin] PATH_INFO: `/v3/projects/9b21e1acd9984b50af0f064bbcd68570/users/6148c2bd7b9d48bdaec4320ec2d15827/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:08.557367 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1409273-71b5-4ff7-99fb-4704a94b4d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b21e1acd9984b50af0f064bbcd68570, user_id=6148c2bd7b9d48bdaec4320ec2d15827, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:08.561290 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1409273-71b5-4ff7-99fb-4704a94b4d40 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:08.853941 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1290/2588] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:37:08 2022] PUT /identity/v3/projects/9b21e1acd9984b50af0f064bbcd68570/users/6148c2bd7b9d48bdaec4320ec2d15827/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:08.870568 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b905a8-dcb5-4afb-a6e0-f96a057fcb7e None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:08.871148 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b905a8-dcb5-4afb-a6e0-f96a057fcb7e None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:08.871258 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b905a8-dcb5-4afb-a6e0-f96a057fcb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:08.907368 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-c0b905a8-dcb5-4afb-a6e0-f96a057fcb7e None None] MFA Rules not processed for user `6148c2bd7b9d48bdaec4320ec2d15827`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:08.908599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-c0b905a8-dcb5-4afb-a6e0-f96a057fcb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:08.960849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:08.981846 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1299/2589] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:08.986903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1409273-71b5-4ff7-99fb-4704a94b4d40 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:09.066088 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1409273-71b5-4ff7-99fb-4704a94b4d40 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:09.073154 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fdde6-ac00-49d2-9c56-a7b9b9f29f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:09.074126 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fdde6-ac00-49d2-9c56-a7b9b9f29f19 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:09.074479 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fdde6-ac00-49d2-9c56-a7b9b9f29f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:09.074910 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fdde6-ac00-49d2-9c56-a7b9b9f29f19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:09.075730 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fdde6-ac00-49d2-9c56-a7b9b9f29f19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:09.078269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fdde6-ac00-49d2-9c56-a7b9b9f29f19 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:09.312244 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1291/2590] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:37:08 2022] POST /identity/v3/projects => generated 379 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:37:09.313998 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b905a8-dcb5-4afb-a6e0-f96a057fcb7e None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:09.326415 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b905a8-dcb5-4afb-a6e0-f96a057fcb7e None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:09.417098 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc3444-14fb-459e-907d-38083b77996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:09.417780 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc3444-14fb-459e-907d-38083b77996c admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:09.418085 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc3444-14fb-459e-907d-38083b77996c admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:09.418366 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc3444-14fb-459e-907d-38083b77996c admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:09.419096 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc3444-14fb-459e-907d-38083b77996c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:09.421279 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc3444-14fb-459e-907d-38083b77996c admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:09.725348 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1300/2591] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:37:09 2022] POST /identity/v3/users => generated 290 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:37:09.732887 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fdde6-ac00-49d2-9c56-a7b9b9f29f19 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:09.754688 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fdde6-ac00-49d2-9c56-a7b9b9f29f19 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:09.778659 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad859acb-862b-4ce0-8af7-01bcac07591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:09.779813 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad859acb-862b-4ce0-8af7-01bcac07591f admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:09.780372 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad859acb-862b-4ce0-8af7-01bcac07591f admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:09.781581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad859acb-862b-4ce0-8af7-01bcac07591f admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:09.782892 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad859acb-862b-4ce0-8af7-01bcac07591f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:09.792595 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad859acb-862b-4ce0-8af7-01bcac07591f admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:09.814938 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1292/2592] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:37:09.818631 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc3444-14fb-459e-907d-38083b77996c admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:09.834697 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc3444-14fb-459e-907d-38083b77996c admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:09.851424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e53b75-00d4-4352-b15f-58990a6c6203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:09.853028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e53b75-00d4-4352-b15f-58990a6c6203 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:09.853544 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e53b75-00d4-4352-b15f-58990a6c6203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:09.855011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e53b75-00d4-4352-b15f-58990a6c6203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:09.856194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e53b75-00d4-4352-b15f-58990a6c6203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:09.860351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e53b75-00d4-4352-b15f-58990a6c6203 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:09.882528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1301/2593] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:37:09.888584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad859acb-862b-4ce0-8af7-01bcac07591f admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:09.917856 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad859acb-862b-4ce0-8af7-01bcac07591f admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:09.935045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886b574-1bb2-4cf1-a5f6-10f50e1428ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:09.936644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886b574-1bb2-4cf1-a5f6-10f50e1428ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:09.937137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886b574-1bb2-4cf1-a5f6-10f50e1428ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:09.937740 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886b574-1bb2-4cf1-a5f6-10f50e1428ff admin admin] PATH_INFO: `/v3/projects/5bc88bc3906e48e695387d5a00b5ebc4/users/e301d95fe0c24a69aa2ab6a0ed3f8720/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:09.982173 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:09.982173 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886b574-1bb2-4cf1-a5f6-10f50e1428ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bc88bc3906e48e695387d5a00b5ebc4, user_id=e301d95fe0c24a69aa2ab6a0ed3f8720, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:09.982173 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886b574-1bb2-4cf1-a5f6-10f50e1428ff admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:10.110494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1293/2594] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:37:09 2022] PUT /identity/v3/projects/5bc88bc3906e48e695387d5a00b5ebc4/users/e301d95fe0c24a69aa2ab6a0ed3f8720/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:10.129115 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f3698-bf99-46f3-b74b-261504331d56 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:10.129635 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f3698-bf99-46f3-b74b-261504331d56 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:10.130125 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f3698-bf99-46f3-b74b-261504331d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:10.163195 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-d23f3698-bf99-46f3-b74b-261504331d56 None None] MFA Rules not processed for user `e301d95fe0c24a69aa2ab6a0ed3f8720`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:10.164675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d23f3698-bf99-46f3-b74b-261504331d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:10.270222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1302/2595] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:10.275908 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886b574-1bb2-4cf1-a5f6-10f50e1428ff admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:10.366461 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886b574-1bb2-4cf1-a5f6-10f50e1428ff admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:10.373061 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fad0e2-de78-4b60-901f-fc45b9f8eb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:10.373844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fad0e2-de78-4b60-901f-fc45b9f8eb74 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:10.374194 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fad0e2-de78-4b60-901f-fc45b9f8eb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:10.374506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fad0e2-de78-4b60-901f-fc45b9f8eb74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:10.375301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fad0e2-de78-4b60-901f-fc45b9f8eb74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:10.377673 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fad0e2-de78-4b60-901f-fc45b9f8eb74 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:10.499660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1294/2596] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:37:10 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:37:10.504297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f3698-bf99-46f3-b74b-261504331d56 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:10.517070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f3698-bf99-46f3-b74b-261504331d56 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:10.602547 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3e53a-ea3c-4406-991d-c6c72c23639c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:10.603276 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3e53a-ea3c-4406-991d-c6c72c23639c admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:10.603561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3e53a-ea3c-4406-991d-c6c72c23639c admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:10.603835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3e53a-ea3c-4406-991d-c6c72c23639c admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:10.604487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3e53a-ea3c-4406-991d-c6c72c23639c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:10.606802 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3e53a-ea3c-4406-991d-c6c72c23639c admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:10.756165 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1303/2597] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:37:10 2022] POST /identity/v3/users => generated 296 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:37:10.762933 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fad0e2-de78-4b60-901f-fc45b9f8eb74 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:10.779568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fad0e2-de78-4b60-901f-fc45b9f8eb74 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:10.783457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:10.789655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca511a8-1e4f-48e8-b438-e8ef1d867824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:10.790880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca511a8-1e4f-48e8-b438-e8ef1d867824 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:10.791713 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca511a8-1e4f-48e8-b438-e8ef1d867824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:10.792194 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca511a8-1e4f-48e8-b438-e8ef1d867824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:10.793194 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca511a8-1e4f-48e8-b438-e8ef1d867824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:10.795458 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca511a8-1e4f-48e8-b438-e8ef1d867824 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:10.818839 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1295/2598] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:37:10.820613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3e53a-ea3c-4406-991d-c6c72c23639c admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:10.836751 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3e53a-ea3c-4406-991d-c6c72c23639c admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:10.845654 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70159ee5-c4f3-4f54-84c9-f48a5e66d0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:10.846471 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70159ee5-c4f3-4f54-84c9-f48a5e66d0f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:10.847161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70159ee5-c4f3-4f54-84c9-f48a5e66d0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:10.847596 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70159ee5-c4f3-4f54-84c9-f48a5e66d0f6 admin admin] PATH_INFO: `/v3/projects/acc890c98c2743658f3c4307da9a5df0/users/3b84f9b22a0a40ba9043346418e89628/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:10.870291 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70159ee5-c4f3-4f54-84c9-f48a5e66d0f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc890c98c2743658f3c4307da9a5df0, user_id=3b84f9b22a0a40ba9043346418e89628, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:10.873607 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70159ee5-c4f3-4f54-84c9-f48a5e66d0f6 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:11.061119 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1304/2599] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:37:10 2022] PUT /identity/v3/projects/acc890c98c2743658f3c4307da9a5df0/users/3b84f9b22a0a40ba9043346418e89628/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:37:11.065423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca511a8-1e4f-48e8-b438-e8ef1d867824 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:11.086733 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca511a8-1e4f-48e8-b438-e8ef1d867824 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:11.182241 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d6c2e-1464-454a-85c7-acb37842e3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:11.183288 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d6c2e-1464-454a-85c7-acb37842e3ce admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:11.184031 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d6c2e-1464-454a-85c7-acb37842e3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:11.184601 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d6c2e-1464-454a-85c7-acb37842e3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:11.185927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d6c2e-1464-454a-85c7-acb37842e3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:11.200324 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d6c2e-1464-454a-85c7-acb37842e3ce admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:11.218632 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1296/2600] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:37:11.220138 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70159ee5-c4f3-4f54-84c9-f48a5e66d0f6 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:11.232017 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70159ee5-c4f3-4f54-84c9-f48a5e66d0f6 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:11.238290 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f32b1-95b6-4274-93cb-e2f31773b4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:11.239222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f32b1-95b6-4274-93cb-e2f31773b4bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:11.239222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f32b1-95b6-4274-93cb-e2f31773b4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:11.239222 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f32b1-95b6-4274-93cb-e2f31773b4bf admin admin] PATH_INFO: `/v3/projects/acc890c98c2743658f3c4307da9a5df0/users/3b84f9b22a0a40ba9043346418e89628/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:11.241428 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f32b1-95b6-4274-93cb-e2f31773b4bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc890c98c2743658f3c4307da9a5df0, user_id=3b84f9b22a0a40ba9043346418e89628, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:11.244251 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f32b1-95b6-4274-93cb-e2f31773b4bf admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:11.264083 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1305/2601] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:37:11 2022] PUT /identity/v3/projects/acc890c98c2743658f3c4307da9a5df0/users/3b84f9b22a0a40ba9043346418e89628/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:11.278630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139317c-4d86-4fc0-b45b-ff0804c13703 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:11.278953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139317c-4d86-4fc0-b45b-ff0804c13703 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:11.279251 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139317c-4d86-4fc0-b45b-ff0804c13703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:11.315185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-9139317c-4d86-4fc0-b45b-ff0804c13703 None None] MFA Rules not processed for user `3b84f9b22a0a40ba9043346418e89628`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:11.316411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-9139317c-4d86-4fc0-b45b-ff0804c13703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:11.417909 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1297/2602] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:11.435894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f32b1-95b6-4274-93cb-e2f31773b4bf admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:11.438915 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-4c0f32b1-95b6-4274-93cb-e2f31773b4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:11.512970 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f32b1-95b6-4274-93cb-e2f31773b4bf admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:11.517309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9c532-7cdf-4bf3-8b8a-e96801e8151c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:11.517918 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9c532-7cdf-4bf3-8b8a-e96801e8151c service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:11.518195 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9c532-7cdf-4bf3-8b8a-e96801e8151c service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:11.518464 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9c532-7cdf-4bf3-8b8a-e96801e8151c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:11.531416 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9c532-7cdf-4bf3-8b8a-e96801e8151c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:11.532862 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9c532-7cdf-4bf3-8b8a-e96801e8151c service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:11.544452 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1306/2603] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:37:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:37:11.641500 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139317c-4d86-4fc0-b45b-ff0804c13703 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:11.642284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-9139317c-4d86-4fc0-b45b-ff0804c13703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:11.654081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139317c-4d86-4fc0-b45b-ff0804c13703 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:11.657630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629e579-2bfb-4fe5-9f32-70a2ff520a1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:11.658239 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629e579-2bfb-4fe5-9f32-70a2ff520a1b service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:11.658513 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629e579-2bfb-4fe5-9f32-70a2ff520a1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:11.658815 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629e579-2bfb-4fe5-9f32-70a2ff520a1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:11.666022 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:11.720794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629e579-2bfb-4fe5-9f32-70a2ff520a1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:11.722222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629e579-2bfb-4fe5-9f32-70a2ff520a1b service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:11.732444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1298/2604] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:37:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:37:16.376560 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9c532-7cdf-4bf3-8b8a-e96801e8151c service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:16.457543 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9c532-7cdf-4bf3-8b8a-e96801e8151c service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:16.465226 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee6766-9fdc-4f56-985a-5a82e8d1a2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:16.465881 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee6766-9fdc-4f56-985a-5a82e8d1a2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:16.466256 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee6766-9fdc-4f56-985a-5a82e8d1a2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:16.466706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee6766-9fdc-4f56-985a-5a82e8d1a2d5 admin admin] PATH_INFO: `/v3/users/6148c2bd7b9d48bdaec4320ec2d15827` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:16.468143 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee6766-9fdc-4f56-985a-5a82e8d1a2d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6148c2bd7b9d48bdaec4320ec2d15827)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:16.470445 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee6766-9fdc-4f56-985a-5a82e8d1a2d5 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:16.765984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1bee6766-9fdc-4f56-985a-5a82e8d1a2d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6148c2bd7b9d48bdaec4320ec2d15827'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:16.885825 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1bee6766-9fdc-4f56-985a-5a82e8d1a2d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6148c2bd7b9d48bdaec4320ec2d15827'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:16.886992 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1bee6766-9fdc-4f56-985a-5a82e8d1a2d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6148c2bd7b9d48bdaec4320ec2d15827'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:16.889637 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:INSERT=6,keystone:SELECT=86,keystone:DELETE=8 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:16.897659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1bee6766-9fdc-4f56-985a-5a82e8d1a2d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6148c2bd7b9d48bdaec4320ec2d15827'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:16.900012 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1bee6766-9fdc-4f56-985a-5a82e8d1a2d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6148c2bd7b9d48bdaec4320ec2d15827'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:16.922802 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1307/2605] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:37:16 2022] DELETE /identity/v3/users/6148c2bd7b9d48bdaec4320ec2d15827 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:16.928459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b17547-e3b2-4915-a16b-b4c6ceb99102 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:16.928459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b17547-e3b2-4915-a16b-b4c6ceb99102 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:16.928459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b17547-e3b2-4915-a16b-b4c6ceb99102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:16.954037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-50b17547-e3b2-4915-a16b-b4c6ceb99102 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:16.955254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-50b17547-e3b2-4915-a16b-b4c6ceb99102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:17.061578 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1299/2606] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:17.069738 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee6766-9fdc-4f56-985a-5a82e8d1a2d5 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:17.071301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-1bee6766-9fdc-4f56-985a-5a82e8d1a2d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:17.154824 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee6766-9fdc-4f56-985a-5a82e8d1a2d5 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:17.159659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265ae6e-f6c7-4134-86be-9ed68995fa76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:17.160301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265ae6e-f6c7-4134-86be-9ed68995fa76 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:17.160584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265ae6e-f6c7-4134-86be-9ed68995fa76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:17.160860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265ae6e-f6c7-4134-86be-9ed68995fa76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:17.172293 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265ae6e-f6c7-4134-86be-9ed68995fa76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:17.173839 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265ae6e-f6c7-4134-86be-9ed68995fa76 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:17.187012 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1308/2607] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:37:17.856034 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b17547-e3b2-4915-a16b-b4c6ceb99102 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:17.873186 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b17547-e3b2-4915-a16b-b4c6ceb99102 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:17.877445 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed73ad-c168-4a76-9d9a-5e75bd10b57f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:17.878213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed73ad-c168-4a76-9d9a-5e75bd10b57f service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:17.878491 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed73ad-c168-4a76-9d9a-5e75bd10b57f service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:17.878801 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed73ad-c168-4a76-9d9a-5e75bd10b57f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:17.880892 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4eed73ad-c168-4a76-9d9a-5e75bd10b57f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:17.896149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed73ad-c168-4a76-9d9a-5e75bd10b57f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:17.897687 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed73ad-c168-4a76-9d9a-5e75bd10b57f service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:17.910545 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1300/2608] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:37:18.051919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265ae6e-f6c7-4134-86be-9ed68995fa76 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:18.054691 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d265ae6e-f6c7-4134-86be-9ed68995fa76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:18.081617 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265ae6e-f6c7-4134-86be-9ed68995fa76 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:18.091354 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59500b6-77c8-4863-a072-408c1ba0208c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:18.092418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59500b6-77c8-4863-a072-408c1ba0208c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:18.093019 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59500b6-77c8-4863-a072-408c1ba0208c admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:18.093452 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59500b6-77c8-4863-a072-408c1ba0208c admin admin] PATH_INFO: `/v3/projects/9b21e1acd9984b50af0f064bbcd68570` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:18.096057 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59500b6-77c8-4863-a072-408c1ba0208c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b21e1acd9984b50af0f064bbcd68570)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:18.099955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59500b6-77c8-4863-a072-408c1ba0208c admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:18.248395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-a59500b6-77c8-4863-a072-408c1ba0208c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b21e1acd9984b50af0f064bbcd68570', 'request_id': 'req-a59500b6-77c8-4863-a072-408c1ba0208c'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:18.365343 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-a59500b6-77c8-4863-a072-408c1ba0208c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b21e1acd9984b50af0f064bbcd68570', 'request_id': 'req-a59500b6-77c8-4863-a072-408c1ba0208c'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:18.375267 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-a59500b6-77c8-4863-a072-408c1ba0208c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b21e1acd9984b50af0f064bbcd68570', 'request_id': 'req-a59500b6-77c8-4863-a072-408c1ba0208c'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:18.392029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-a59500b6-77c8-4863-a072-408c1ba0208c admin admin] The token cache is being invalidate because project 9b21e1acd9984b50af0f064bbcd68570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:37:18.392299 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-a59500b6-77c8-4863-a072-408c1ba0208c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:18.392990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-a59500b6-77c8-4863-a072-408c1ba0208c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:18.394536 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1309/2609] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:37:18 2022] DELETE /identity/v3/projects/9b21e1acd9984b50af0f064bbcd68570 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:18.399208 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed73ad-c168-4a76-9d9a-5e75bd10b57f service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:18.420417 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed73ad-c168-4a76-9d9a-5e75bd10b57f service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:18.515070 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da98e0d-cab8-4a49-b263-1d2f9a9363e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:18.516074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da98e0d-cab8-4a49-b263-1d2f9a9363e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:18.516592 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da98e0d-cab8-4a49-b263-1d2f9a9363e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:18.517019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da98e0d-cab8-4a49-b263-1d2f9a9363e0 admin admin] PATH_INFO: `/v3/users/e301d95fe0c24a69aa2ab6a0ed3f8720` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:18.518971 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da98e0d-cab8-4a49-b263-1d2f9a9363e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e301d95fe0c24a69aa2ab6a0ed3f8720)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:18.522290 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da98e0d-cab8-4a49-b263-1d2f9a9363e0 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:18.545330 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:18.812876 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0da98e0d-cab8-4a49-b263-1d2f9a9363e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e301d95fe0c24a69aa2ab6a0ed3f8720'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:18.837126 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0da98e0d-cab8-4a49-b263-1d2f9a9363e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e301d95fe0c24a69aa2ab6a0ed3f8720'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:19.035558 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0da98e0d-cab8-4a49-b263-1d2f9a9363e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e301d95fe0c24a69aa2ab6a0ed3f8720'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:19.036327 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0da98e0d-cab8-4a49-b263-1d2f9a9363e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e301d95fe0c24a69aa2ab6a0ed3f8720'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:19.045861 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0da98e0d-cab8-4a49-b263-1d2f9a9363e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e301d95fe0c24a69aa2ab6a0ed3f8720'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:19.054294 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1301/2610] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:37:18 2022] DELETE /identity/v3/users/e301d95fe0c24a69aa2ab6a0ed3f8720 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:37:20.052480 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59500b6-77c8-4863-a072-408c1ba0208c admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:20.054841 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a59500b6-77c8-4863-a072-408c1ba0208c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:20.075761 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59500b6-77c8-4863-a072-408c1ba0208c admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:20.215803 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a4ca2-c991-4e84-a76c-4afd82687a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:20.216833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a4ca2-c991-4e84-a76c-4afd82687a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:20.217387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a4ca2-c991-4e84-a76c-4afd82687a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:20.217862 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a4ca2-c991-4e84-a76c-4afd82687a5e admin admin] PATH_INFO: `/v3/projects/5bc88bc3906e48e695387d5a00b5ebc4` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:20.220129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a4ca2-c991-4e84-a76c-4afd82687a5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bc88bc3906e48e695387d5a00b5ebc4)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:20.223378 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a4ca2-c991-4e84-a76c-4afd82687a5e admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:20.224885 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:20.363187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d10a4ca2-c991-4e84-a76c-4afd82687a5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bc88bc3906e48e695387d5a00b5ebc4', 'request_id': 'req-d10a4ca2-c991-4e84-a76c-4afd82687a5e'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:20.555763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d10a4ca2-c991-4e84-a76c-4afd82687a5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bc88bc3906e48e695387d5a00b5ebc4', 'request_id': 'req-d10a4ca2-c991-4e84-a76c-4afd82687a5e'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:20.563766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d10a4ca2-c991-4e84-a76c-4afd82687a5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bc88bc3906e48e695387d5a00b5ebc4', 'request_id': 'req-d10a4ca2-c991-4e84-a76c-4afd82687a5e'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:20.580339 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d10a4ca2-c991-4e84-a76c-4afd82687a5e admin admin] The token cache is being invalidate because project 5bc88bc3906e48e695387d5a00b5ebc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:37:20.580680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d10a4ca2-c991-4e84-a76c-4afd82687a5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:20.581314 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d10a4ca2-c991-4e84-a76c-4afd82687a5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:20.582962 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1310/2611] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:37:20 2022] DELETE /identity/v3/projects/5bc88bc3906e48e695387d5a00b5ebc4 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:37:20.587033 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da98e0d-cab8-4a49-b263-1d2f9a9363e0 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:20.589251 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-0da98e0d-cab8-4a49-b263-1d2f9a9363e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:20.602196 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da98e0d-cab8-4a49-b263-1d2f9a9363e0 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:20.716425 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836b73c-5db7-47ce-9a7b-7507b6fa19c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:20.718387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836b73c-5db7-47ce-9a7b-7507b6fa19c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:20.718848 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836b73c-5db7-47ce-9a7b-7507b6fa19c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:20.719517 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836b73c-5db7-47ce-9a7b-7507b6fa19c8 admin admin] PATH_INFO: `/v3/users/3b84f9b22a0a40ba9043346418e89628` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:20.723719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836b73c-5db7-47ce-9a7b-7507b6fa19c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b84f9b22a0a40ba9043346418e89628)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:20.726731 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836b73c-5db7-47ce-9a7b-7507b6fa19c8 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:21.104354 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0836b73c-5db7-47ce-9a7b-7507b6fa19c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b84f9b22a0a40ba9043346418e89628'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:21.121360 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0836b73c-5db7-47ce-9a7b-7507b6fa19c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b84f9b22a0a40ba9043346418e89628'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:21.265239 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0836b73c-5db7-47ce-9a7b-7507b6fa19c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b84f9b22a0a40ba9043346418e89628'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:21.266417 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0836b73c-5db7-47ce-9a7b-7507b6fa19c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b84f9b22a0a40ba9043346418e89628'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:21.282341 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0836b73c-5db7-47ce-9a7b-7507b6fa19c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b84f9b22a0a40ba9043346418e89628'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:21.290978 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1302/2612] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:37:20 2022] DELETE /identity/v3/users/3b84f9b22a0a40ba9043346418e89628 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:22.204671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a4ca2-c991-4e84-a76c-4afd82687a5e admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:22.206715 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d10a4ca2-c991-4e84-a76c-4afd82687a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:22.230823 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a4ca2-c991-4e84-a76c-4afd82687a5e admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:22.380163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f383d13-d9b3-45f3-9495-9324f7e41911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:22.382299 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f383d13-d9b3-45f3-9495-9324f7e41911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:22.383227 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f383d13-d9b3-45f3-9495-9324f7e41911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:22.384015 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f383d13-d9b3-45f3-9495-9324f7e41911 admin admin] PATH_INFO: `/v3/projects/acc890c98c2743658f3c4307da9a5df0` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:22.388756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f383d13-d9b3-45f3-9495-9324f7e41911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acc890c98c2743658f3c4307da9a5df0)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:22.395465 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f383d13-d9b3-45f3-9495-9324f7e41911 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:22.625625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2f383d13-d9b3-45f3-9495-9324f7e41911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acc890c98c2743658f3c4307da9a5df0', 'request_id': 'req-2f383d13-d9b3-45f3-9495-9324f7e41911'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:22.739805 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2f383d13-d9b3-45f3-9495-9324f7e41911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acc890c98c2743658f3c4307da9a5df0', 'request_id': 'req-2f383d13-d9b3-45f3-9495-9324f7e41911'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:22.749632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2f383d13-d9b3-45f3-9495-9324f7e41911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acc890c98c2743658f3c4307da9a5df0', 'request_id': 'req-2f383d13-d9b3-45f3-9495-9324f7e41911'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:22.768168 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2f383d13-d9b3-45f3-9495-9324f7e41911 admin admin] The token cache is being invalidate because project acc890c98c2743658f3c4307da9a5df0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:37:22.768624 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2f383d13-d9b3-45f3-9495-9324f7e41911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:22.769512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-2f383d13-d9b3-45f3-9495-9324f7e41911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:22.771479 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1311/2613] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:37:22 2022] DELETE /identity/v3/projects/acc890c98c2743658f3c4307da9a5df0 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:22.780805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a00260-8bf7-46e7-974d-d4332374a22a None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:22.781390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a00260-8bf7-46e7-974d-d4332374a22a None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:22.781658 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a00260-8bf7-46e7-974d-d4332374a22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:22.810109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-64a00260-8bf7-46e7-974d-d4332374a22a None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:22.811817 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-64a00260-8bf7-46e7-974d-d4332374a22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:22.816201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:22.912308 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1303/2614] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:22.920970 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f35b5b-1036-4b7e-ae66-4e01aa8f428d None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:22.922986 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f35b5b-1036-4b7e-ae66-4e01aa8f428d None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:22.923773 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f35b5b-1036-4b7e-ae66-4e01aa8f428d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:22.953806 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-d0f35b5b-1036-4b7e-ae66-4e01aa8f428d None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:22.958040 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d0f35b5b-1036-4b7e-ae66-4e01aa8f428d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:22.968512 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1312/2615] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:37:22.972677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a00260-8bf7-46e7-974d-d4332374a22a None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:22.988470 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a00260-8bf7-46e7-974d-d4332374a22a None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:22.997462 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb5aa5-610e-48d2-bf38-1112ad5499c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:22.997462 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb5aa5-610e-48d2-bf38-1112ad5499c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:22.997462 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb5aa5-610e-48d2-bf38-1112ad5499c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:22.997462 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb5aa5-610e-48d2-bf38-1112ad5499c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:22.997967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb5aa5-610e-48d2-bf38-1112ad5499c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:37:22.997967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb5aa5-610e-48d2-bf38-1112ad5499c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:22.998872 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb5aa5-610e-48d2-bf38-1112ad5499c8 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:23.014567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1304/2616] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:37:23.018505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f35b5b-1036-4b7e-ae66-4e01aa8f428d None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:23.030085 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f35b5b-1036-4b7e-ae66-4e01aa8f428d None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:23.037214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbf9a5-1f7a-4b22-9118-c66e1b3175a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:23.037877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbf9a5-1f7a-4b22-9118-c66e1b3175a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:23.038206 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbf9a5-1f7a-4b22-9118-c66e1b3175a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:23.038547 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbf9a5-1f7a-4b22-9118-c66e1b3175a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:23.039441 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbf9a5-1f7a-4b22-9118-c66e1b3175a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:23.042146 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbf9a5-1f7a-4b22-9118-c66e1b3175a5 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:23.063659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:23.162863 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1313/2617] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:37:23 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:37:23.168182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb5aa5-610e-48d2-bf38-1112ad5499c8 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:23.183669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb5aa5-610e-48d2-bf38-1112ad5499c8 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:23.256509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbf9a5-1f7a-4b22-9118-c66e1b3175a5 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:23.258095 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa890cd-d45a-4651-83bb-3b4c2f8815a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:23.258923 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa890cd-d45a-4651-83bb-3b4c2f8815a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:23.259341 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa890cd-d45a-4651-83bb-3b4c2f8815a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:23.259955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa890cd-d45a-4651-83bb-3b4c2f8815a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:23.260775 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa890cd-d45a-4651-83bb-3b4c2f8815a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:23.261701 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-8fbbf9a5-1f7a-4b22-9118-c66e1b3175a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:23.263416 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa890cd-d45a-4651-83bb-3b4c2f8815a3 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:23.287582 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbf9a5-1f7a-4b22-9118-c66e1b3175a5 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:23.299128 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2d223-7e7c-4e6a-b7db-a3de1fcd5676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:23.300202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2d223-7e7c-4e6a-b7db-a3de1fcd5676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:23.300686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2d223-7e7c-4e6a-b7db-a3de1fcd5676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:23.301161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2d223-7e7c-4e6a-b7db-a3de1fcd5676 admin admin] PATH_INFO: `/v3/users/67b89827871f45738162611b31a23509` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:23.303550 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2d223-7e7c-4e6a-b7db-a3de1fcd5676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67b89827871f45738162611b31a23509)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:23.307468 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2d223-7e7c-4e6a-b7db-a3de1fcd5676 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:23.459355 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1305/2618] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:37:23 2022] POST /identity/v3/users => generated 286 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:37:23.465546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa890cd-d45a-4651-83bb-3b4c2f8815a3 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:23.479190 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa890cd-d45a-4651-83bb-3b4c2f8815a3 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:23.484072 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d67278-a5bb-41e7-a2ea-408b11d19d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:23.484684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d67278-a5bb-41e7-a2ea-408b11d19d80 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:23.485004 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d67278-a5bb-41e7-a2ea-408b11d19d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:23.490881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d67278-a5bb-41e7-a2ea-408b11d19d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:23.490881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d67278-a5bb-41e7-a2ea-408b11d19d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:23.490881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d67278-a5bb-41e7-a2ea-408b11d19d80 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:23.503688 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1306/2619] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:37:23.512613 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d67278-a5bb-41e7-a2ea-408b11d19d80 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:23.523532 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d67278-a5bb-41e7-a2ea-408b11d19d80 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:23.529455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4f15f-d29d-4757-8aaa-c0524f055332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:23.530091 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4f15f-d29d-4757-8aaa-c0524f055332 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:23.530375 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4f15f-d29d-4757-8aaa-c0524f055332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:23.530681 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4f15f-d29d-4757-8aaa-c0524f055332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:23.531973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4f15f-d29d-4757-8aaa-c0524f055332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:23.532983 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4f15f-d29d-4757-8aaa-c0524f055332 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:23.550215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1307/2620] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:37:23.551940 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4f15f-d29d-4757-8aaa-c0524f055332 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:23.562407 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4f15f-d29d-4757-8aaa-c0524f055332 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:23.567494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87966e29-3044-4064-b1e3-07cbe3e63c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:23.568395 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87966e29-3044-4064-b1e3-07cbe3e63c00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:23.568672 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87966e29-3044-4064-b1e3-07cbe3e63c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:23.569028 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87966e29-3044-4064-b1e3-07cbe3e63c00 admin admin] PATH_INFO: `/v3/projects/48e010ac15f7448383e87c8a6a76499b/users/859c4608a38343889e41d07628ee98f7/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:23.588682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87966e29-3044-4064-b1e3-07cbe3e63c00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e010ac15f7448383e87c8a6a76499b, user_id=859c4608a38343889e41d07628ee98f7, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:23.591974 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87966e29-3044-4064-b1e3-07cbe3e63c00 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:23.621410 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-22e2d223-7e7c-4e6a-b7db-a3de1fcd5676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67b89827871f45738162611b31a23509'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:23.743160 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1308/2621] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:37:23 2022] PUT /identity/v3/projects/48e010ac15f7448383e87c8a6a76499b/users/859c4608a38343889e41d07628ee98f7/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:37:23.768564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db8d50-6a52-4a45-b604-b49c80821d79 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:23.769016 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db8d50-6a52-4a45-b604-b49c80821d79 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:23.769339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db8d50-6a52-4a45-b604-b49c80821d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:23.779733 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-22e2d223-7e7c-4e6a-b7db-a3de1fcd5676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67b89827871f45738162611b31a23509'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:23.780980 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-22e2d223-7e7c-4e6a-b7db-a3de1fcd5676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67b89827871f45738162611b31a23509'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:23.800172 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-22e2d223-7e7c-4e6a-b7db-a3de1fcd5676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67b89827871f45738162611b31a23509'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:23.801170 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-22e2d223-7e7c-4e6a-b7db-a3de1fcd5676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67b89827871f45738162611b31a23509'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:23.806895 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-67db8d50-6a52-4a45-b604-b49c80821d79 None None] MFA Rules not processed for user `859c4608a38343889e41d07628ee98f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:23.808277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-67db8d50-6a52-4a45-b604-b49c80821d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:23.826938 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1314/2622] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:37:23 2022] DELETE /identity/v3/users/67b89827871f45738162611b31a23509 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:23.853595 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:23.905100 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1309/2623] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:37:23.922700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2d223-7e7c-4e6a-b7db-a3de1fcd5676 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:23.924357 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-22e2d223-7e7c-4e6a-b7db-a3de1fcd5676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:24.032727 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2d223-7e7c-4e6a-b7db-a3de1fcd5676 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:24.039653 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4db921-c08e-45f7-88a9-dffe435207a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:24.040891 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4db921-c08e-45f7-88a9-dffe435207a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:24.041388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4db921-c08e-45f7-88a9-dffe435207a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:24.041845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4db921-c08e-45f7-88a9-dffe435207a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:24.127147 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4db921-c08e-45f7-88a9-dffe435207a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:24.128681 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4db921-c08e-45f7-88a9-dffe435207a0 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:24.139781 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1315/2624] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:37:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:37:24.173963 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db8d50-6a52-4a45-b604-b49c80821d79 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:24.175368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-67db8d50-6a52-4a45-b604-b49c80821d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:24.232810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4db921-c08e-45f7-88a9-dffe435207a0 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:24.235693 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-7f4db921-c08e-45f7-88a9-dffe435207a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:24.287492 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:24.294179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db8d50-6a52-4a45-b604-b49c80821d79 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:24.370881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6eee6-2383-4467-8157-cb7e5c65b34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:24.371587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6eee6-2383-4467-8157-cb7e5c65b34d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:24.371863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6eee6-2383-4467-8157-cb7e5c65b34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:24.372222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6eee6-2383-4467-8157-cb7e5c65b34d admin admin] PATH_INFO: `/v3/users/859c4608a38343889e41d07628ee98f7` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:24.373710 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6eee6-2383-4467-8157-cb7e5c65b34d admin admin] RBAC: Authorizing `identity:delete_user(user_id=859c4608a38343889e41d07628ee98f7)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:24.377489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6eee6-2383-4467-8157-cb7e5c65b34d admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:24.380983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4db921-c08e-45f7-88a9-dffe435207a0 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:24.389101 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364d772-396b-436d-8754-8359d68edf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:24.389772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364d772-396b-436d-8754-8359d68edf77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:24.390115 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364d772-396b-436d-8754-8359d68edf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:24.390331 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364d772-396b-436d-8754-8359d68edf77 admin admin] PATH_INFO: `/v3/projects/ec922942147b4c0bb122eb30c6cd1bc7` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:24.391927 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364d772-396b-436d-8754-8359d68edf77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec922942147b4c0bb122eb30c6cd1bc7)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:24.395395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364d772-396b-436d-8754-8359d68edf77 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:24.956072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7364d772-396b-436d-8754-8359d68edf77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec922942147b4c0bb122eb30c6cd1bc7', 'request_id': 'req-7364d772-396b-436d-8754-8359d68edf77'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:24.959196 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-74d6eee6-2383-4467-8157-cb7e5c65b34d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '859c4608a38343889e41d07628ee98f7'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:24.983042 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-74d6eee6-2383-4467-8157-cb7e5c65b34d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '859c4608a38343889e41d07628ee98f7'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:25.099932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7364d772-396b-436d-8754-8359d68edf77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec922942147b4c0bb122eb30c6cd1bc7', 'request_id': 'req-7364d772-396b-436d-8754-8359d68edf77'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:25.108123 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7364d772-396b-436d-8754-8359d68edf77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec922942147b4c0bb122eb30c6cd1bc7', 'request_id': 'req-7364d772-396b-436d-8754-8359d68edf77'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:25.128238 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7364d772-396b-436d-8754-8359d68edf77 admin admin] The token cache is being invalidate because project ec922942147b4c0bb122eb30c6cd1bc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:37:25.128789 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7364d772-396b-436d-8754-8359d68edf77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:25.129691 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7364d772-396b-436d-8754-8359d68edf77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:25.132269 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1316/2625] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:37:24 2022] DELETE /identity/v3/projects/ec922942147b4c0bb122eb30c6cd1bc7 => generated 0 bytes in 900 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:37:25.144373 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f2045-9eb6-46aa-9685-6d4ccb314bbe None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:25.144373 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f2045-9eb6-46aa-9685-6d4ccb314bbe None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:25.144373 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f2045-9eb6-46aa-9685-6d4ccb314bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:25.165944 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-f17f2045-9eb6-46aa-9685-6d4ccb314bbe None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:25.167213 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f17f2045-9eb6-46aa-9685-6d4ccb314bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:25.178403 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-74d6eee6-2383-4467-8157-cb7e5c65b34d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '859c4608a38343889e41d07628ee98f7'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:25.181788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-74d6eee6-2383-4467-8157-cb7e5c65b34d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '859c4608a38343889e41d07628ee98f7'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:25.188385 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:25.190655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-74d6eee6-2383-4467-8157-cb7e5c65b34d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '859c4608a38343889e41d07628ee98f7'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:25.199057 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1310/2626] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:37:24 2022] DELETE /identity/v3/users/859c4608a38343889e41d07628ee98f7 => generated 0 bytes in 1025 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:37:25.207368 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19f66b-6017-48ed-94a1-08b4588732a4 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:25.208336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19f66b-6017-48ed-94a1-08b4588732a4 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:25.209168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19f66b-6017-48ed-94a1-08b4588732a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:25.251630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-fa19f66b-6017-48ed-94a1-08b4588732a4 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:25.252961 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-fa19f66b-6017-48ed-94a1-08b4588732a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:25.255080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1317/2627] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:25.264900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f6545-f9f4-4821-9bf2-2666c6a1c4e6 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:25.265313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f6545-f9f4-4821-9bf2-2666c6a1c4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:25.265761 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f6545-f9f4-4821-9bf2-2666c6a1c4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:25.287170 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-f24f6545-f9f4-4821-9bf2-2666c6a1c4e6 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:25.288411 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f24f6545-f9f4-4821-9bf2-2666c6a1c4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:25.359310 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1311/2628] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:37:25.368022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:25.375834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19f66b-6017-48ed-94a1-08b4588732a4 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:25.379179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-fa19f66b-6017-48ed-94a1-08b4588732a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:25.383959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1318/2629] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:37:25.389835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f6545-f9f4-4821-9bf2-2666c6a1c4e6 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:25.407637 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f6545-f9f4-4821-9bf2-2666c6a1c4e6 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:25.417176 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f5bbb-9a20-4cbc-afc7-4289f4d84b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:25.419278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f5bbb-9a20-4cbc-afc7-4289f4d84b09 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:25.419759 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f5bbb-9a20-4cbc-afc7-4289f4d84b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:25.420136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f5bbb-9a20-4cbc-afc7-4289f4d84b09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:25.421403 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f5bbb-9a20-4cbc-afc7-4289f4d84b09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:37:25.421833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f5bbb-9a20-4cbc-afc7-4289f4d84b09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:25.424867 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f5bbb-9a20-4cbc-afc7-4289f4d84b09 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:25.440237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1319/2630] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:37:25.447994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f5bbb-9a20-4cbc-afc7-4289f4d84b09 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:25.463376 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f5bbb-9a20-4cbc-afc7-4289f4d84b09 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:25.466580 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02536c57-4235-4487-a19a-2a7574f05837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:25.468667 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02536c57-4235-4487-a19a-2a7574f05837 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:25.469071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02536c57-4235-4487-a19a-2a7574f05837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:25.469667 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02536c57-4235-4487-a19a-2a7574f05837 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:25.470560 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02536c57-4235-4487-a19a-2a7574f05837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:25.472902 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02536c57-4235-4487-a19a-2a7574f05837 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:25.498353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19f66b-6017-48ed-94a1-08b4588732a4 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:25.502880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e830921-5950-473b-ad4c-c252904011f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:25.503749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e830921-5950-473b-ad4c-c252904011f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:25.504069 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e830921-5950-473b-ad4c-c252904011f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:25.504396 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e830921-5950-473b-ad4c-c252904011f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:25.515355 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e830921-5950-473b-ad4c-c252904011f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:25.516870 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e830921-5950-473b-ad4c-c252904011f2 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:25.529695 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1312/2631] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:37:25.600707 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1320/2632] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:37:25 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:37:25.603073 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e830921-5950-473b-ad4c-c252904011f2 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:25.622028 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e830921-5950-473b-ad4c-c252904011f2 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:25.698918 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef2bc3-2587-430e-b416-f17f47ea11f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:25.699544 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef2bc3-2587-430e-b416-f17f47ea11f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:25.699839 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef2bc3-2587-430e-b416-f17f47ea11f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:25.700089 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef2bc3-2587-430e-b416-f17f47ea11f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:25.700725 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef2bc3-2587-430e-b416-f17f47ea11f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:25.702721 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef2bc3-2587-430e-b416-f17f47ea11f7 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:25.852858 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1313/2633] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:37:25 2022] POST /identity/v3/users => generated 287 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:37:25.855068 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02536c57-4235-4487-a19a-2a7574f05837 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:25.872680 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02536c57-4235-4487-a19a-2a7574f05837 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:25.878706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf061b1f-6043-43f3-b422-a86e60fb4ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:25.879561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf061b1f-6043-43f3-b422-a86e60fb4ccb admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:25.880003 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf061b1f-6043-43f3-b422-a86e60fb4ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:25.880443 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf061b1f-6043-43f3-b422-a86e60fb4ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:25.881170 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf061b1f-6043-43f3-b422-a86e60fb4ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:25.883183 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf061b1f-6043-43f3-b422-a86e60fb4ccb admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:25.895315 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1321/2634] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:37:25.900810 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef2bc3-2587-430e-b416-f17f47ea11f7 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:25.915676 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef2bc3-2587-430e-b416-f17f47ea11f7 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:25.921539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15388fed-4106-4fb7-91b3-7932fd012f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:25.922408 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15388fed-4106-4fb7-91b3-7932fd012f3f admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:25.922854 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15388fed-4106-4fb7-91b3-7932fd012f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:25.923157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15388fed-4106-4fb7-91b3-7932fd012f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:25.923932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15388fed-4106-4fb7-91b3-7932fd012f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:25.926666 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15388fed-4106-4fb7-91b3-7932fd012f3f admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:25.947013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1314/2635] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:37:25.954200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf061b1f-6043-43f3-b422-a86e60fb4ccb admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:25.965380 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf061b1f-6043-43f3-b422-a86e60fb4ccb admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:25.975097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ff9a6-7a8f-4269-80f1-09d6a2f08476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:25.975097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ff9a6-7a8f-4269-80f1-09d6a2f08476 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:25.975097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ff9a6-7a8f-4269-80f1-09d6a2f08476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:25.975097 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ff9a6-7a8f-4269-80f1-09d6a2f08476 admin admin] PATH_INFO: `/v3/projects/aee4a5fff91e4277ae584015bb4bedbe/users/d5a3b3053d0748e79021d8b1ef6e8ab7/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:25.992200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ff9a6-7a8f-4269-80f1-09d6a2f08476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee4a5fff91e4277ae584015bb4bedbe, user_id=d5a3b3053d0748e79021d8b1ef6e8ab7, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:25.995737 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ff9a6-7a8f-4269-80f1-09d6a2f08476 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:26.091977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15388fed-4106-4fb7-91b3-7932fd012f3f admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:26.094935 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-15388fed-4106-4fb7-91b3-7932fd012f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:26.116130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15388fed-4106-4fb7-91b3-7932fd012f3f admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:26.135199 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1322/2636] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:37:25 2022] PUT /identity/v3/projects/aee4a5fff91e4277ae584015bb4bedbe/users/d5a3b3053d0748e79021d8b1ef6e8ab7/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:37:26.145847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d02fe-faf4-42b8-9017-67bcddbe620d None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:26.146136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d02fe-faf4-42b8-9017-67bcddbe620d None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:26.146424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d02fe-faf4-42b8-9017-67bcddbe620d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:26.146855 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:26.183419 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-d85d02fe-faf4-42b8-9017-67bcddbe620d None None] MFA Rules not processed for user `d5a3b3053d0748e79021d8b1ef6e8ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:26.185129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d85d02fe-faf4-42b8-9017-67bcddbe620d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:26.223677 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adb075-3355-4dbd-a14d-32e473c62949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:26.224949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adb075-3355-4dbd-a14d-32e473c62949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:26.225465 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adb075-3355-4dbd-a14d-32e473c62949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:26.225964 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adb075-3355-4dbd-a14d-32e473c62949 admin admin] PATH_INFO: `/v3/projects/48e010ac15f7448383e87c8a6a76499b` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:26.229104 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adb075-3355-4dbd-a14d-32e473c62949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e010ac15f7448383e87c8a6a76499b)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:26.233526 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adb075-3355-4dbd-a14d-32e473c62949 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:26.316923 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1323/2637] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:37:26.330802 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d02fe-faf4-42b8-9017-67bcddbe620d None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:26.332764 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d85d02fe-faf4-42b8-9017-67bcddbe620d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:26.424303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c4adb075-3355-4dbd-a14d-32e473c62949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e010ac15f7448383e87c8a6a76499b', 'request_id': 'req-c4adb075-3355-4dbd-a14d-32e473c62949'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:26.463839 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d02fe-faf4-42b8-9017-67bcddbe620d None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:26.468596 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:26.548984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c4adb075-3355-4dbd-a14d-32e473c62949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e010ac15f7448383e87c8a6a76499b', 'request_id': 'req-c4adb075-3355-4dbd-a14d-32e473c62949'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:26.558391 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c4adb075-3355-4dbd-a14d-32e473c62949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e010ac15f7448383e87c8a6a76499b', 'request_id': 'req-c4adb075-3355-4dbd-a14d-32e473c62949'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:26.573144 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c4adb075-3355-4dbd-a14d-32e473c62949 admin admin] The token cache is being invalidate because project 48e010ac15f7448383e87c8a6a76499b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:37:26.573424 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c4adb075-3355-4dbd-a14d-32e473c62949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:26.574209 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-c4adb075-3355-4dbd-a14d-32e473c62949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:26.576269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1315/2638] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:37:26 2022] DELETE /identity/v3/projects/48e010ac15f7448383e87c8a6a76499b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:26.581844 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06bec8-c9fa-4de9-b808-bd848049e152 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:26.582166 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06bec8-c9fa-4de9-b808-bd848049e152 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:26.582344 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06bec8-c9fa-4de9-b808-bd848049e152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:26.609315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-bc06bec8-c9fa-4de9-b808-bd848049e152 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:26.611207 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-bc06bec8-c9fa-4de9-b808-bd848049e152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:26.691116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1316/2639] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:37:26.693384 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57c841-f4bb-423e-a4d5-e863cb2ed6a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:26.694057 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57c841-f4bb-423e-a4d5-e863cb2ed6a1 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:26.694550 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57c841-f4bb-423e-a4d5-e863cb2ed6a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:26.694713 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57c841-f4bb-423e-a4d5-e863cb2ed6a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:26.696736 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-3b57c841-f4bb-423e-a4d5-e863cb2ed6a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:26.700888 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33644dd6-e566-4396-9cc0-3f62a0ad6bc0 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:26.701403 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33644dd6-e566-4396-9cc0-3f62a0ad6bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:26.701894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33644dd6-e566-4396-9cc0-3f62a0ad6bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:26.738222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-33644dd6-e566-4396-9cc0-3f62a0ad6bc0 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:26.741002 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-33644dd6-e566-4396-9cc0-3f62a0ad6bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:26.755799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1317/2640] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:26.760794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33644dd6-e566-4396-9cc0-3f62a0ad6bc0 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:26.773885 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33644dd6-e566-4396-9cc0-3f62a0ad6bc0 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:26.777874 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57c841-f4bb-423e-a4d5-e863cb2ed6a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:26.780777 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b647c-6446-4111-9238-9cf07169c7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:26.781155 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57c841-f4bb-423e-a4d5-e863cb2ed6a1 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:26.781707 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b647c-6446-4111-9238-9cf07169c7ee admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:26.791307 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b647c-6446-4111-9238-9cf07169c7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:26.791307 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b647c-6446-4111-9238-9cf07169c7ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:26.791307 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b647c-6446-4111-9238-9cf07169c7ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:37:26.791307 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b647c-6446-4111-9238-9cf07169c7ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:26.791307 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b647c-6446-4111-9238-9cf07169c7ee admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:26.799584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1324/2641] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:37:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:37:26.804691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1318/2642] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:37:26.812321 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57c841-f4bb-423e-a4d5-e863cb2ed6a1 service nova] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:26.834304 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57c841-f4bb-423e-a4d5-e863cb2ed6a1 service nova] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:26.841430 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f51954-bea4-437f-9788-43b40b64c095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:26.842413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f51954-bea4-437f-9788-43b40b64c095 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:26.843039 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f51954-bea4-437f-9788-43b40b64c095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:26.843187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f51954-bea4-437f-9788-43b40b64c095 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:26.844000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f51954-bea4-437f-9788-43b40b64c095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:26.846798 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f51954-bea4-437f-9788-43b40b64c095 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:27.034160 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1325/2643] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:37:26 2022] POST /identity/v3/projects => generated 377 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:37:27.038489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b647c-6446-4111-9238-9cf07169c7ee admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:27.050128 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b647c-6446-4111-9238-9cf07169c7ee admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:27.103198 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:27.158225 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a2b00-612b-42b4-b4f5-71e27d8c7b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:27.159136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a2b00-612b-42b4-b4f5-71e27d8c7b28 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:27.159409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a2b00-612b-42b4-b4f5-71e27d8c7b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:27.159684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a2b00-612b-42b4-b4f5-71e27d8c7b28 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:27.160373 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a2b00-612b-42b4-b4f5-71e27d8c7b28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:27.162331 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a2b00-612b-42b4-b4f5-71e27d8c7b28 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:27.287875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1319/2644] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:37:27 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:37:27.293075 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f51954-bea4-437f-9788-43b40b64c095 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:27.312816 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f51954-bea4-437f-9788-43b40b64c095 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:27.321095 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356867d1-4205-4484-a64d-62e2c4f06326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:27.322714 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356867d1-4205-4484-a64d-62e2c4f06326 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:27.323218 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356867d1-4205-4484-a64d-62e2c4f06326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:27.323724 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356867d1-4205-4484-a64d-62e2c4f06326 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:27.324932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356867d1-4205-4484-a64d-62e2c4f06326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:27.328233 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356867d1-4205-4484-a64d-62e2c4f06326 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:27.346108 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1326/2645] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:37:27.350581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a2b00-612b-42b4-b4f5-71e27d8c7b28 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:27.364338 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a2b00-612b-42b4-b4f5-71e27d8c7b28 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:27.371562 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba3a38-616e-466a-9758-9ba0ec5d255e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:27.372439 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba3a38-616e-466a-9758-9ba0ec5d255e admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:27.372734 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba3a38-616e-466a-9758-9ba0ec5d255e admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:27.373128 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba3a38-616e-466a-9758-9ba0ec5d255e admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:27.374180 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba3a38-616e-466a-9758-9ba0ec5d255e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:27.376688 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba3a38-616e-466a-9758-9ba0ec5d255e admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:27.389442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1320/2646] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:37:27.395605 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356867d1-4205-4484-a64d-62e2c4f06326 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:27.410333 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356867d1-4205-4484-a64d-62e2c4f06326 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:27.420214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d902bfe-2ada-455d-a9d1-fd0ef837c712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:27.421524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d902bfe-2ada-455d-a9d1-fd0ef837c712 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:27.421816 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d902bfe-2ada-455d-a9d1-fd0ef837c712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:27.422130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d902bfe-2ada-455d-a9d1-fd0ef837c712 admin admin] PATH_INFO: `/v3/projects/2bfb66434d1c408db38f08634cc4f636/users/96fa7223000d447aa984f3f0bb021cac/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:27.443991 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d902bfe-2ada-455d-a9d1-fd0ef837c712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bfb66434d1c408db38f08634cc4f636, user_id=96fa7223000d447aa984f3f0bb021cac, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:27.447374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d902bfe-2ada-455d-a9d1-fd0ef837c712 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:27.575138 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1327/2647] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:37:27 2022] PUT /identity/v3/projects/2bfb66434d1c408db38f08634cc4f636/users/96fa7223000d447aa984f3f0bb021cac/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:27.582018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc663d-a00f-4d0a-9cb8-3d33b98ef932 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:27.584746 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc663d-a00f-4d0a-9cb8-3d33b98ef932 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:27.589321 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc663d-a00f-4d0a-9cb8-3d33b98ef932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:27.639455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-abdc663d-a00f-4d0a-9cb8-3d33b98ef932 None None] MFA Rules not processed for user `96fa7223000d447aa984f3f0bb021cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:27.640949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-abdc663d-a00f-4d0a-9cb8-3d33b98ef932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:27.762063 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1321/2648] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:27.778114 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d902bfe-2ada-455d-a9d1-fd0ef837c712 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:27.796117 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-2d902bfe-2ada-455d-a9d1-fd0ef837c712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:27.960961 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:27.968250 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d902bfe-2ada-455d-a9d1-fd0ef837c712 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:27.974041 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9333a6-eda8-499a-bf02-1dd1b487d9a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5b3a7a9a08e40718980143d7c4880ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:27.975035 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9333a6-eda8-499a-bf02-1dd1b487d9a8 service glance] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:27.975518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9333a6-eda8-499a-bf02-1dd1b487d9a8 service glance] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:27.975995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9333a6-eda8-499a-bf02-1dd1b487d9a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:27.992587 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9333a6-eda8-499a-bf02-1dd1b487d9a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:27.996168 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9333a6-eda8-499a-bf02-1dd1b487d9a8 service glance] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:28.012534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1328/2649] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:37:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:37:28.145707 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df57def-e4f3-413d-881a-2b066f9c05e8 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:28.146639 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df57def-e4f3-413d-881a-2b066f9c05e8 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:28.146639 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df57def-e4f3-413d-881a-2b066f9c05e8 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:28.148479 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1322/2650] 10.222.0.83 () {54 vars in 961 bytes} [Fri Sep 23 01:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:37:28.158121 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c41cd-b4dc-4e09-b454-787e8258ff04 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:28.158707 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c41cd-b4dc-4e09-b454-787e8258ff04 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:28.159200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c41cd-b4dc-4e09-b454-787e8258ff04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:28.198355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-1e8c41cd-b4dc-4e09-b454-787e8258ff04 None None] MFA Rules not processed for user `3eab2cbff5984fa6a8e715ed6553db82`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:28.202077 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-1e8c41cd-b4dc-4e09-b454-787e8258ff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:28.296972 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1329/2651] 10.222.0.83 () {58 vars in 1058 bytes} [Fri Sep 23 01:37:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:37:28.307971 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df57def-e4f3-413d-881a-2b066f9c05e8 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:28.326646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df57def-e4f3-413d-881a-2b066f9c05e8 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:28.333714 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bbf28-2096-4915-850a-f799d8984b15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eab2cbff5984fa6a8e715ed6553db82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:28.334472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bbf28-2096-4915-850a-f799d8984b15 service placement] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:28.335165 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bbf28-2096-4915-850a-f799d8984b15 service placement] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:28.335437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bbf28-2096-4915-850a-f799d8984b15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:28.337681 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b60bbf28-2096-4915-850a-f799d8984b15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:28.350765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bbf28-2096-4915-850a-f799d8984b15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:28.352562 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bbf28-2096-4915-850a-f799d8984b15 service placement] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:28.364789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1323/2652] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:37:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:37:28.399153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c41cd-b4dc-4e09-b454-787e8258ff04 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:28.407311 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-1e8c41cd-b4dc-4e09-b454-787e8258ff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:28.497436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c41cd-b4dc-4e09-b454-787e8258ff04 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:28.502877 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b9b17-5478-4e2f-a42c-f6a51ceba983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:28.513684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b9b17-5478-4e2f-a42c-f6a51ceba983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:28.513684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b9b17-5478-4e2f-a42c-f6a51ceba983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:28.513684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b9b17-5478-4e2f-a42c-f6a51ceba983 admin admin] PATH_INFO: `/v3/users/c88f23161cd447a2800244936f7faff9` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:28.513684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b9b17-5478-4e2f-a42c-f6a51ceba983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88f23161cd447a2800244936f7faff9)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:28.513684 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b9b17-5478-4e2f-a42c-f6a51ceba983 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:28.765278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-093b9b17-5478-4e2f-a42c-f6a51ceba983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88f23161cd447a2800244936f7faff9'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:28.881441 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-093b9b17-5478-4e2f-a42c-f6a51ceba983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88f23161cd447a2800244936f7faff9'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:28.882555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-093b9b17-5478-4e2f-a42c-f6a51ceba983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88f23161cd447a2800244936f7faff9'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:28.897807 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-093b9b17-5478-4e2f-a42c-f6a51ceba983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88f23161cd447a2800244936f7faff9'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:28.899396 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-093b9b17-5478-4e2f-a42c-f6a51ceba983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88f23161cd447a2800244936f7faff9'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:28.921431 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1330/2653] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:37:28 2022] DELETE /identity/v3/users/c88f23161cd447a2800244936f7faff9 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:29.341547 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bbf28-2096-4915-850a-f799d8984b15 service placement] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:29.358574 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bbf28-2096-4915-850a-f799d8984b15 service placement] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:29.458005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0b80a-d3d8-4427-8042-67047b31fcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:29.458792 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0b80a-d3d8-4427-8042-67047b31fcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:29.459136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0b80a-d3d8-4427-8042-67047b31fcda admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:29.459474 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0b80a-d3d8-4427-8042-67047b31fcda admin admin] PATH_INFO: `/v3/projects/7649509ee74b4e3a9d4b275c913993cd` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:29.460758 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0b80a-d3d8-4427-8042-67047b31fcda admin admin] RBAC: Authorizing `identity:delete_project(project_id=7649509ee74b4e3a9d4b275c913993cd)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:29.463525 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0b80a-d3d8-4427-8042-67047b31fcda admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:29.632632 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:29.663448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4da0b80a-d3d8-4427-8042-67047b31fcda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7649509ee74b4e3a9d4b275c913993cd', 'request_id': 'req-4da0b80a-d3d8-4427-8042-67047b31fcda'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:29.818651 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4da0b80a-d3d8-4427-8042-67047b31fcda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7649509ee74b4e3a9d4b275c913993cd', 'request_id': 'req-4da0b80a-d3d8-4427-8042-67047b31fcda'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:29.829580 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4da0b80a-d3d8-4427-8042-67047b31fcda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7649509ee74b4e3a9d4b275c913993cd', 'request_id': 'req-4da0b80a-d3d8-4427-8042-67047b31fcda'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:29.845867 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4da0b80a-d3d8-4427-8042-67047b31fcda admin admin] The token cache is being invalidate because project 7649509ee74b4e3a9d4b275c913993cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:37:29.846347 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4da0b80a-d3d8-4427-8042-67047b31fcda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:29.846987 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4da0b80a-d3d8-4427-8042-67047b31fcda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:29.848777 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1324/2654] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:37:29 2022] DELETE /identity/v3/projects/7649509ee74b4e3a9d4b275c913993cd => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:30.534001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b9b17-5478-4e2f-a42c-f6a51ceba983 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:30.534001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-093b9b17-5478-4e2f-a42c-f6a51ceba983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:30.546025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:30.550508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b9b17-5478-4e2f-a42c-f6a51ceba983 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:30.624091 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69fc74-84e8-4617-bd97-8f87b95d2536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:30.624923 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69fc74-84e8-4617-bd97-8f87b95d2536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:30.625206 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69fc74-84e8-4617-bd97-8f87b95d2536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:30.625484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69fc74-84e8-4617-bd97-8f87b95d2536 admin admin] PATH_INFO: `/v3/users/d5a3b3053d0748e79021d8b1ef6e8ab7` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:30.627075 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69fc74-84e8-4617-bd97-8f87b95d2536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5a3b3053d0748e79021d8b1ef6e8ab7)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:30.638867 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69fc74-84e8-4617-bd97-8f87b95d2536 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:30.872790 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3c69fc74-84e8-4617-bd97-8f87b95d2536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5a3b3053d0748e79021d8b1ef6e8ab7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:31.022074 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3c69fc74-84e8-4617-bd97-8f87b95d2536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5a3b3053d0748e79021d8b1ef6e8ab7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:31.022893 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3c69fc74-84e8-4617-bd97-8f87b95d2536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5a3b3053d0748e79021d8b1ef6e8ab7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:31.032753 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3c69fc74-84e8-4617-bd97-8f87b95d2536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5a3b3053d0748e79021d8b1ef6e8ab7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:31.033639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3c69fc74-84e8-4617-bd97-8f87b95d2536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5a3b3053d0748e79021d8b1ef6e8ab7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:31.060412 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1331/2655] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:37:30 2022] DELETE /identity/v3/users/d5a3b3053d0748e79021d8b1ef6e8ab7 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:31.065045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f089a7e-2df4-4e16-933d-00bd5dc8cd9d None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:31.065615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f089a7e-2df4-4e16-933d-00bd5dc8cd9d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:31.065615 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f089a7e-2df4-4e16-933d-00bd5dc8cd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:31.090898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-9f089a7e-2df4-4e16-933d-00bd5dc8cd9d None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:31.092170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-9f089a7e-2df4-4e16-933d-00bd5dc8cd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:31.161998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1325/2656] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:31.174186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69fc74-84e8-4617-bd97-8f87b95d2536 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:31.175674 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-3c69fc74-84e8-4617-bd97-8f87b95d2536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:31.245915 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69fc74-84e8-4617-bd97-8f87b95d2536 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:31.250288 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89c96b-b9b3-46b3-9819-d7e56ecae08c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:31.251038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89c96b-b9b3-46b3-9819-d7e56ecae08c service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:31.251287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89c96b-b9b3-46b3-9819-d7e56ecae08c service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:31.251509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89c96b-b9b3-46b3-9819-d7e56ecae08c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:31.263351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89c96b-b9b3-46b3-9819-d7e56ecae08c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:31.265225 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89c96b-b9b3-46b3-9819-d7e56ecae08c service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:31.279194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1332/2657] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:37:31.981042 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f089a7e-2df4-4e16-933d-00bd5dc8cd9d None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:31.982761 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-9f089a7e-2df4-4e16-933d-00bd5dc8cd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:31.999590 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f089a7e-2df4-4e16-933d-00bd5dc8cd9d None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:32.003623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c805322-7718-4cd7-a715-9ef9ee915369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:32.004286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c805322-7718-4cd7-a715-9ef9ee915369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:32.004568 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c805322-7718-4cd7-a715-9ef9ee915369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:32.004842 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c805322-7718-4cd7-a715-9ef9ee915369 admin admin] PATH_INFO: `/v3/projects/aee4a5fff91e4277ae584015bb4bedbe` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:32.006870 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c805322-7718-4cd7-a715-9ef9ee915369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee4a5fff91e4277ae584015bb4bedbe)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:32.008845 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c805322-7718-4cd7-a715-9ef9ee915369 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:32.165569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4c805322-7718-4cd7-a715-9ef9ee915369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee4a5fff91e4277ae584015bb4bedbe', 'request_id': 'req-4c805322-7718-4cd7-a715-9ef9ee915369'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:32.250357 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4c805322-7718-4cd7-a715-9ef9ee915369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee4a5fff91e4277ae584015bb4bedbe', 'request_id': 'req-4c805322-7718-4cd7-a715-9ef9ee915369'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:32.259501 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4c805322-7718-4cd7-a715-9ef9ee915369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee4a5fff91e4277ae584015bb4bedbe', 'request_id': 'req-4c805322-7718-4cd7-a715-9ef9ee915369'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:32.276555 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4c805322-7718-4cd7-a715-9ef9ee915369 admin admin] The token cache is being invalidate because project aee4a5fff91e4277ae584015bb4bedbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:37:32.276900 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4c805322-7718-4cd7-a715-9ef9ee915369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:32.277679 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-4c805322-7718-4cd7-a715-9ef9ee915369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:32.279419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1326/2658] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:37:31 2022] DELETE /identity/v3/projects/aee4a5fff91e4277ae584015bb4bedbe => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:32.285686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac199165-d705-4bab-a2c4-931aef98c98b None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:32.286249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac199165-d705-4bab-a2c4-931aef98c98b None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:32.286705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac199165-d705-4bab-a2c4-931aef98c98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:32.320269 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-ac199165-d705-4bab-a2c4-931aef98c98b None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:32.322430 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ac199165-d705-4bab-a2c4-931aef98c98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:32.357314 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:32.405055 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1333/2659] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:32.416622 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ed310-0fb0-49c4-b829-b3e5d0474a7f None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:32.417090 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ed310-0fb0-49c4-b829-b3e5d0474a7f None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:32.417377 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ed310-0fb0-49c4-b829-b3e5d0474a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:32.440213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-ec6ed310-0fb0-49c4-b829-b3e5d0474a7f None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:32.442497 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ec6ed310-0fb0-49c4-b829-b3e5d0474a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:32.450319 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1327/2660] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:32.454774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac199165-d705-4bab-a2c4-931aef98c98b None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:32.471157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac199165-d705-4bab-a2c4-931aef98c98b None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:32.479925 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174714b-e526-457d-acbc-4710ffe26b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:32.482748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174714b-e526-457d-acbc-4710ffe26b9e admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:32.482748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174714b-e526-457d-acbc-4710ffe26b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:32.482748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174714b-e526-457d-acbc-4710ffe26b9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:32.482748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174714b-e526-457d-acbc-4710ffe26b9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:37:32.482748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174714b-e526-457d-acbc-4710ffe26b9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:32.484908 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174714b-e526-457d-acbc-4710ffe26b9e admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:32.500528 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1334/2661] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:37:32.505693 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ed310-0fb0-49c4-b829-b3e5d0474a7f None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:32.515437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ed310-0fb0-49c4-b829-b3e5d0474a7f None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:32.520539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2993153-a2e9-481a-bdf9-0f5fedc4e766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:32.521258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2993153-a2e9-481a-bdf9-0f5fedc4e766 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:32.521564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2993153-a2e9-481a-bdf9-0f5fedc4e766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:32.521868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2993153-a2e9-481a-bdf9-0f5fedc4e766 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:32.522573 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2993153-a2e9-481a-bdf9-0f5fedc4e766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:32.524543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2993153-a2e9-481a-bdf9-0f5fedc4e766 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:32.674411 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1328/2662] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:37:32 2022] POST /identity/v3/projects => generated 365 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:37:32.676123 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174714b-e526-457d-acbc-4710ffe26b9e admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:32.696563 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174714b-e526-457d-acbc-4710ffe26b9e admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:32.829513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b576ab-b076-40f2-8f36-465c7f85924f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:32.830151 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b576ab-b076-40f2-8f36-465c7f85924f admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:32.830434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b576ab-b076-40f2-8f36-465c7f85924f admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:32.830742 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b576ab-b076-40f2-8f36-465c7f85924f admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:32.831395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b576ab-b076-40f2-8f36-465c7f85924f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:32.833439 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b576ab-b076-40f2-8f36-465c7f85924f admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:32.958677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1335/2663] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:37:32 2022] POST /identity/v3/users => generated 283 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:37:32.964511 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2993153-a2e9-481a-bdf9-0f5fedc4e766 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:32.979210 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2993153-a2e9-481a-bdf9-0f5fedc4e766 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:32.984745 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c733b7-814b-48c9-a1d5-318b8ca4a599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:32.985793 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c733b7-814b-48c9-a1d5-318b8ca4a599 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:32.986358 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c733b7-814b-48c9-a1d5-318b8ca4a599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:32.987240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c733b7-814b-48c9-a1d5-318b8ca4a599 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:32.988192 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c733b7-814b-48c9-a1d5-318b8ca4a599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:32.990225 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c733b7-814b-48c9-a1d5-318b8ca4a599 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:32.992960 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:33.002545 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1329/2664] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:37:33.009249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b576ab-b076-40f2-8f36-465c7f85924f admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:33.021567 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b576ab-b076-40f2-8f36-465c7f85924f admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:33.027219 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877e050-04c0-42ef-ab14-70ab9dfd9f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:33.027739 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877e050-04c0-42ef-ab14-70ab9dfd9f8a admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:33.028096 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877e050-04c0-42ef-ab14-70ab9dfd9f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:33.028314 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877e050-04c0-42ef-ab14-70ab9dfd9f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:33.029061 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877e050-04c0-42ef-ab14-70ab9dfd9f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:33.030872 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877e050-04c0-42ef-ab14-70ab9dfd9f8a admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:33.043771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1336/2665] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:37:33.049406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c733b7-814b-48c9-a1d5-318b8ca4a599 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:33.060218 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c733b7-814b-48c9-a1d5-318b8ca4a599 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:33.066224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96beae-d155-40a6-a53b-20914f993365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:33.066931 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96beae-d155-40a6-a53b-20914f993365 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:33.067210 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96beae-d155-40a6-a53b-20914f993365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:33.067773 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96beae-d155-40a6-a53b-20914f993365 admin admin] PATH_INFO: `/v3/projects/ca92e5c8f7a944779d549d6dfae760f2/users/0ad65e8e2fdc40a49f4d655fd18942bd/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:33.085216 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96beae-d155-40a6-a53b-20914f993365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca92e5c8f7a944779d549d6dfae760f2, user_id=0ad65e8e2fdc40a49f4d655fd18942bd, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:33.088584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96beae-d155-40a6-a53b-20914f993365 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:33.160243 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1330/2666] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:37:33 2022] PUT /identity/v3/projects/ca92e5c8f7a944779d549d6dfae760f2/users/0ad65e8e2fdc40a49f4d655fd18942bd/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:33.171882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed555b24-dcf3-4ae1-b108-0be8c4aafc3f None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:33.172217 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed555b24-dcf3-4ae1-b108-0be8c4aafc3f None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:33.172404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed555b24-dcf3-4ae1-b108-0be8c4aafc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:33.205794 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-ed555b24-dcf3-4ae1-b108-0be8c4aafc3f None None] MFA Rules not processed for user `0ad65e8e2fdc40a49f4d655fd18942bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:33.207474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ed555b24-dcf3-4ae1-b108-0be8c4aafc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:33.299704 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1337/2667] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:37:33.305022 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96beae-d155-40a6-a53b-20914f993365 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:33.389263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96beae-d155-40a6-a53b-20914f993365 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:33.396247 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4812491-19c0-4dd2-97da-348b4e87220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:33.397224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4812491-19c0-4dd2-97da-348b4e87220e admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:33.397507 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4812491-19c0-4dd2-97da-348b4e87220e admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:33.397830 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4812491-19c0-4dd2-97da-348b4e87220e admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:33.398527 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4812491-19c0-4dd2-97da-348b4e87220e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:33.401452 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4812491-19c0-4dd2-97da-348b4e87220e admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:33.530672 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1331/2668] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:37:33 2022] POST /identity/v3/projects => generated 363 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:37:33.538895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed555b24-dcf3-4ae1-b108-0be8c4aafc3f None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:33.553660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed555b24-dcf3-4ae1-b108-0be8c4aafc3f None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:33.581654 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:33.628801 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed3ad7-320a-4d8c-83e1-581167eecebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:33.629428 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed3ad7-320a-4d8c-83e1-581167eecebd admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:33.629701 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed3ad7-320a-4d8c-83e1-581167eecebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:33.629973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed3ad7-320a-4d8c-83e1-581167eecebd admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:33.630638 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed3ad7-320a-4d8c-83e1-581167eecebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:33.632737 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed3ad7-320a-4d8c-83e1-581167eecebd admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:33.713955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1338/2669] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:37:33 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:37:33.719390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4812491-19c0-4dd2-97da-348b4e87220e admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:33.732171 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4812491-19c0-4dd2-97da-348b4e87220e admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:33.737363 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87158ace-bb4b-4bb6-9b87-635a9ede12cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:33.737986 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87158ace-bb4b-4bb6-9b87-635a9ede12cf admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:33.738268 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87158ace-bb4b-4bb6-9b87-635a9ede12cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:33.738566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87158ace-bb4b-4bb6-9b87-635a9ede12cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:33.739322 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87158ace-bb4b-4bb6-9b87-635a9ede12cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:33.740996 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87158ace-bb4b-4bb6-9b87-635a9ede12cf admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:33.756762 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1332/2670] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:37:33.761663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed3ad7-320a-4d8c-83e1-581167eecebd admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:33.774017 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed3ad7-320a-4d8c-83e1-581167eecebd admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:33.780408 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895bc3c-48ba-4c73-93ff-187b16d955b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:33.781100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895bc3c-48ba-4c73-93ff-187b16d955b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:33.781378 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895bc3c-48ba-4c73-93ff-187b16d955b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:33.781652 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895bc3c-48ba-4c73-93ff-187b16d955b7 admin admin] PATH_INFO: `/v3/projects/dc22ab4410d3484aa3060680a69ee308/users/63d3523143ba4151ae69769624a3ec4a/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:33.801231 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895bc3c-48ba-4c73-93ff-187b16d955b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc22ab4410d3484aa3060680a69ee308, user_id=63d3523143ba4151ae69769624a3ec4a, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:33.810251 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895bc3c-48ba-4c73-93ff-187b16d955b7 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:33.895403 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1339/2671] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:37:33 2022] PUT /identity/v3/projects/dc22ab4410d3484aa3060680a69ee308/users/63d3523143ba4151ae69769624a3ec4a/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:33.900599 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87158ace-bb4b-4bb6-9b87-635a9ede12cf admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:33.922743 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87158ace-bb4b-4bb6-9b87-635a9ede12cf admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:34.025155 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cf993-9528-45a3-aee7-6b98adef55d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:34.026284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cf993-9528-45a3-aee7-6b98adef55d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:34.026572 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cf993-9528-45a3-aee7-6b98adef55d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:34.026897 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cf993-9528-45a3-aee7-6b98adef55d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:34.027597 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cf993-9528-45a3-aee7-6b98adef55d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:34.029267 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cf993-9528-45a3-aee7-6b98adef55d4 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:34.042851 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1333/2672] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:37:34.048004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895bc3c-48ba-4c73-93ff-187b16d955b7 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:34.062424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895bc3c-48ba-4c73-93ff-187b16d955b7 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:34.068678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac099614-0c7c-4aee-86c6-f5ba939a800f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:34.069567 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac099614-0c7c-4aee-86c6-f5ba939a800f admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:34.069951 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac099614-0c7c-4aee-86c6-f5ba939a800f admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:34.070303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac099614-0c7c-4aee-86c6-f5ba939a800f admin admin] PATH_INFO: `/v3/projects/dc22ab4410d3484aa3060680a69ee308/users/63d3523143ba4151ae69769624a3ec4a/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:34.074458 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac099614-0c7c-4aee-86c6-f5ba939a800f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc22ab4410d3484aa3060680a69ee308, user_id=63d3523143ba4151ae69769624a3ec4a, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:34.078356 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac099614-0c7c-4aee-86c6-f5ba939a800f admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:34.094741 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1340/2673] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:37:34 2022] PUT /identity/v3/projects/dc22ab4410d3484aa3060680a69ee308/users/63d3523143ba4151ae69769624a3ec4a/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:37:34.102630 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4c23b-b822-4398-b421-749035a7bea7 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:34.103633 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4c23b-b822-4398-b421-749035a7bea7 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:34.104123 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4c23b-b822-4398-b421-749035a7bea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:34.144903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-36b4c23b-b822-4398-b421-749035a7bea7 None None] MFA Rules not processed for user `63d3523143ba4151ae69769624a3ec4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:34.146351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-36b4c23b-b822-4398-b421-749035a7bea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:34.186170 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:34.232388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1334/2674] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:37:34.248749 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac099614-0c7c-4aee-86c6-f5ba939a800f admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:34.251875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ac099614-0c7c-4aee-86c6-f5ba939a800f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:34.357080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac099614-0c7c-4aee-86c6-f5ba939a800f admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:34.364497 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a9062-0646-4430-bb95-d1110ef01054 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:34.365573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a9062-0646-4430-bb95-d1110ef01054 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:34.366050 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a9062-0646-4430-bb95-d1110ef01054 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:34.366526 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a9062-0646-4430-bb95-d1110ef01054 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:34.385686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a9062-0646-4430-bb95-d1110ef01054 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:34.387332 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a9062-0646-4430-bb95-d1110ef01054 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:34.398774 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1341/2675] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:37:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:37:35.710793 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4c23b-b822-4398-b421-749035a7bea7 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:35.846560 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4c23b-b822-4398-b421-749035a7bea7 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:35.853263 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fd23e-a610-4716-9730-ef95779b9acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:35.854131 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fd23e-a610-4716-9730-ef95779b9acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:35.854575 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fd23e-a610-4716-9730-ef95779b9acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:35.854977 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fd23e-a610-4716-9730-ef95779b9acc admin admin] PATH_INFO: `/v3/users/0ad65e8e2fdc40a49f4d655fd18942bd` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:35.856689 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fd23e-a610-4716-9730-ef95779b9acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad65e8e2fdc40a49f4d655fd18942bd)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:35.859853 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fd23e-a610-4716-9730-ef95779b9acc admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:36.109261 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-558fd23e-a610-4716-9730-ef95779b9acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad65e8e2fdc40a49f4d655fd18942bd'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:36.135491 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-558fd23e-a610-4716-9730-ef95779b9acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad65e8e2fdc40a49f4d655fd18942bd'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:36.218152 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-558fd23e-a610-4716-9730-ef95779b9acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad65e8e2fdc40a49f4d655fd18942bd'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:36.218850 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-558fd23e-a610-4716-9730-ef95779b9acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad65e8e2fdc40a49f4d655fd18942bd'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:36.228880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-558fd23e-a610-4716-9730-ef95779b9acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad65e8e2fdc40a49f4d655fd18942bd'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:36.242433 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1335/2676] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:37:35 2022] DELETE /identity/v3/users/0ad65e8e2fdc40a49f4d655fd18942bd => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:36.250740 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb200d32-7c96-417d-85bf-b55cb7b9026f None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:36.251436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb200d32-7c96-417d-85bf-b55cb7b9026f None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:36.251695 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb200d32-7c96-417d-85bf-b55cb7b9026f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:36.283553 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-eb200d32-7c96-417d-85bf-b55cb7b9026f None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:36.285851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-eb200d32-7c96-417d-85bf-b55cb7b9026f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:36.413791 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1342/2677] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:37:36.424871 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fd23e-a610-4716-9730-ef95779b9acc admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:36.427315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-558fd23e-a610-4716-9730-ef95779b9acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:36.529644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fd23e-a610-4716-9730-ef95779b9acc admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:36.531277 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:36.535422 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a35579-4773-460c-b209-37f4a26fa92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:36.536202 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a35579-4773-460c-b209-37f4a26fa92a service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:36.536542 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a35579-4773-460c-b209-37f4a26fa92a service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:36.536882 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a35579-4773-460c-b209-37f4a26fa92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:36.547859 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a35579-4773-460c-b209-37f4a26fa92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:36.549401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a35579-4773-460c-b209-37f4a26fa92a service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:36.560324 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1336/2678] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:37:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:37:37.133363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb200d32-7c96-417d-85bf-b55cb7b9026f None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:37.137741 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-eb200d32-7c96-417d-85bf-b55cb7b9026f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:37.155967 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb200d32-7c96-417d-85bf-b55cb7b9026f None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:37.164086 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89774461-c65e-4314-ba05-153690a50598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:37.165213 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89774461-c65e-4314-ba05-153690a50598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:37.165795 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89774461-c65e-4314-ba05-153690a50598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:37.166147 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89774461-c65e-4314-ba05-153690a50598 admin admin] PATH_INFO: `/v3/projects/ca92e5c8f7a944779d549d6dfae760f2` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:37.168249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89774461-c65e-4314-ba05-153690a50598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca92e5c8f7a944779d549d6dfae760f2)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:37.172125 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89774461-c65e-4314-ba05-153690a50598 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:37.193834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:37.382062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-89774461-c65e-4314-ba05-153690a50598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca92e5c8f7a944779d549d6dfae760f2', 'request_id': 'req-89774461-c65e-4314-ba05-153690a50598'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:37.475106 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-89774461-c65e-4314-ba05-153690a50598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca92e5c8f7a944779d549d6dfae760f2', 'request_id': 'req-89774461-c65e-4314-ba05-153690a50598'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:37.485928 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-89774461-c65e-4314-ba05-153690a50598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca92e5c8f7a944779d549d6dfae760f2', 'request_id': 'req-89774461-c65e-4314-ba05-153690a50598'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:37.506556 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-89774461-c65e-4314-ba05-153690a50598 admin admin] The token cache is being invalidate because project ca92e5c8f7a944779d549d6dfae760f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:37:37.506556 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-89774461-c65e-4314-ba05-153690a50598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:37.507200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-89774461-c65e-4314-ba05-153690a50598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:37.508753 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1343/2679] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:37:37 2022] DELETE /identity/v3/projects/ca92e5c8f7a944779d549d6dfae760f2 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:37.515240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a35579-4773-460c-b209-37f4a26fa92a service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:37.531569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a35579-4773-460c-b209-37f4a26fa92a service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:37.646720 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2df3a7-841f-4bce-bee6-e441248eaf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:37.647546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2df3a7-841f-4bce-bee6-e441248eaf1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:37.647958 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2df3a7-841f-4bce-bee6-e441248eaf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:37.648429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2df3a7-841f-4bce-bee6-e441248eaf1f admin admin] PATH_INFO: `/v3/users/63d3523143ba4151ae69769624a3ec4a` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:37.651175 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2df3a7-841f-4bce-bee6-e441248eaf1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d3523143ba4151ae69769624a3ec4a)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:37.655443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2df3a7-841f-4bce-bee6-e441248eaf1f admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:37.976480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ca2df3a7-841f-4bce-bee6-e441248eaf1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d3523143ba4151ae69769624a3ec4a'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:37.996317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ca2df3a7-841f-4bce-bee6-e441248eaf1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d3523143ba4151ae69769624a3ec4a'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:38.079430 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ca2df3a7-841f-4bce-bee6-e441248eaf1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d3523143ba4151ae69769624a3ec4a'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:38.080451 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ca2df3a7-841f-4bce-bee6-e441248eaf1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d3523143ba4151ae69769624a3ec4a'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:38.093851 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-ca2df3a7-841f-4bce-bee6-e441248eaf1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d3523143ba4151ae69769624a3ec4a'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:38.103014 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1337/2680] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:37:37 2022] DELETE /identity/v3/users/63d3523143ba4151ae69769624a3ec4a => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:38.811621 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89774461-c65e-4314-ba05-153690a50598 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:38.814849 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-89774461-c65e-4314-ba05-153690a50598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:38.837353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89774461-c65e-4314-ba05-153690a50598 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:38.948486 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdbbca-f16a-4154-9902-af5e3e1ac3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:38.949543 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdbbca-f16a-4154-9902-af5e3e1ac3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:38.950003 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdbbca-f16a-4154-9902-af5e3e1ac3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:38.950486 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdbbca-f16a-4154-9902-af5e3e1ac3f2 admin admin] PATH_INFO: `/v3/projects/dc22ab4410d3484aa3060680a69ee308` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:38.952565 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bdbbca-f16a-4154-9902-af5e3e1ac3f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc22ab4410d3484aa3060680a69ee308)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:38.956132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bdbbca-f16a-4154-9902-af5e3e1ac3f2 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:39.121860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f9bdbbca-f16a-4154-9902-af5e3e1ac3f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc22ab4410d3484aa3060680a69ee308', 'request_id': 'req-f9bdbbca-f16a-4154-9902-af5e3e1ac3f2'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:39.235495 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f9bdbbca-f16a-4154-9902-af5e3e1ac3f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc22ab4410d3484aa3060680a69ee308', 'request_id': 'req-f9bdbbca-f16a-4154-9902-af5e3e1ac3f2'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:39.246194 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f9bdbbca-f16a-4154-9902-af5e3e1ac3f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc22ab4410d3484aa3060680a69ee308', 'request_id': 'req-f9bdbbca-f16a-4154-9902-af5e3e1ac3f2'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:39.262893 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f9bdbbca-f16a-4154-9902-af5e3e1ac3f2 admin admin] The token cache is being invalidate because project dc22ab4410d3484aa3060680a69ee308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:37:39.263516 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f9bdbbca-f16a-4154-9902-af5e3e1ac3f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:39.264663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f9bdbbca-f16a-4154-9902-af5e3e1ac3f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:39.266661 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1344/2681] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:37:38 2022] DELETE /identity/v3/projects/dc22ab4410d3484aa3060680a69ee308 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:39.273791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c63857-f5c8-450b-bce8-41466337d069 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:39.274373 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c63857-f5c8-450b-bce8-41466337d069 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:39.274373 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c63857-f5c8-450b-bce8-41466337d069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:39.297923 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-49c63857-f5c8-450b-bce8-41466337d069 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:39.299237 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-49c63857-f5c8-450b-bce8-41466337d069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:39.405727 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1338/2682] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:39.415400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd85502-d9e3-4b23-aacf-ac1e2c43ed21 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:39.415898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd85502-d9e3-4b23-aacf-ac1e2c43ed21 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:39.416095 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd85502-d9e3-4b23-aacf-ac1e2c43ed21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:39.450610 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-fdd85502-d9e3-4b23-aacf-ac1e2c43ed21 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:39.452621 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-fdd85502-d9e3-4b23-aacf-ac1e2c43ed21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:39.466492 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1345/2683] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:37:39.471861 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c63857-f5c8-450b-bce8-41466337d069 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:39.490126 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c63857-f5c8-450b-bce8-41466337d069 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:39.501984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c928f7-0cd8-4837-92c5-6c31337eceee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:39.502875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c928f7-0cd8-4837-92c5-6c31337eceee admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:39.503341 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c928f7-0cd8-4837-92c5-6c31337eceee admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:39.503840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c928f7-0cd8-4837-92c5-6c31337eceee admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:39.504874 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c928f7-0cd8-4837-92c5-6c31337eceee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:37:39.505987 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c928f7-0cd8-4837-92c5-6c31337eceee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:39.507904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c928f7-0cd8-4837-92c5-6c31337eceee admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:39.517390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:39.525211 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1339/2684] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:37:39.530430 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd85502-d9e3-4b23-aacf-ac1e2c43ed21 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:39.547852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd85502-d9e3-4b23-aacf-ac1e2c43ed21 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:39.556810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e1c00-792d-4913-9cf2-d16039717cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:39.559567 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e1c00-792d-4913-9cf2-d16039717cbd admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:39.559567 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e1c00-792d-4913-9cf2-d16039717cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:39.559567 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e1c00-792d-4913-9cf2-d16039717cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:39.560159 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e1c00-792d-4913-9cf2-d16039717cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:39.564503 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e1c00-792d-4913-9cf2-d16039717cbd admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:39.705790 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1346/2685] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:37:39 2022] POST /identity/v3/projects => generated 357 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:37:39.710484 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c928f7-0cd8-4837-92c5-6c31337eceee admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:39.723009 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c928f7-0cd8-4837-92c5-6c31337eceee admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:39.820650 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056b079-4489-475a-95a5-d68052ed1525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:39.821489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056b079-4489-475a-95a5-d68052ed1525 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:39.821932 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056b079-4489-475a-95a5-d68052ed1525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:39.822213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056b079-4489-475a-95a5-d68052ed1525 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:39.822987 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056b079-4489-475a-95a5-d68052ed1525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:39.825177 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056b079-4489-475a-95a5-d68052ed1525 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:40.053519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1340/2686] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:37:39 2022] POST /identity/v3/users => generated 279 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:37:40.074714 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e1c00-792d-4913-9cf2-d16039717cbd admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:40.088160 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:40.096941 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e1c00-792d-4913-9cf2-d16039717cbd admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:40.109719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2b8c2-c11e-485e-903e-a28b424ad20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:40.109719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2b8c2-c11e-485e-903e-a28b424ad20c admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:40.109719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2b8c2-c11e-485e-903e-a28b424ad20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:40.109719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2b8c2-c11e-485e-903e-a28b424ad20c admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:40.110271 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2b8c2-c11e-485e-903e-a28b424ad20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:40.112283 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2b8c2-c11e-485e-903e-a28b424ad20c admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:40.120682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e72ff3-413f-4504-9ab6-f5be34f27bd7 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:40.122949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e72ff3-413f-4504-9ab6-f5be34f27bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:40.123650 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e72ff3-413f-4504-9ab6-f5be34f27bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:40.130435 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1347/2687] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:37:40.131389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2b8c2-c11e-485e-903e-a28b424ad20c admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:40.145524 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2b8c2-c11e-485e-903e-a28b424ad20c admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:40.155788 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4fcdd6-4193-43b0-8614-c79e73e0759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:40.156944 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fcdd6-4193-43b0-8614-c79e73e0759e admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:40.157472 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fcdd6-4193-43b0-8614-c79e73e0759e admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:40.157943 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fcdd6-4193-43b0-8614-c79e73e0759e admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:40.158832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4fcdd6-4193-43b0-8614-c79e73e0759e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:40.160690 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4fcdd6-4193-43b0-8614-c79e73e0759e admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:40.174632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1348/2688] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:37:40.177405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-51e72ff3-413f-4504-9ab6-f5be34f27bd7 None None] MFA Rules not processed for user `f2cea4c08f324769bf6dcea58c9394b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:40.179072 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4fcdd6-4193-43b0-8614-c79e73e0759e admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:40.183759 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-51e72ff3-413f-4504-9ab6-f5be34f27bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:40.197595 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4fcdd6-4193-43b0-8614-c79e73e0759e admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:40.205324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69653173-bceb-4f77-a076-3a0465e622f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:40.207714 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69653173-bceb-4f77-a076-3a0465e622f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:40.207714 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69653173-bceb-4f77-a076-3a0465e622f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:40.208201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69653173-bceb-4f77-a076-3a0465e622f9 admin admin] PATH_INFO: `/v3/projects/5bebddf1324f4edc951bc794d8af2971/users/e7fab584f9ce452ba3d53e34cee4cb0e/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:40.255581 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69653173-bceb-4f77-a076-3a0465e622f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bebddf1324f4edc951bc794d8af2971, user_id=e7fab584f9ce452ba3d53e34cee4cb0e, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:40.265297 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69653173-bceb-4f77-a076-3a0465e622f9 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:40.310909 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1341/2689] 10.222.0.83 () {58 vars in 1009 bytes} [Fri Sep 23 01:37:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:40.369003 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1349/2690] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:37:40 2022] PUT /identity/v3/projects/5bebddf1324f4edc951bc794d8af2971/users/e7fab584f9ce452ba3d53e34cee4cb0e/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:40.386440 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642d7e5-46d8-4142-8b52-995bcce0d4c3 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:40.386898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642d7e5-46d8-4142-8b52-995bcce0d4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:40.387472 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642d7e5-46d8-4142-8b52-995bcce0d4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:40.440414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-1642d7e5-46d8-4142-8b52-995bcce0d4c3 None None] MFA Rules not processed for user `e7fab584f9ce452ba3d53e34cee4cb0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:40.441840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-1642d7e5-46d8-4142-8b52-995bcce0d4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:40.559521 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1342/2691] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:40.564887 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69653173-bceb-4f77-a076-3a0465e622f9 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:40.623027 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642d7e5-46d8-4142-8b52-995bcce0d4c3 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:40.625438 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-1642d7e5-46d8-4142-8b52-995bcce0d4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:40.648563 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69653173-bceb-4f77-a076-3a0465e622f9 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:40.656021 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff34828-e189-43e0-8415-054db3751638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:40.657007 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff34828-e189-43e0-8415-054db3751638 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:40.657381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff34828-e189-43e0-8415-054db3751638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:40.657845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff34828-e189-43e0-8415-054db3751638 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:40.658961 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff34828-e189-43e0-8415-054db3751638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:40.661938 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:40.662104 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff34828-e189-43e0-8415-054db3751638 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:40.711767 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642d7e5-46d8-4142-8b52-995bcce0d4c3 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:40.718163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdedc9-5651-4832-9af1-ce8eae1463dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526c7ad227943d1a2bba7b5e2e039e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:40.718840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdedc9-5651-4832-9af1-ce8eae1463dd service swift] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:40.719213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdedc9-5651-4832-9af1-ce8eae1463dd service swift] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:40.719485 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdedc9-5651-4832-9af1-ce8eae1463dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:40.767069 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1350/2692] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:37:40 2022] POST /identity/v3/projects => generated 357 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:37:40.774142 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff34828-e189-43e0-8415-054db3751638 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:40.811417 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdedc9-5651-4832-9af1-ce8eae1463dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:40.813040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdedc9-5651-4832-9af1-ce8eae1463dd service swift] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:40.824416 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1343/2693] 10.222.0.83 () {60 vars in 1384 bytes} [Fri Sep 23 01:37:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 01:37:40.902340 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff34828-e189-43e0-8415-054db3751638 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:40.912298 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da420f-3537-4801-8de3-86555c2f1d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:40.913460 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da420f-3537-4801-8de3-86555c2f1d5a admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:40.917353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da420f-3537-4801-8de3-86555c2f1d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:40.917353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da420f-3537-4801-8de3-86555c2f1d5a admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:40.917353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da420f-3537-4801-8de3-86555c2f1d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:40.920548 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da420f-3537-4801-8de3-86555c2f1d5a admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:41.135100 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1351/2694] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:37:40 2022] POST /identity/v3/users => generated 285 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:37:41.140554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdedc9-5651-4832-9af1-ce8eae1463dd service swift] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:41.186415 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdedc9-5651-4832-9af1-ce8eae1463dd service swift] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:41.202227 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42c8bf-fb91-444b-9a85-21c3bf7d4e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:41.203201 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42c8bf-fb91-444b-9a85-21c3bf7d4e70 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:41.203634 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42c8bf-fb91-444b-9a85-21c3bf7d4e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:41.204120 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42c8bf-fb91-444b-9a85-21c3bf7d4e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:41.205478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42c8bf-fb91-444b-9a85-21c3bf7d4e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:41.211141 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42c8bf-fb91-444b-9a85-21c3bf7d4e70 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:41.257165 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1344/2695] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:37:41.259663 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da420f-3537-4801-8de3-86555c2f1d5a admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:41.275808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da420f-3537-4801-8de3-86555c2f1d5a admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:41.283159 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0f364-51d1-4d38-add7-68d0d2cbd23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:41.284296 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0f364-51d1-4d38-add7-68d0d2cbd23c admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:41.284782 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0f364-51d1-4d38-add7-68d0d2cbd23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:41.285255 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0f364-51d1-4d38-add7-68d0d2cbd23c admin admin] PATH_INFO: `/v3/projects/9fbcad1e15aa4b688423fd9bc37c9a4f/users/1b893a59b81d4b938f85a8100285bea9/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:41.310650 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0f364-51d1-4d38-add7-68d0d2cbd23c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fbcad1e15aa4b688423fd9bc37c9a4f, user_id=1b893a59b81d4b938f85a8100285bea9, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:41.313763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0f364-51d1-4d38-add7-68d0d2cbd23c admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:41.426209 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1352/2696] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:37:41 2022] PUT /identity/v3/projects/9fbcad1e15aa4b688423fd9bc37c9a4f/users/1b893a59b81d4b938f85a8100285bea9/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:41.433451 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42c8bf-fb91-444b-9a85-21c3bf7d4e70 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:41.449749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42c8bf-fb91-444b-9a85-21c3bf7d4e70 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:41.560632 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f1e9d-0342-4e7e-a783-e7fe40045e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:41.561260 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f1e9d-0342-4e7e-a783-e7fe40045e68 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:41.561604 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f1e9d-0342-4e7e-a783-e7fe40045e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:41.561876 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f1e9d-0342-4e7e-a783-e7fe40045e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:41.562773 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f1e9d-0342-4e7e-a783-e7fe40045e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:41.565445 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f1e9d-0342-4e7e-a783-e7fe40045e68 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:41.577683 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1345/2697] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:37:41.583377 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0f364-51d1-4d38-add7-68d0d2cbd23c admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:41.598835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0f364-51d1-4d38-add7-68d0d2cbd23c admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:41.604032 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd03d2-ac86-4c85-a1e7-8c1f27c0faee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:41.604786 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd03d2-ac86-4c85-a1e7-8c1f27c0faee admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:41.605237 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd03d2-ac86-4c85-a1e7-8c1f27c0faee admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:41.605584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd03d2-ac86-4c85-a1e7-8c1f27c0faee admin admin] PATH_INFO: `/v3/projects/9fbcad1e15aa4b688423fd9bc37c9a4f/users/1b893a59b81d4b938f85a8100285bea9/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:41.607784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd03d2-ac86-4c85-a1e7-8c1f27c0faee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fbcad1e15aa4b688423fd9bc37c9a4f, user_id=1b893a59b81d4b938f85a8100285bea9, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:41.610547 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd03d2-ac86-4c85-a1e7-8c1f27c0faee admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:41.613546 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:41.628323 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1353/2698] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:37:41 2022] PUT /identity/v3/projects/9fbcad1e15aa4b688423fd9bc37c9a4f/users/1b893a59b81d4b938f85a8100285bea9/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:41.650344 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c7bad-3432-4db6-8f89-20dff5ea5af8 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:41.650958 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c7bad-3432-4db6-8f89-20dff5ea5af8 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:41.651451 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c7bad-3432-4db6-8f89-20dff5ea5af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:41.714175 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-ed2c7bad-3432-4db6-8f89-20dff5ea5af8 None None] MFA Rules not processed for user `1b893a59b81d4b938f85a8100285bea9`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:41.716259 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ed2c7bad-3432-4db6-8f89-20dff5ea5af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:41.798176 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:41.868006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1346/2699] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:41 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:37:41.882240 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd03d2-ac86-4c85-a1e7-8c1f27c0faee admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:41.884008 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-1ffd03d2-ac86-4c85-a1e7-8c1f27c0faee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:41.964161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd03d2-ac86-4c85-a1e7-8c1f27c0faee admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:41.969727 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79e2cd-d877-4761-b397-43c6330b0603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:41.970338 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79e2cd-d877-4761-b397-43c6330b0603 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:41.970622 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79e2cd-d877-4761-b397-43c6330b0603 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:41.971027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79e2cd-d877-4761-b397-43c6330b0603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:41.982404 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79e2cd-d877-4761-b397-43c6330b0603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:41.983903 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79e2cd-d877-4761-b397-43c6330b0603 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:42.001187 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1354/2700] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:37:41 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:37:42.303863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c7bad-3432-4db6-8f89-20dff5ea5af8 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:42.306933 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ed2c7bad-3432-4db6-8f89-20dff5ea5af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:42.343340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c7bad-3432-4db6-8f89-20dff5ea5af8 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:42.356744 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27674e-59bc-4ed0-b3a2-bf3dcd080bd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:42.357788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27674e-59bc-4ed0-b3a2-bf3dcd080bd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:42.358267 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27674e-59bc-4ed0-b3a2-bf3dcd080bd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:42.359051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27674e-59bc-4ed0-b3a2-bf3dcd080bd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:42.543181 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27674e-59bc-4ed0-b3a2-bf3dcd080bd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:42.545194 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27674e-59bc-4ed0-b3a2-bf3dcd080bd8 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:42.558414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1347/2701] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:37:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:37:47.313835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79e2cd-d877-4761-b397-43c6330b0603 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:47.316378 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ce79e2cd-d877-4761-b397-43c6330b0603 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:47.478969 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79e2cd-d877-4761-b397-43c6330b0603 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:47.479389 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8358cc3-72b5-4ed0-b455-6772fe8f66e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:47.480994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8358cc3-72b5-4ed0-b455-6772fe8f66e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:47.481482 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8358cc3-72b5-4ed0-b455-6772fe8f66e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:47.481964 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8358cc3-72b5-4ed0-b455-6772fe8f66e6 admin admin] PATH_INFO: `/v3/users/96fa7223000d447aa984f3f0bb021cac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:47.494643 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8358cc3-72b5-4ed0-b455-6772fe8f66e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96fa7223000d447aa984f3f0bb021cac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:47.494643 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8358cc3-72b5-4ed0-b455-6772fe8f66e6 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:47.822466 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-b8358cc3-72b5-4ed0-b455-6772fe8f66e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96fa7223000d447aa984f3f0bb021cac'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:47.911900 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-b8358cc3-72b5-4ed0-b455-6772fe8f66e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96fa7223000d447aa984f3f0bb021cac'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:47.915611 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-b8358cc3-72b5-4ed0-b455-6772fe8f66e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96fa7223000d447aa984f3f0bb021cac'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:47.933266 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-b8358cc3-72b5-4ed0-b455-6772fe8f66e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96fa7223000d447aa984f3f0bb021cac'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:47.934277 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-b8358cc3-72b5-4ed0-b455-6772fe8f66e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96fa7223000d447aa984f3f0bb021cac'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:47.962234 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1355/2702] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:37:47 2022] DELETE /identity/v3/users/96fa7223000d447aa984f3f0bb021cac => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:47.964019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bde98-e18e-40eb-842e-367af2a466c4 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:47.964699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bde98-e18e-40eb-842e-367af2a466c4 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:47.964699 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bde98-e18e-40eb-842e-367af2a466c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:47.995442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-262bde98-e18e-40eb-842e-367af2a466c4 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:47.997334 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-262bde98-e18e-40eb-842e-367af2a466c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:48.109388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1348/2703] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:37:48.115650 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8358cc3-72b5-4ed0-b455-6772fe8f66e6 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:48.125370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b8358cc3-72b5-4ed0-b455-6772fe8f66e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:48.149195 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:48.201566 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8358cc3-72b5-4ed0-b455-6772fe8f66e6 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:48.206442 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d8b5b-e2ee-4d91-b1c4-9e3473bad3cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:48.207136 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d8b5b-e2ee-4d91-b1c4-9e3473bad3cd service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:48.207470 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d8b5b-e2ee-4d91-b1c4-9e3473bad3cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:48.207747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d8b5b-e2ee-4d91-b1c4-9e3473bad3cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:48.222685 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d8b5b-e2ee-4d91-b1c4-9e3473bad3cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:48.224451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d8b5b-e2ee-4d91-b1c4-9e3473bad3cd service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:48.238803 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1356/2704] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:37:49.107922 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bde98-e18e-40eb-842e-367af2a466c4 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:49.111402 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-262bde98-e18e-40eb-842e-367af2a466c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:49.138831 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bde98-e18e-40eb-842e-367af2a466c4 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:49.156738 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d78e76-8a0f-46b7-85db-179d37daa311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:49.156738 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d78e76-8a0f-46b7-85db-179d37daa311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:49.156738 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d78e76-8a0f-46b7-85db-179d37daa311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:49.156738 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d78e76-8a0f-46b7-85db-179d37daa311 admin admin] PATH_INFO: `/v3/projects/2bfb66434d1c408db38f08634cc4f636` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:49.157993 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d78e76-8a0f-46b7-85db-179d37daa311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bfb66434d1c408db38f08634cc4f636)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:49.160066 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d78e76-8a0f-46b7-85db-179d37daa311 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:49.361541 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-98d78e76-8a0f-46b7-85db-179d37daa311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bfb66434d1c408db38f08634cc4f636', 'request_id': 'req-98d78e76-8a0f-46b7-85db-179d37daa311'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:49.558019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-98d78e76-8a0f-46b7-85db-179d37daa311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bfb66434d1c408db38f08634cc4f636', 'request_id': 'req-98d78e76-8a0f-46b7-85db-179d37daa311'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:49.558019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-98d78e76-8a0f-46b7-85db-179d37daa311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bfb66434d1c408db38f08634cc4f636', 'request_id': 'req-98d78e76-8a0f-46b7-85db-179d37daa311'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:49.558019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:49.565752 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-98d78e76-8a0f-46b7-85db-179d37daa311 admin admin] The token cache is being invalidate because project 2bfb66434d1c408db38f08634cc4f636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:37:49.566115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-98d78e76-8a0f-46b7-85db-179d37daa311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:49.566901 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-98d78e76-8a0f-46b7-85db-179d37daa311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:37:49.568880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1349/2705] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:37:49 2022] DELETE /identity/v3/projects/2bfb66434d1c408db38f08634cc4f636 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:49.573811 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560a28a-2c45-434d-9983-d655852b7e9b None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:49.574508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560a28a-2c45-434d-9983-d655852b7e9b None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:49.574508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560a28a-2c45-434d-9983-d655852b7e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:49.596700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-9560a28a-2c45-434d-9983-d655852b7e9b None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:49.598020 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-9560a28a-2c45-434d-9983-d655852b7e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:49.705141 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1357/2706] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:49.715004 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f5d41-ef1c-40dc-88ca-5c753d5e1c84 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:49.715798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f5d41-ef1c-40dc-88ca-5c753d5e1c84 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:49.716658 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f5d41-ef1c-40dc-88ca-5c753d5e1c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:49.742262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-a40f5d41-ef1c-40dc-88ca-5c753d5e1c84 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:49.743874 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a40f5d41-ef1c-40dc-88ca-5c753d5e1c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:49.757229 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1350/2707] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:49.762721 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560a28a-2c45-434d-9983-d655852b7e9b None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:49.793921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560a28a-2c45-434d-9983-d655852b7e9b None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:49.802508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edbb2e-5114-4647-9f8e-c2a42d62c3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:49.805700 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edbb2e-5114-4647-9f8e-c2a42d62c3ba admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:49.806215 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edbb2e-5114-4647-9f8e-c2a42d62c3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:49.806745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edbb2e-5114-4647-9f8e-c2a42d62c3ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:49.807564 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edbb2e-5114-4647-9f8e-c2a42d62c3ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:37:49.807942 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edbb2e-5114-4647-9f8e-c2a42d62c3ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:49.810150 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edbb2e-5114-4647-9f8e-c2a42d62c3ba admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:49.841991 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f5d41-ef1c-40dc-88ca-5c753d5e1c84 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:49.850220 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1358/2708] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:37:49.860030 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f5d41-ef1c-40dc-88ca-5c753d5e1c84 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:49.869393 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7addbf-59c6-49ee-ae75-1a0666b91a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:49.870031 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7addbf-59c6-49ee-ae75-1a0666b91a70 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:49.870307 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7addbf-59c6-49ee-ae75-1a0666b91a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:49.870578 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7addbf-59c6-49ee-ae75-1a0666b91a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:49.871279 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7addbf-59c6-49ee-ae75-1a0666b91a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:49.873221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7addbf-59c6-49ee-ae75-1a0666b91a70 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:50.036722 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1351/2709] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:37:49 2022] POST /identity/v3/projects => generated 369 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:37:50.039579 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edbb2e-5114-4647-9f8e-c2a42d62c3ba admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:50.050181 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edbb2e-5114-4647-9f8e-c2a42d62c3ba admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:50.166431 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d62dd-9fed-45a4-a7bb-efff2188f360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:50.167141 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d62dd-9fed-45a4-a7bb-efff2188f360 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:50.167421 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d62dd-9fed-45a4-a7bb-efff2188f360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:50.167731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d62dd-9fed-45a4-a7bb-efff2188f360 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:50.169478 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d62dd-9fed-45a4-a7bb-efff2188f360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:50.171669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d62dd-9fed-45a4-a7bb-efff2188f360 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:50.322299 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1359/2710] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:37:50 2022] POST /identity/v3/users => generated 285 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:37:50.326519 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7addbf-59c6-49ee-ae75-1a0666b91a70 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:50.343258 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7addbf-59c6-49ee-ae75-1a0666b91a70 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:50.348647 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd7b7a-25ed-4031-8284-43a8187ef517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:50.349438 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd7b7a-25ed-4031-8284-43a8187ef517 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:50.350006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd7b7a-25ed-4031-8284-43a8187ef517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:50.350372 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd7b7a-25ed-4031-8284-43a8187ef517 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:50.351182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd7b7a-25ed-4031-8284-43a8187ef517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:50.353629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd7b7a-25ed-4031-8284-43a8187ef517 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:50.373109 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1352/2711] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:37:50.378525 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d62dd-9fed-45a4-a7bb-efff2188f360 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:50.403274 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d62dd-9fed-45a4-a7bb-efff2188f360 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:50.417508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029a1b7-1bd8-46f1-bc36-1de99bf1f34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:50.418911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029a1b7-1bd8-46f1-bc36-1de99bf1f34a admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:50.420590 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029a1b7-1bd8-46f1-bc36-1de99bf1f34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:50.420590 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029a1b7-1bd8-46f1-bc36-1de99bf1f34a admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:50.420590 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029a1b7-1bd8-46f1-bc36-1de99bf1f34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:50.422704 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029a1b7-1bd8-46f1-bc36-1de99bf1f34a admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:50.442305 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1360/2712] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:37:50.447218 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd7b7a-25ed-4031-8284-43a8187ef517 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:50.461041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd7b7a-25ed-4031-8284-43a8187ef517 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:50.472740 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ac4aa-0e8f-402a-81e7-3b048a43001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:50.473841 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ac4aa-0e8f-402a-81e7-3b048a43001c admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:50.474187 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ac4aa-0e8f-402a-81e7-3b048a43001c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:50.474479 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ac4aa-0e8f-402a-81e7-3b048a43001c admin admin] PATH_INFO: `/v3/projects/01ce4412dd824b3398df390c8f131ac1/users/8de0ae3cdffc405195f3c06fed86188b/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:50.502894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ac4aa-0e8f-402a-81e7-3b048a43001c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ce4412dd824b3398df390c8f131ac1, user_id=8de0ae3cdffc405195f3c06fed86188b, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:50.510292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ac4aa-0e8f-402a-81e7-3b048a43001c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:50.617731 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1353/2713] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:37:50 2022] PUT /identity/v3/projects/01ce4412dd824b3398df390c8f131ac1/users/8de0ae3cdffc405195f3c06fed86188b/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:37:50.632201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b09d0-3b99-4e60-b319-1fa8cc58e037 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:50.633209 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b09d0-3b99-4e60-b319-1fa8cc58e037 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:50.633209 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b09d0-3b99-4e60-b319-1fa8cc58e037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:50.683483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-394b09d0-3b99-4e60-b319-1fa8cc58e037 None None] MFA Rules not processed for user `8de0ae3cdffc405195f3c06fed86188b`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:37:50.685560 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-394b09d0-3b99-4e60-b319-1fa8cc58e037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:50.715399 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:50.830025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1361/2714] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:37:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:37:50.846194 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ac4aa-0e8f-402a-81e7-3b048a43001c admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:37:50.848362 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f05ac4aa-0e8f-402a-81e7-3b048a43001c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:37:50.984266 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ac4aa-0e8f-402a-81e7-3b048a43001c admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:37:50.988715 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bfe3a-af91-4e03-95c5-11b2564b19a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5b3a7a9a08e40718980143d7c4880ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:37:50.989347 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bfe3a-af91-4e03-95c5-11b2564b19a2 service glance] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:37:50.989678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bfe3a-af91-4e03-95c5-11b2564b19a2 service glance] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:37:50.989903 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bfe3a-af91-4e03-95c5-11b2564b19a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:37:51.011682 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bfe3a-af91-4e03-95c5-11b2564b19a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:37:51.013379 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bfe3a-af91-4e03-95c5-11b2564b19a2 service glance] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:37:51.032155 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1354/2715] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:37:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:38:00.881183 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=21 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:01.019286 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=55,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:01.969687 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd69ed-842a-4698-b85b-b9319e212172 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:01.970274 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd69ed-842a-4698-b85b-b9319e212172 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:01.970274 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd69ed-842a-4698-b85b-b9319e212172 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:01.972075 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1362/2716] 10.222.0.83 () {54 vars in 921 bytes} [Fri Sep 23 01:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 01:38:01.988147 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c5577-77af-4334-b4c2-17ae72ba0b62 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:01.988681 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c5577-77af-4334-b4c2-17ae72ba0b62 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:01.989067 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c5577-77af-4334-b4c2-17ae72ba0b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:02.030308 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-fa0c5577-77af-4334-b4c2-17ae72ba0b62 None None] MFA Rules not processed for user `824648d693af4b44ae5df853a3d258f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:02.032058 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-fa0c5577-77af-4334-b4c2-17ae72ba0b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:02.152967 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1355/2717] 10.222.0.83 () {58 vars in 1018 bytes} [Fri Sep 23 01:38:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:38:02.166622 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd69ed-842a-4698-b85b-b9319e212172 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:02.168534 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d5bd69ed-842a-4698-b85b-b9319e212172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:02.184746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd69ed-842a-4698-b85b-b9319e212172 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:02.188601 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff914d-220b-41a9-9bba-a0f2f6717e24 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5b3a7a9a08e40718980143d7c4880ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:02.189257 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff914d-220b-41a9-9bba-a0f2f6717e24 service glance] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:02.189525 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff914d-220b-41a9-9bba-a0f2f6717e24 service glance] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:02.189796 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff914d-220b-41a9-9bba-a0f2f6717e24 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:02.201627 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff914d-220b-41a9-9bba-a0f2f6717e24 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:02.203164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff914d-220b-41a9-9bba-a0f2f6717e24 service glance] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:02.222724 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1363/2718] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:38:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:38:02.441652 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba27b8-eb77-4bdf-ba77-8c802e8916a8 None None] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:02.442177 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba27b8-eb77-4bdf-ba77-8c802e8916a8 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:02.442638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba27b8-eb77-4bdf-ba77-8c802e8916a8 None None] PATH_INFO: `/` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:02.445041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1356/2719] 10.222.0.83 () {54 vars in 921 bytes} [Fri Sep 23 01:38:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:38:02.454071 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5dba8-81a6-4ce6-abcb-a6159a62864c None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:02.454689 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5dba8-81a6-4ce6-abcb-a6159a62864c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:02.455004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5dba8-81a6-4ce6-abcb-a6159a62864c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:02.484004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-6fd5dba8-81a6-4ce6-abcb-a6159a62864c None None] MFA Rules not processed for user `be2b2806686c4a15b1ace8b6245c4e28`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:02.485244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-6fd5dba8-81a6-4ce6-abcb-a6159a62864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:02.564973 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1364/2720] 10.222.0.83 () {58 vars in 1018 bytes} [Fri Sep 23 01:38:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:38:02.581761 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba27b8-eb77-4bdf-ba77-8c802e8916a8 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:02.586547 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-b4ba27b8-eb77-4bdf-ba77-8c802e8916a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:02.613835 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba27b8-eb77-4bdf-ba77-8c802e8916a8 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:02.617740 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a870be-f3ce-467d-bc72-10b2c8c55d5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:02.618525 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a870be-f3ce-467d-bc72-10b2c8c55d5f service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:02.618842 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a870be-f3ce-467d-bc72-10b2c8c55d5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:02.619113 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a870be-f3ce-467d-bc72-10b2c8c55d5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:02.627460 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a870be-f3ce-467d-bc72-10b2c8c55d5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:02.628994 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a870be-f3ce-467d-bc72-10b2c8c55d5f service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:02.639314 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1357/2721] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:38:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:38:02.762358 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee98718-fbe0-4d60-87db-0d92a679afb2 None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:02.763206 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee98718-fbe0-4d60-87db-0d92a679afb2 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:02.763713 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee98718-fbe0-4d60-87db-0d92a679afb2 None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:02.766336 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1365/2722] 10.222.0.83 () {54 vars in 921 bytes} [Fri Sep 23 01:38:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:38:02.773062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3468030-a6b0-4d09-8c81-8c719528d0e0 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:02.773443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3468030-a6b0-4d09-8c81-8c719528d0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:02.773773 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3468030-a6b0-4d09-8c81-8c719528d0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:02.802862 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-f3468030-a6b0-4d09-8c81-8c719528d0e0 None None] MFA Rules not processed for user `824648d693af4b44ae5df853a3d258f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:02.804169 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f3468030-a6b0-4d09-8c81-8c719528d0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:02.815188 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1358/2723] 10.222.0.83 () {58 vars in 1018 bytes} [Fri Sep 23 01:38:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:38:02.827274 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee98718-fbe0-4d60-87db-0d92a679afb2 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:02.844480 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee98718-fbe0-4d60-87db-0d92a679afb2 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:02.849478 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaddc15-de72-4791-840f-aa78382dc3a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:02.850573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaddc15-de72-4791-840f-aa78382dc3a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:02.850931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaddc15-de72-4791-840f-aa78382dc3a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:02.851240 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaddc15-de72-4791-840f-aa78382dc3a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:02.863257 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaddc15-de72-4791-840f-aa78382dc3a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:02.864760 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaddc15-de72-4791-840f-aa78382dc3a3 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:02.878027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1366/2724] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:38:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:38:05.931094 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3468030-a6b0-4d09-8c81-8c719528d0e0 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:05.932565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f3468030-a6b0-4d09-8c81-8c719528d0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:06.007426 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3468030-a6b0-4d09-8c81-8c719528d0e0 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:06.012393 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d139f0-a0d9-4556-98cf-5397540d123f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:06.013115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d139f0-a0d9-4556-98cf-5397540d123f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:06.013389 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d139f0-a0d9-4556-98cf-5397540d123f admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:06.013684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d139f0-a0d9-4556-98cf-5397540d123f admin admin] PATH_INFO: `/v3/users/e7fab584f9ce452ba3d53e34cee4cb0e` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:06.014966 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d139f0-a0d9-4556-98cf-5397540d123f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7fab584f9ce452ba3d53e34cee4cb0e)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:06.016927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d139f0-a0d9-4556-98cf-5397540d123f admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:06.261700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-52d139f0-a0d9-4556-98cf-5397540d123f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7fab584f9ce452ba3d53e34cee4cb0e'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:06.264056 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:06.280745 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-52d139f0-a0d9-4556-98cf-5397540d123f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7fab584f9ce452ba3d53e34cee4cb0e'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:06.388897 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-52d139f0-a0d9-4556-98cf-5397540d123f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7fab584f9ce452ba3d53e34cee4cb0e'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:06.389531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-52d139f0-a0d9-4556-98cf-5397540d123f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7fab584f9ce452ba3d53e34cee4cb0e'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:06.397306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-52d139f0-a0d9-4556-98cf-5397540d123f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7fab584f9ce452ba3d53e34cee4cb0e'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:06.403583 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1359/2725] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:38:05 2022] DELETE /identity/v3/users/e7fab584f9ce452ba3d53e34cee4cb0e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:06.408434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349ab67-c0a2-4e89-8fac-572f5151ed79 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:06.415232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349ab67-c0a2-4e89-8fac-572f5151ed79 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:06.415232 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349ab67-c0a2-4e89-8fac-572f5151ed79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:06.430455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-f349ab67-c0a2-4e89-8fac-572f5151ed79 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:06.432151 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f349ab67-c0a2-4e89-8fac-572f5151ed79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:06.504324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1367/2726] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:38:06.518466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d139f0-a0d9-4556-98cf-5397540d123f admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:06.520091 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-52d139f0-a0d9-4556-98cf-5397540d123f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:06.593973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d139f0-a0d9-4556-98cf-5397540d123f admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:06.597629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd99aa-af27-4f62-9065-2dc6cff71399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:06.600959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd99aa-af27-4f62-9065-2dc6cff71399 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:06.601236 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd99aa-af27-4f62-9065-2dc6cff71399 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:06.601506 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd99aa-af27-4f62-9065-2dc6cff71399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:06.612571 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd99aa-af27-4f62-9065-2dc6cff71399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:06.614044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd99aa-af27-4f62-9065-2dc6cff71399 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:06.626040 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1360/2727] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:38:07.199370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349ab67-c0a2-4e89-8fac-572f5151ed79 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:07.200540 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f349ab67-c0a2-4e89-8fac-572f5151ed79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:07.221740 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349ab67-c0a2-4e89-8fac-572f5151ed79 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:07.227749 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508141b4-a5bf-4405-bf5a-c9e7ecb02cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:07.228027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508141b4-a5bf-4405-bf5a-c9e7ecb02cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:07.228457 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508141b4-a5bf-4405-bf5a-c9e7ecb02cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:07.228766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508141b4-a5bf-4405-bf5a-c9e7ecb02cba admin admin] PATH_INFO: `/v3/projects/5bebddf1324f4edc951bc794d8af2971` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:07.230186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508141b4-a5bf-4405-bf5a-c9e7ecb02cba admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bebddf1324f4edc951bc794d8af2971)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:07.232669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508141b4-a5bf-4405-bf5a-c9e7ecb02cba admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:07.361063 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-508141b4-a5bf-4405-bf5a-c9e7ecb02cba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bebddf1324f4edc951bc794d8af2971', 'request_id': 'req-508141b4-a5bf-4405-bf5a-c9e7ecb02cba'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:07.480609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-508141b4-a5bf-4405-bf5a-c9e7ecb02cba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bebddf1324f4edc951bc794d8af2971', 'request_id': 'req-508141b4-a5bf-4405-bf5a-c9e7ecb02cba'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:07.487240 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-508141b4-a5bf-4405-bf5a-c9e7ecb02cba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bebddf1324f4edc951bc794d8af2971', 'request_id': 'req-508141b4-a5bf-4405-bf5a-c9e7ecb02cba'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:07.500867 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-508141b4-a5bf-4405-bf5a-c9e7ecb02cba admin admin] The token cache is being invalidate because project 5bebddf1324f4edc951bc794d8af2971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:38:07.501253 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-508141b4-a5bf-4405-bf5a-c9e7ecb02cba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:07.502169 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-508141b4-a5bf-4405-bf5a-c9e7ecb02cba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:07.504815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1368/2728] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:38:07 2022] DELETE /identity/v3/projects/5bebddf1324f4edc951bc794d8af2971 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:07.509159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd99aa-af27-4f62-9065-2dc6cff71399 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:07.521722 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd99aa-af27-4f62-9065-2dc6cff71399 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:07.588145 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5010a19-c942-498b-9ec4-473d48cde56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:07.588841 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5010a19-c942-498b-9ec4-473d48cde56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:07.589055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5010a19-c942-498b-9ec4-473d48cde56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:07.589374 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5010a19-c942-498b-9ec4-473d48cde56d admin admin] PATH_INFO: `/v3/users/1b893a59b81d4b938f85a8100285bea9` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:07.590497 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5010a19-c942-498b-9ec4-473d48cde56d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b893a59b81d4b938f85a8100285bea9)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:07.592476 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5010a19-c942-498b-9ec4-473d48cde56d admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:07.595569 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8feb1f-1433-4079-8748-b774c5010338 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:07.595847 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8feb1f-1433-4079-8748-b774c5010338 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:07.596116 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8feb1f-1433-4079-8748-b774c5010338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:07.610483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:07.621660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-5d8feb1f-1433-4079-8748-b774c5010338 None None] MFA Rules not processed for user `f2cea4c08f324769bf6dcea58c9394b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:07.626566 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-5d8feb1f-1433-4079-8748-b774c5010338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:07.685801 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1369/2729] 10.222.0.83 () {58 vars in 1009 bytes} [Fri Sep 23 01:38:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:38:07.699185 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8feb1f-1433-4079-8748-b774c5010338 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:07.700857 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-5d8feb1f-1433-4079-8748-b774c5010338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:07.783661 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8feb1f-1433-4079-8748-b774c5010338 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:07.791319 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaea025-f3cb-4437-80ae-3fbe2daa34de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526c7ad227943d1a2bba7b5e2e039e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:07.791941 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaea025-f3cb-4437-80ae-3fbe2daa34de service swift] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:07.792249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaea025-f3cb-4437-80ae-3fbe2daa34de service swift] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:07.792523 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaea025-f3cb-4437-80ae-3fbe2daa34de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:07.801829 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaea025-f3cb-4437-80ae-3fbe2daa34de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:07.803565 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaea025-f3cb-4437-80ae-3fbe2daa34de service swift] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:07.813973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a5010a19-c942-498b-9ec4-473d48cde56d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b893a59b81d4b938f85a8100285bea9'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:07.814872 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1370/2730] 10.222.0.83 () {60 vars in 1384 bytes} [Fri Sep 23 01:38:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 01:38:07.835412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a5010a19-c942-498b-9ec4-473d48cde56d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b893a59b81d4b938f85a8100285bea9'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:07.845078 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:07.938049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a5010a19-c942-498b-9ec4-473d48cde56d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b893a59b81d4b938f85a8100285bea9'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:07.939010 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a5010a19-c942-498b-9ec4-473d48cde56d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b893a59b81d4b938f85a8100285bea9'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:07.948703 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a5010a19-c942-498b-9ec4-473d48cde56d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b893a59b81d4b938f85a8100285bea9'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:07.957528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1361/2731] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:38:07 2022] DELETE /identity/v3/users/1b893a59b81d4b938f85a8100285bea9 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:08.539408 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaea025-f3cb-4437-80ae-3fbe2daa34de service swift] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:08.544875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-eeaea025-f3cb-4437-80ae-3fbe2daa34de service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:08.559467 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaea025-f3cb-4437-80ae-3fbe2daa34de service swift] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:08.655606 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a165b80-868f-4116-b03a-0001e5c27780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:08.657632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a165b80-868f-4116-b03a-0001e5c27780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:08.658431 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a165b80-868f-4116-b03a-0001e5c27780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:08.659393 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a165b80-868f-4116-b03a-0001e5c27780 admin admin] PATH_INFO: `/v3/projects/9fbcad1e15aa4b688423fd9bc37c9a4f` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:08.661121 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a165b80-868f-4116-b03a-0001e5c27780 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fbcad1e15aa4b688423fd9bc37c9a4f)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:08.663645 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a165b80-868f-4116-b03a-0001e5c27780 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:08.831620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:08.849421 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-8a165b80-868f-4116-b03a-0001e5c27780 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fbcad1e15aa4b688423fd9bc37c9a4f', 'request_id': 'req-8a165b80-868f-4116-b03a-0001e5c27780'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:08.920394 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-8a165b80-868f-4116-b03a-0001e5c27780 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fbcad1e15aa4b688423fd9bc37c9a4f', 'request_id': 'req-8a165b80-868f-4116-b03a-0001e5c27780'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:08.935092 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-8a165b80-868f-4116-b03a-0001e5c27780 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fbcad1e15aa4b688423fd9bc37c9a4f', 'request_id': 'req-8a165b80-868f-4116-b03a-0001e5c27780'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:08.954383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-8a165b80-868f-4116-b03a-0001e5c27780 admin admin] The token cache is being invalidate because project 9fbcad1e15aa4b688423fd9bc37c9a4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:38:08.955203 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-8a165b80-868f-4116-b03a-0001e5c27780 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:08.955563 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-8a165b80-868f-4116-b03a-0001e5c27780 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:08.957342 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1371/2732] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:38:08 2022] DELETE /identity/v3/projects/9fbcad1e15aa4b688423fd9bc37c9a4f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:08.962399 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2538920-945f-4287-b457-b437dbaf6c09 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:08.964051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2538920-945f-4287-b457-b437dbaf6c09 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:08.964738 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2538920-945f-4287-b457-b437dbaf6c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:08.991575 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-e2538920-945f-4287-b457-b437dbaf6c09 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:08.993159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e2538920-945f-4287-b457-b437dbaf6c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:09.070423 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1362/2733] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:38:09.080350 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8203cb-fb89-43c9-9276-22e18b26b9ff None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:09.080728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8203cb-fb89-43c9-9276-22e18b26b9ff None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:09.081009 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8203cb-fb89-43c9-9276-22e18b26b9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:09.105216 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-af8203cb-fb89-43c9-9276-22e18b26b9ff None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:09.106525 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-af8203cb-fb89-43c9-9276-22e18b26b9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:09.115285 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1372/2734] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:38:09.119835 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2538920-945f-4287-b457-b437dbaf6c09 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:09.137056 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2538920-945f-4287-b457-b437dbaf6c09 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:09.145295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752808f9-00ee-4251-810e-8d8f3ba40d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:09.146696 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752808f9-00ee-4251-810e-8d8f3ba40d39 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:09.147558 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752808f9-00ee-4251-810e-8d8f3ba40d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:09.148297 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752808f9-00ee-4251-810e-8d8f3ba40d39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:09.148991 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752808f9-00ee-4251-810e-8d8f3ba40d39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:38:09.149298 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752808f9-00ee-4251-810e-8d8f3ba40d39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:09.151911 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752808f9-00ee-4251-810e-8d8f3ba40d39 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:09.247448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1363/2735] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:38:09.251201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8203cb-fb89-43c9-9276-22e18b26b9ff None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:09.266710 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8203cb-fb89-43c9-9276-22e18b26b9ff None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:09.280912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15dab6-6a88-419a-82da-360126a9cf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:09.287519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15dab6-6a88-419a-82da-360126a9cf74 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:09.287519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15dab6-6a88-419a-82da-360126a9cf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:09.287519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15dab6-6a88-419a-82da-360126a9cf74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:09.287519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15dab6-6a88-419a-82da-360126a9cf74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:09.287519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15dab6-6a88-419a-82da-360126a9cf74 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:09.431994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1373/2736] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:38:09 2022] POST /identity/v3/projects => generated 391 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:38:09.433458 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752808f9-00ee-4251-810e-8d8f3ba40d39 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:09.453048 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752808f9-00ee-4251-810e-8d8f3ba40d39 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:09.623242 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87218049-4e71-4b73-8a43-427dd94c74e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:09.624329 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87218049-4e71-4b73-8a43-427dd94c74e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:09.624794 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87218049-4e71-4b73-8a43-427dd94c74e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:09.625253 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87218049-4e71-4b73-8a43-427dd94c74e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:09.625879 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87218049-4e71-4b73-8a43-427dd94c74e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:09.627869 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87218049-4e71-4b73-8a43-427dd94c74e6 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:09.737106 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1364/2737] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:38:09 2022] POST /identity/v3/users => generated 296 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:38:09.741547 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15dab6-6a88-419a-82da-360126a9cf74 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:09.753375 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15dab6-6a88-419a-82da-360126a9cf74 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:09.758686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d170c-1e86-49e2-bfad-97b901e76d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:09.760655 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d170c-1e86-49e2-bfad-97b901e76d2e admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:09.760808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d170c-1e86-49e2-bfad-97b901e76d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:09.761011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d170c-1e86-49e2-bfad-97b901e76d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:09.761658 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d170c-1e86-49e2-bfad-97b901e76d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:09.763299 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d170c-1e86-49e2-bfad-97b901e76d2e admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:09.774086 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1374/2738] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:38:09.778284 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87218049-4e71-4b73-8a43-427dd94c74e6 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:09.790023 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87218049-4e71-4b73-8a43-427dd94c74e6 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:09.795006 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10a95d-2bf0-4a73-9aa6-88099c67460f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:09.795639 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10a95d-2bf0-4a73-9aa6-88099c67460f admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:09.795998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10a95d-2bf0-4a73-9aa6-88099c67460f admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:09.796325 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10a95d-2bf0-4a73-9aa6-88099c67460f admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:09.797019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10a95d-2bf0-4a73-9aa6-88099c67460f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:09.799215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10a95d-2bf0-4a73-9aa6-88099c67460f admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:09.814493 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1365/2739] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:38:09.827906 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d170c-1e86-49e2-bfad-97b901e76d2e admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:09.842415 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d170c-1e86-49e2-bfad-97b901e76d2e admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:09.847405 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cc779-78bb-4832-ab9c-f14bffa52a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:09.848086 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cc779-78bb-4832-ab9c-f14bffa52a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:09.848363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cc779-78bb-4832-ab9c-f14bffa52a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:09.848784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cc779-78bb-4832-ab9c-f14bffa52a5b admin admin] PATH_INFO: `/v3/projects/25a5a236dfe84b3ca6c5ae21a588b6a5/users/46fb5f68def04e73a4f09ebe0fd2207c/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:09.868325 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cc779-78bb-4832-ab9c-f14bffa52a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a5a236dfe84b3ca6c5ae21a588b6a5, user_id=46fb5f68def04e73a4f09ebe0fd2207c, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:09.871916 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cc779-78bb-4832-ab9c-f14bffa52a5b admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:09.984812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1375/2740] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:38:09 2022] PUT /identity/v3/projects/25a5a236dfe84b3ca6c5ae21a588b6a5/users/46fb5f68def04e73a4f09ebe0fd2207c/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:38:09.990679 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159c96d-9a25-4ea7-ad9d-1649dee06285 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:09.990679 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159c96d-9a25-4ea7-ad9d-1649dee06285 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:09.990679 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159c96d-9a25-4ea7-ad9d-1649dee06285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:10.035718 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-9159c96d-9a25-4ea7-ad9d-1649dee06285 None None] MFA Rules not processed for user `46fb5f68def04e73a4f09ebe0fd2207c`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:10.037094 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-9159c96d-9a25-4ea7-ad9d-1649dee06285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:10.122756 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:10.152186 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1366/2741] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:38:10.156565 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cc779-78bb-4832-ab9c-f14bffa52a5b admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:10.239952 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cc779-78bb-4832-ab9c-f14bffa52a5b admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:10.245819 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce847595-bc39-4e7d-b621-d19a92d99bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:10.246445 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce847595-bc39-4e7d-b621-d19a92d99bec admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:10.246758 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce847595-bc39-4e7d-b621-d19a92d99bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:10.247031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce847595-bc39-4e7d-b621-d19a92d99bec admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:10.247678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce847595-bc39-4e7d-b621-d19a92d99bec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:10.249671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce847595-bc39-4e7d-b621-d19a92d99bec admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:10.937894 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1376/2742] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:38:10 2022] POST /identity/v3/projects => generated 391 bytes in 780 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:38:10.939093 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159c96d-9a25-4ea7-ad9d-1649dee06285 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:10.951652 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159c96d-9a25-4ea7-ad9d-1649dee06285 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:11.036350 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3cd3-c2ad-4616-829a-fdf7c5880b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:11.037194 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3cd3-c2ad-4616-829a-fdf7c5880b3f admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:11.037291 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3cd3-c2ad-4616-829a-fdf7c5880b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:11.037546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3cd3-c2ad-4616-829a-fdf7c5880b3f admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:11.038289 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e3cd3-c2ad-4616-829a-fdf7c5880b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:11.043264 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e3cd3-c2ad-4616-829a-fdf7c5880b3f admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:11.323381 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1367/2743] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:38:10 2022] POST /identity/v3/users => generated 302 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:38:11.327718 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce847595-bc39-4e7d-b621-d19a92d99bec admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:11.338822 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce847595-bc39-4e7d-b621-d19a92d99bec admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:11.343984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3df964-d222-4a6f-ad7f-8a129758f833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:11.344966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3df964-d222-4a6f-ad7f-8a129758f833 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:11.345272 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3df964-d222-4a6f-ad7f-8a129758f833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:11.345574 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3df964-d222-4a6f-ad7f-8a129758f833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:11.347034 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3df964-d222-4a6f-ad7f-8a129758f833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:11.349177 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3df964-d222-4a6f-ad7f-8a129758f833 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:11.367189 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1377/2744] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:38:11.368176 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3cd3-c2ad-4616-829a-fdf7c5880b3f admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:11.380820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3cd3-c2ad-4616-829a-fdf7c5880b3f admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:11.387997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640088dc-1f60-4d50-adcc-043b6c54ad1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:11.387997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640088dc-1f60-4d50-adcc-043b6c54ad1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:11.387997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640088dc-1f60-4d50-adcc-043b6c54ad1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:11.387997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640088dc-1f60-4d50-adcc-043b6c54ad1c admin admin] PATH_INFO: `/v3/projects/eb7c35a271d94e12839e0f79f3a29f2d/users/6e25154569cf4f38a6bc7153dbb910ab/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:11.413512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640088dc-1f60-4d50-adcc-043b6c54ad1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7c35a271d94e12839e0f79f3a29f2d, user_id=6e25154569cf4f38a6bc7153dbb910ab, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:11.417047 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640088dc-1f60-4d50-adcc-043b6c54ad1c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:11.534241 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1368/2745] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:38:11 2022] PUT /identity/v3/projects/eb7c35a271d94e12839e0f79f3a29f2d/users/6e25154569cf4f38a6bc7153dbb910ab/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:11.541309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3df964-d222-4a6f-ad7f-8a129758f833 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:11.549246 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3df964-d222-4a6f-ad7f-8a129758f833 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:11.633537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:11.654092 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7113a-c6c8-451b-ac60-1d1b72fab3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:11.655197 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7113a-c6c8-451b-ac60-1d1b72fab3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:11.655690 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7113a-c6c8-451b-ac60-1d1b72fab3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:11.656179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7113a-c6c8-451b-ac60-1d1b72fab3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:11.657243 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7113a-c6c8-451b-ac60-1d1b72fab3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:11.659054 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7113a-c6c8-451b-ac60-1d1b72fab3a4 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:11.675105 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1378/2746] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:38:11.675823 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640088dc-1f60-4d50-adcc-043b6c54ad1c admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:11.687070 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640088dc-1f60-4d50-adcc-043b6c54ad1c admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:11.692676 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3313f-2f66-4083-866b-d2cd2046c724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:11.694970 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3313f-2f66-4083-866b-d2cd2046c724 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:11.694970 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3313f-2f66-4083-866b-d2cd2046c724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:11.694970 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3313f-2f66-4083-866b-d2cd2046c724 admin admin] PATH_INFO: `/v3/projects/eb7c35a271d94e12839e0f79f3a29f2d/users/6e25154569cf4f38a6bc7153dbb910ab/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:11.695962 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3313f-2f66-4083-866b-d2cd2046c724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7c35a271d94e12839e0f79f3a29f2d, user_id=6e25154569cf4f38a6bc7153dbb910ab, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:11.699632 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3313f-2f66-4083-866b-d2cd2046c724 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:11.712031 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1369/2747] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:38:11 2022] PUT /identity/v3/projects/eb7c35a271d94e12839e0f79f3a29f2d/users/6e25154569cf4f38a6bc7153dbb910ab/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:11.723363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f1f3a-f94e-4de8-ab98-2431d5d5b2ab None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:11.723649 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f1f3a-f94e-4de8-ab98-2431d5d5b2ab None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:11.723981 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f1f3a-f94e-4de8-ab98-2431d5d5b2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:11.761325 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-d82f1f3a-f94e-4de8-ab98-2431d5d5b2ab None None] MFA Rules not processed for user `6e25154569cf4f38a6bc7153dbb910ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:11.762815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d82f1f3a-f94e-4de8-ab98-2431d5d5b2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:11.859242 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1379/2748] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:11 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:38:11.872475 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3313f-2f66-4083-866b-d2cd2046c724 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:11.875346 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-46f3313f-2f66-4083-866b-d2cd2046c724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:11.950251 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3313f-2f66-4083-866b-d2cd2046c724 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:11.954810 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863982c8-703e-43f0-bbd7-b3941edb8f31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:11.955694 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863982c8-703e-43f0-bbd7-b3941edb8f31 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:11.956264 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863982c8-703e-43f0-bbd7-b3941edb8f31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:11.956459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863982c8-703e-43f0-bbd7-b3941edb8f31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:11.975091 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863982c8-703e-43f0-bbd7-b3941edb8f31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:11.977159 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863982c8-703e-43f0-bbd7-b3941edb8f31 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:11.988603 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1370/2749] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:38:11 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:38:12.053382 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f1f3a-f94e-4de8-ab98-2431d5d5b2ab None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:12.054865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d82f1f3a-f94e-4de8-ab98-2431d5d5b2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:12.074811 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f1f3a-f94e-4de8-ab98-2431d5d5b2ab None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:12.079483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb940e95-43b1-442e-a348-5834a719d735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:12.080635 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb940e95-43b1-442e-a348-5834a719d735 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:12.081138 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb940e95-43b1-442e-a348-5834a719d735 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:12.081649 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb940e95-43b1-442e-a348-5834a719d735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:12.160417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb940e95-43b1-442e-a348-5834a719d735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:12.162553 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb940e95-43b1-442e-a348-5834a719d735 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:12.175309 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1380/2750] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:38:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:38:19.726074 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863982c8-703e-43f0-bbd7-b3941edb8f31 service cinder] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:19.772483 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:19.805308 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863982c8-703e-43f0-bbd7-b3941edb8f31 service cinder] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:19.813378 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3cc7e-574e-464a-b26e-d6307d86330b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:19.814225 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3cc7e-574e-464a-b26e-d6307d86330b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:19.814363 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3cc7e-574e-464a-b26e-d6307d86330b admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:19.814645 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3cc7e-574e-464a-b26e-d6307d86330b admin admin] PATH_INFO: `/v3/users/46fb5f68def04e73a4f09ebe0fd2207c` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:19.816099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3cc7e-574e-464a-b26e-d6307d86330b admin admin] RBAC: Authorizing `identity:delete_user(user_id=46fb5f68def04e73a4f09ebe0fd2207c)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:19.818252 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3cc7e-574e-464a-b26e-d6307d86330b admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:20.081693 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-fbf3cc7e-574e-464a-b26e-d6307d86330b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46fb5f68def04e73a4f09ebe0fd2207c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:20.096899 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-fbf3cc7e-574e-464a-b26e-d6307d86330b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46fb5f68def04e73a4f09ebe0fd2207c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:20.246000 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-fbf3cc7e-574e-464a-b26e-d6307d86330b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46fb5f68def04e73a4f09ebe0fd2207c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:20.246709 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-fbf3cc7e-574e-464a-b26e-d6307d86330b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46fb5f68def04e73a4f09ebe0fd2207c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:20.254980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-fbf3cc7e-574e-464a-b26e-d6307d86330b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46fb5f68def04e73a4f09ebe0fd2207c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:20.262375 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1371/2751] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:38:19 2022] DELETE /identity/v3/users/46fb5f68def04e73a4f09ebe0fd2207c => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:20.269010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3cbcd-d09e-46e5-adb1-4f13b66a2c98 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:20.269010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3cbcd-d09e-46e5-adb1-4f13b66a2c98 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:20.269010 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3cbcd-d09e-46e5-adb1-4f13b66a2c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:20.287726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-41d3cbcd-d09e-46e5-adb1-4f13b66a2c98 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:20.288943 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-41d3cbcd-d09e-46e5-adb1-4f13b66a2c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:20.359994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1381/2752] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:38:20.375303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3cc7e-574e-464a-b26e-d6307d86330b admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:20.376894 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-fbf3cc7e-574e-464a-b26e-d6307d86330b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:20.444621 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3cc7e-574e-464a-b26e-d6307d86330b admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:20.449257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15181cf-736e-4b91-b1e9-350c6e986054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:20.449859 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15181cf-736e-4b91-b1e9-350c6e986054 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:20.450133 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15181cf-736e-4b91-b1e9-350c6e986054 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:20.450401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15181cf-736e-4b91-b1e9-350c6e986054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:20.460297 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15181cf-736e-4b91-b1e9-350c6e986054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:20.466880 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15181cf-736e-4b91-b1e9-350c6e986054 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:20.496072 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1372/2753] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:38:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:38:21.012964 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3cbcd-d09e-46e5-adb1-4f13b66a2c98 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:21.015209 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-41d3cbcd-d09e-46e5-adb1-4f13b66a2c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:21.022794 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:21.033268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3cbcd-d09e-46e5-adb1-4f13b66a2c98 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:21.036057 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ee46b-a201-4f48-9014-511c79a4cc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:21.036852 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ee46b-a201-4f48-9014-511c79a4cc28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:21.037447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ee46b-a201-4f48-9014-511c79a4cc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:21.038133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ee46b-a201-4f48-9014-511c79a4cc28 admin admin] PATH_INFO: `/v3/projects/25a5a236dfe84b3ca6c5ae21a588b6a5` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:21.039809 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ee46b-a201-4f48-9014-511c79a4cc28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25a5a236dfe84b3ca6c5ae21a588b6a5)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:21.042827 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ee46b-a201-4f48-9014-511c79a4cc28 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:21.222857 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e12ee46b-a201-4f48-9014-511c79a4cc28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25a5a236dfe84b3ca6c5ae21a588b6a5', 'request_id': 'req-e12ee46b-a201-4f48-9014-511c79a4cc28'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:21.371424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e12ee46b-a201-4f48-9014-511c79a4cc28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25a5a236dfe84b3ca6c5ae21a588b6a5', 'request_id': 'req-e12ee46b-a201-4f48-9014-511c79a4cc28'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:21.378261 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e12ee46b-a201-4f48-9014-511c79a4cc28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25a5a236dfe84b3ca6c5ae21a588b6a5', 'request_id': 'req-e12ee46b-a201-4f48-9014-511c79a4cc28'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:21.393762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e12ee46b-a201-4f48-9014-511c79a4cc28 admin admin] The token cache is being invalidate because project 25a5a236dfe84b3ca6c5ae21a588b6a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:38:21.393762 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e12ee46b-a201-4f48-9014-511c79a4cc28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:21.394359 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e12ee46b-a201-4f48-9014-511c79a4cc28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:21.395984 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1382/2754] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:38:21 2022] DELETE /identity/v3/projects/25a5a236dfe84b3ca6c5ae21a588b6a5 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:38:21.400835 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15181cf-736e-4b91-b1e9-350c6e986054 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:21.411809 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15181cf-736e-4b91-b1e9-350c6e986054 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:21.482310 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17233d91-4772-45aa-9740-bcad180ef238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:21.485271 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17233d91-4772-45aa-9740-bcad180ef238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:21.485271 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17233d91-4772-45aa-9740-bcad180ef238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:21.485271 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17233d91-4772-45aa-9740-bcad180ef238 admin admin] PATH_INFO: `/v3/users/6e25154569cf4f38a6bc7153dbb910ab` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:21.485271 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17233d91-4772-45aa-9740-bcad180ef238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e25154569cf4f38a6bc7153dbb910ab)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:21.486884 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17233d91-4772-45aa-9740-bcad180ef238 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:21.488895 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:21.573821 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ee46b-a201-4f48-9014-511c79a4cc28 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:21.575746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-e12ee46b-a201-4f48-9014-511c79a4cc28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:21.589556 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ee46b-a201-4f48-9014-511c79a4cc28 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:21.596570 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be3eeb-9c99-4384-83e6-191520378393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:21.596795 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be3eeb-9c99-4384-83e6-191520378393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:21.597056 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be3eeb-9c99-4384-83e6-191520378393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:21.597316 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be3eeb-9c99-4384-83e6-191520378393 admin admin] PATH_INFO: `/v3/users/8de0ae3cdffc405195f3c06fed86188b` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:21.598731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be3eeb-9c99-4384-83e6-191520378393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8de0ae3cdffc405195f3c06fed86188b)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:21.600773 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be3eeb-9c99-4384-83e6-191520378393 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:21.690829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-17233d91-4772-45aa-9740-bcad180ef238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e25154569cf4f38a6bc7153dbb910ab'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:21.704444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-17233d91-4772-45aa-9740-bcad180ef238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e25154569cf4f38a6bc7153dbb910ab'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:21.870127 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-17233d91-4772-45aa-9740-bcad180ef238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e25154569cf4f38a6bc7153dbb910ab'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:21.870799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-17233d91-4772-45aa-9740-bcad180ef238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e25154569cf4f38a6bc7153dbb910ab'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:21.888522 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-17233d91-4772-45aa-9740-bcad180ef238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e25154569cf4f38a6bc7153dbb910ab'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:21.902897 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-83be3eeb-9c99-4384-83e6-191520378393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8de0ae3cdffc405195f3c06fed86188b'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:21.909211 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1373/2755] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:38:21 2022] DELETE /identity/v3/users/6e25154569cf4f38a6bc7153dbb910ab => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:22.032656 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-83be3eeb-9c99-4384-83e6-191520378393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8de0ae3cdffc405195f3c06fed86188b'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:22.033675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-83be3eeb-9c99-4384-83e6-191520378393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8de0ae3cdffc405195f3c06fed86188b'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:22.047422 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-83be3eeb-9c99-4384-83e6-191520378393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8de0ae3cdffc405195f3c06fed86188b'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:22.048206 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-83be3eeb-9c99-4384-83e6-191520378393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8de0ae3cdffc405195f3c06fed86188b'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:22.054059 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17233d91-4772-45aa-9740-bcad180ef238 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:22.057407 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-17233d91-4772-45aa-9740-bcad180ef238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:22.074912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1383/2756] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:38:21 2022] DELETE /identity/v3/users/8de0ae3cdffc405195f3c06fed86188b => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:38:22.079214 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d351afe-740b-4058-879d-a9e7bb5999a2 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:22.079557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d351afe-740b-4058-879d-a9e7bb5999a2 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:22.079765 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d351afe-740b-4058-879d-a9e7bb5999a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:22.100594 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-9d351afe-740b-4058-879d-a9e7bb5999a2 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:22.101732 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-9d351afe-740b-4058-879d-a9e7bb5999a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:22.126874 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17233d91-4772-45aa-9740-bcad180ef238 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:22.170365 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:22.181940 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1384/2757] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:38:22.191051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077c5bd-241a-4982-9c93-3f59d4ee53b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:22.191561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d351afe-740b-4058-879d-a9e7bb5999a2 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:22.191800 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077c5bd-241a-4982-9c93-3f59d4ee53b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:22.192083 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077c5bd-241a-4982-9c93-3f59d4ee53b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:22.192382 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077c5bd-241a-4982-9c93-3f59d4ee53b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:22.193505 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-9d351afe-740b-4058-879d-a9e7bb5999a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:22.194805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-a077c5bd-241a-4982-9c93-3f59d4ee53b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:22.217168 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d351afe-740b-4058-879d-a9e7bb5999a2 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:22.221104 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3dcbc-42f7-4f49-816f-eb83ee281b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:22.221993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3dcbc-42f7-4f49-816f-eb83ee281b31 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:22.222549 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3dcbc-42f7-4f49-816f-eb83ee281b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:22.222898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3dcbc-42f7-4f49-816f-eb83ee281b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:22.233927 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3dcbc-42f7-4f49-816f-eb83ee281b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:22.235720 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3dcbc-42f7-4f49-816f-eb83ee281b31 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:22.248860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1385/2758] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:38:22.264774 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:22.280436 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077c5bd-241a-4982-9c93-3f59d4ee53b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:22.287332 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077c5bd-241a-4982-9c93-3f59d4ee53b5 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:22.294240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1374/2759] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:38:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:38:22.554241 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3dcbc-42f7-4f49-816f-eb83ee281b31 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:22.555839 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-2dd3dcbc-42f7-4f49-816f-eb83ee281b31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:22.570731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3dcbc-42f7-4f49-816f-eb83ee281b31 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:22.577694 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e44158-ce4d-4492-a4f3-54653f5f7fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:22.578977 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e44158-ce4d-4492-a4f3-54653f5f7fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:22.578977 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e44158-ce4d-4492-a4f3-54653f5f7fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:22.579245 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e44158-ce4d-4492-a4f3-54653f5f7fd5 admin admin] PATH_INFO: `/v3/projects/eb7c35a271d94e12839e0f79f3a29f2d` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:22.580397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e44158-ce4d-4492-a4f3-54653f5f7fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb7c35a271d94e12839e0f79f3a29f2d)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:22.582682 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e44158-ce4d-4492-a4f3-54653f5f7fd5 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:22.756860 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-38e44158-ce4d-4492-a4f3-54653f5f7fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb7c35a271d94e12839e0f79f3a29f2d', 'request_id': 'req-38e44158-ce4d-4492-a4f3-54653f5f7fd5'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:22.874850 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-38e44158-ce4d-4492-a4f3-54653f5f7fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb7c35a271d94e12839e0f79f3a29f2d', 'request_id': 'req-38e44158-ce4d-4492-a4f3-54653f5f7fd5'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:22.885671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-38e44158-ce4d-4492-a4f3-54653f5f7fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb7c35a271d94e12839e0f79f3a29f2d', 'request_id': 'req-38e44158-ce4d-4492-a4f3-54653f5f7fd5'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:22.905120 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-38e44158-ce4d-4492-a4f3-54653f5f7fd5 admin admin] The token cache is being invalidate because project eb7c35a271d94e12839e0f79f3a29f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:38:22.905120 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-38e44158-ce4d-4492-a4f3-54653f5f7fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:22.906064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-38e44158-ce4d-4492-a4f3-54653f5f7fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:22.912995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1386/2760] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:38:22 2022] DELETE /identity/v3/projects/eb7c35a271d94e12839e0f79f3a29f2d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:38:22.915832 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4562ae-2630-4d32-afb7-306fc020de98 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:22.916390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4562ae-2630-4d32-afb7-306fc020de98 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:22.916679 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4562ae-2630-4d32-afb7-306fc020de98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:22.969352 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-bf4562ae-2630-4d32-afb7-306fc020de98 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:22.969352 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-bf4562ae-2630-4d32-afb7-306fc020de98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:23.065146 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1375/2761] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:38:23.073303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6bed3-feb8-4b84-9186-a76310ddeaf1 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:23.073688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6bed3-feb8-4b84-9186-a76310ddeaf1 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:23.077672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6bed3-feb8-4b84-9186-a76310ddeaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:23.109417 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-e6f6bed3-feb8-4b84-9186-a76310ddeaf1 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:23.110987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-e6f6bed3-feb8-4b84-9186-a76310ddeaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:23.126436 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1387/2762] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:38:23.129468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4562ae-2630-4d32-afb7-306fc020de98 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:23.149217 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4562ae-2630-4d32-afb7-306fc020de98 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:23.151593 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b1dca-6559-4a6f-bcae-a5b73cc37be2 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:23.152075 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b1dca-6559-4a6f-bcae-a5b73cc37be2 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:23.152426 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b1dca-6559-4a6f-bcae-a5b73cc37be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:23.158538 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d55ae-e446-4b27-83a4-4e31e1ee39a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:23.159781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d55ae-e446-4b27-83a4-4e31e1ee39a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:23.160353 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d55ae-e446-4b27-83a4-4e31e1ee39a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:23.160840 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d55ae-e446-4b27-83a4-4e31e1ee39a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:23.162560 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d55ae-e446-4b27-83a4-4e31e1ee39a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:38:23.163222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d55ae-e446-4b27-83a4-4e31e1ee39a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:23.167087 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d55ae-e446-4b27-83a4-4e31e1ee39a6 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:23.175637 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-1a3b1dca-6559-4a6f-bcae-a5b73cc37be2 None None] MFA Rules not processed for user `f2cea4c08f324769bf6dcea58c9394b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:23.177157 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-1a3b1dca-6559-4a6f-bcae-a5b73cc37be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:23.200611 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1376/2763] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:38:23.202776 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d55ae-e446-4b27-83a4-4e31e1ee39a6 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:23.208747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-2e7d55ae-e446-4b27-83a4-4e31e1ee39a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:23.235062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d55ae-e446-4b27-83a4-4e31e1ee39a6 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:23.244873 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f30da-23f7-44fc-aea0-f2783e9b505f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:23.246636 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f30da-23f7-44fc-aea0-f2783e9b505f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:23.246975 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f30da-23f7-44fc-aea0-f2783e9b505f admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:23.247254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f30da-23f7-44fc-aea0-f2783e9b505f admin admin] PATH_INFO: `/v3/projects/01ce4412dd824b3398df390c8f131ac1` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:23.249204 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f30da-23f7-44fc-aea0-f2783e9b505f admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ce4412dd824b3398df390c8f131ac1)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:23.253154 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f30da-23f7-44fc-aea0-f2783e9b505f admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:23.319416 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1388/2764] 10.222.0.83 () {58 vars in 967 bytes} [Fri Sep 23 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:38:23.320792 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b1dca-6559-4a6f-bcae-a5b73cc37be2 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:23.341464 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b1dca-6559-4a6f-bcae-a5b73cc37be2 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:23.349454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82962b0-2ea1-482e-95a5-06f008879f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:23.350296 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82962b0-2ea1-482e-95a5-06f008879f04 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:23.350745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82962b0-2ea1-482e-95a5-06f008879f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:23.351132 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82962b0-2ea1-482e-95a5-06f008879f04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:23.352095 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82962b0-2ea1-482e-95a5-06f008879f04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:23.355209 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82962b0-2ea1-482e-95a5-06f008879f04 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:23.431448 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0c7f30da-23f7-44fc-aea0-f2783e9b505f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ce4412dd824b3398df390c8f131ac1', 'request_id': 'req-0c7f30da-23f7-44fc-aea0-f2783e9b505f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:23.521369 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1389/2765] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:38:23 2022] POST /identity/v3/projects => generated 401 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:38:23.521369 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82962b0-2ea1-482e-95a5-06f008879f04 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:23.522238 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-e82962b0-2ea1-482e-95a5-06f008879f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:23.577613 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0c7f30da-23f7-44fc-aea0-f2783e9b505f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ce4412dd824b3398df390c8f131ac1', 'request_id': 'req-0c7f30da-23f7-44fc-aea0-f2783e9b505f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:23.589358 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0c7f30da-23f7-44fc-aea0-f2783e9b505f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ce4412dd824b3398df390c8f131ac1', 'request_id': 'req-0c7f30da-23f7-44fc-aea0-f2783e9b505f'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:23.608544 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0c7f30da-23f7-44fc-aea0-f2783e9b505f admin admin] The token cache is being invalidate because project 01ce4412dd824b3398df390c8f131ac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:38:23.608841 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0c7f30da-23f7-44fc-aea0-f2783e9b505f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:23.610005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-0c7f30da-23f7-44fc-aea0-f2783e9b505f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:23.612414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1377/2766] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:38:23 2022] DELETE /identity/v3/projects/01ce4412dd824b3398df390c8f131ac1 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:23.613812 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f30da-23f7-44fc-aea0-f2783e9b505f admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:23.615554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-0c7f30da-23f7-44fc-aea0-f2783e9b505f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:23.642195 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:23.745495 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f30da-23f7-44fc-aea0-f2783e9b505f admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:23.753361 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:23.763628 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82962b0-2ea1-482e-95a5-06f008879f04 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:23.778047 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151039ca-f1b7-41a0-820c-4aee280295eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526c7ad227943d1a2bba7b5e2e039e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:23.779359 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151039ca-f1b7-41a0-820c-4aee280295eb service swift] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:23.779648 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151039ca-f1b7-41a0-820c-4aee280295eb service swift] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:23.780154 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151039ca-f1b7-41a0-820c-4aee280295eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:23.784137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-151039ca-f1b7-41a0-820c-4aee280295eb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:23.882041 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12208585-944c-4797-b6c9-ece9ccefce0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:23.884114 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12208585-944c-4797-b6c9-ece9ccefce0b admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:23.885115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12208585-944c-4797-b6c9-ece9ccefce0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:23.885579 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12208585-944c-4797-b6c9-ece9ccefce0b admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:23.887094 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12208585-944c-4797-b6c9-ece9ccefce0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:23.898372 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12208585-944c-4797-b6c9-ece9ccefce0b admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:23.933726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151039ca-f1b7-41a0-820c-4aee280295eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:23.937008 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151039ca-f1b7-41a0-820c-4aee280295eb service swift] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:23.952474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1390/2767] 10.222.0.83 () {60 vars in 1384 bytes} [Fri Sep 23 01:38:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 01:38:24.049830 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1378/2768] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:38:23 2022] POST /identity/v3/users => generated 301 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:38:24.056624 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151039ca-f1b7-41a0-820c-4aee280295eb service swift] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:24.074560 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151039ca-f1b7-41a0-820c-4aee280295eb service swift] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:24.096498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e72b6-3360-4014-bed6-4adaf09da6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:24.096498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e72b6-3360-4014-bed6-4adaf09da6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:24.096498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e72b6-3360-4014-bed6-4adaf09da6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:24.096498 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e72b6-3360-4014-bed6-4adaf09da6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:24.098566 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e72b6-3360-4014-bed6-4adaf09da6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:24.098566 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e72b6-3360-4014-bed6-4adaf09da6c8 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:24.118769 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1391/2769] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:38:24.121238 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12208585-944c-4797-b6c9-ece9ccefce0b admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:24.136144 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12208585-944c-4797-b6c9-ece9ccefce0b admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:24.147712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442ae12-e557-43a4-85b9-0aa41412fcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:24.149163 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442ae12-e557-43a4-85b9-0aa41412fcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:24.150252 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442ae12-e557-43a4-85b9-0aa41412fcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:24.150814 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442ae12-e557-43a4-85b9-0aa41412fcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:24.153638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442ae12-e557-43a4-85b9-0aa41412fcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:24.155888 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442ae12-e557-43a4-85b9-0aa41412fcd8 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:24.181464 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1379/2770] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:38:24.186886 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e72b6-3360-4014-bed6-4adaf09da6c8 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:24.201144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e72b6-3360-4014-bed6-4adaf09da6c8 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:24.207779 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e9a32-7eb4-4d98-a3cd-9ac7bbb3b1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:24.208552 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e9a32-7eb4-4d98-a3cd-9ac7bbb3b1e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:24.208874 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e9a32-7eb4-4d98-a3cd-9ac7bbb3b1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:24.209159 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e9a32-7eb4-4d98-a3cd-9ac7bbb3b1e9 admin admin] PATH_INFO: `/v3/projects/139db1211d8043bba908c7d0e1b83ca5/users/e51f67a5e711493089f92bd6cca4c538/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:24.227811 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e9a32-7eb4-4d98-a3cd-9ac7bbb3b1e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139db1211d8043bba908c7d0e1b83ca5, user_id=e51f67a5e711493089f92bd6cca4c538, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:24.230711 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e9a32-7eb4-4d98-a3cd-9ac7bbb3b1e9 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:24.394189 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1392/2771] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:38:24 2022] PUT /identity/v3/projects/139db1211d8043bba908c7d0e1b83ca5/users/e51f67a5e711493089f92bd6cca4c538/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:38:24.414188 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee3767-02c7-47c1-ac04-03284ca0cc5e None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:24.414719 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee3767-02c7-47c1-ac04-03284ca0cc5e None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:24.415223 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee3767-02c7-47c1-ac04-03284ca0cc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:24.470116 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-43ee3767-02c7-47c1-ac04-03284ca0cc5e None None] MFA Rules not processed for user `e51f67a5e711493089f92bd6cca4c538`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:24.471451 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-43ee3767-02c7-47c1-ac04-03284ca0cc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:24.609235 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1380/2772] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:24 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:38:24.615322 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e9a32-7eb4-4d98-a3cd-9ac7bbb3b1e9 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:24.710244 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e9a32-7eb4-4d98-a3cd-9ac7bbb3b1e9 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:24.717529 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036827e-7b5d-45fb-bb48-c696c989291f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:24.718363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036827e-7b5d-45fb-bb48-c696c989291f admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:24.718756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036827e-7b5d-45fb-bb48-c696c989291f admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:24.719119 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036827e-7b5d-45fb-bb48-c696c989291f admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:24.719861 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036827e-7b5d-45fb-bb48-c696c989291f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:24.722869 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036827e-7b5d-45fb-bb48-c696c989291f admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:24.897538 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee3767-02c7-47c1-ac04-03284ca0cc5e None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:24.906459 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1393/2773] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:38:24 2022] POST /identity/v3/projects => generated 399 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 01:38:24.912489 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee3767-02c7-47c1-ac04-03284ca0cc5e None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:24.989549 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260d70b-06dc-4b65-8fca-aa2f708a6d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:24.990499 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260d70b-06dc-4b65-8fca-aa2f708a6d29 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:24.990820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260d70b-06dc-4b65-8fca-aa2f708a6d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:24.991146 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260d70b-06dc-4b65-8fca-aa2f708a6d29 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:24.991851 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260d70b-06dc-4b65-8fca-aa2f708a6d29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:24.994562 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260d70b-06dc-4b65-8fca-aa2f708a6d29 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:25.159014 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1381/2774] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:38:24 2022] POST /identity/v3/users => generated 306 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:38:25.163835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036827e-7b5d-45fb-bb48-c696c989291f admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:25.176142 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036827e-7b5d-45fb-bb48-c696c989291f admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:25.184763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409151e-8181-4b7f-8c16-22386b47415b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:25.188966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409151e-8181-4b7f-8c16-22386b47415b admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:25.188966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409151e-8181-4b7f-8c16-22386b47415b admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:25.188966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409151e-8181-4b7f-8c16-22386b47415b admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:25.188966 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409151e-8181-4b7f-8c16-22386b47415b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:25.190550 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409151e-8181-4b7f-8c16-22386b47415b admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:25.209632 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1394/2775] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:38:25.214606 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260d70b-06dc-4b65-8fca-aa2f708a6d29 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:25.225806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:25.234786 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260d70b-06dc-4b65-8fca-aa2f708a6d29 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:25.242135 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a639a8-724c-4227-a1f6-8107cf8595e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:25.244035 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a639a8-724c-4227-a1f6-8107cf8595e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:25.245500 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a639a8-724c-4227-a1f6-8107cf8595e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:25.246025 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a639a8-724c-4227-a1f6-8107cf8595e1 admin admin] PATH_INFO: `/v3/projects/1ac438629abd43b3bffc46da5b9fdc9d/users/4faa70b474b04f77a3e98f69df43faf1/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:25.276848 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a639a8-724c-4227-a1f6-8107cf8595e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac438629abd43b3bffc46da5b9fdc9d, user_id=4faa70b474b04f77a3e98f69df43faf1, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:25.283010 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a639a8-724c-4227-a1f6-8107cf8595e1 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:25.393734 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1382/2776] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:38:25 2022] PUT /identity/v3/projects/1ac438629abd43b3bffc46da5b9fdc9d/users/4faa70b474b04f77a3e98f69df43faf1/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:25.400423 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409151e-8181-4b7f-8c16-22386b47415b admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:25.420795 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409151e-8181-4b7f-8c16-22386b47415b admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:25.463067 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:25.533386 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c3f7a-0f8a-4c8e-bfca-fbd0f18de449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:25.534521 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c3f7a-0f8a-4c8e-bfca-fbd0f18de449 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:25.535139 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c3f7a-0f8a-4c8e-bfca-fbd0f18de449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:25.535631 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c3f7a-0f8a-4c8e-bfca-fbd0f18de449 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:25.536881 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c3f7a-0f8a-4c8e-bfca-fbd0f18de449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:25.540366 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c3f7a-0f8a-4c8e-bfca-fbd0f18de449 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:25.566246 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1395/2777] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:38:25.567504 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a639a8-724c-4227-a1f6-8107cf8595e1 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:25.586766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a639a8-724c-4227-a1f6-8107cf8595e1 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:25.594406 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ef048-340b-45cd-aafd-089806ae8c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:25.595251 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef048-340b-45cd-aafd-089806ae8c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:25.595592 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef048-340b-45cd-aafd-089806ae8c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:25.595904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef048-340b-45cd-aafd-089806ae8c1c admin admin] PATH_INFO: `/v3/projects/1ac438629abd43b3bffc46da5b9fdc9d/users/4faa70b474b04f77a3e98f69df43faf1/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:25.598230 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ef048-340b-45cd-aafd-089806ae8c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac438629abd43b3bffc46da5b9fdc9d, user_id=4faa70b474b04f77a3e98f69df43faf1, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:25.602054 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ef048-340b-45cd-aafd-089806ae8c1c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:25.617513 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1383/2778] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:38:25 2022] PUT /identity/v3/projects/1ac438629abd43b3bffc46da5b9fdc9d/users/4faa70b474b04f77a3e98f69df43faf1/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:25.633575 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f3891-6630-407c-a702-1f20ea625e6f None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:25.633855 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f3891-6630-407c-a702-1f20ea625e6f None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:25.634189 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f3891-6630-407c-a702-1f20ea625e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:25.667951 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-394f3891-6630-407c-a702-1f20ea625e6f None None] MFA Rules not processed for user `4faa70b474b04f77a3e98f69df43faf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:25.669459 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-394f3891-6630-407c-a702-1f20ea625e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:25.762508 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1396/2779] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:25 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:38:25.775541 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ef048-340b-45cd-aafd-089806ae8c1c admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:25.778410 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-318ef048-340b-45cd-aafd-089806ae8c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:25.849614 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ef048-340b-45cd-aafd-089806ae8c1c admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:25.853345 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48bd32-8868-4f49-afde-559886795461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:25.853965 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48bd32-8868-4f49-afde-559886795461 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:25.854245 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48bd32-8868-4f49-afde-559886795461 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:25.854516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48bd32-8868-4f49-afde-559886795461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:25.865414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48bd32-8868-4f49-afde-559886795461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:25.866942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48bd32-8868-4f49-afde-559886795461 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:25.877839 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1384/2780] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:38:25 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:38:26.207919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f3891-6630-407c-a702-1f20ea625e6f None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:26.228402 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f3891-6630-407c-a702-1f20ea625e6f None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:26.235643 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112116fa-2abb-429d-b060-e128d9599e28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:26.236496 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112116fa-2abb-429d-b060-e128d9599e28 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:26.237087 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112116fa-2abb-429d-b060-e128d9599e28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:26.237963 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112116fa-2abb-429d-b060-e128d9599e28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:26.334955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112116fa-2abb-429d-b060-e128d9599e28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:26.338322 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112116fa-2abb-429d-b060-e128d9599e28 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:26.356622 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1397/2781] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:38:26 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:38:28.189369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48bd32-8868-4f49-afde-559886795461 service cinder] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:28.191026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-2f48bd32-8868-4f49-afde-559886795461 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:28.319179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48bd32-8868-4f49-afde-559886795461 service cinder] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:28.329185 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d6438-62fc-439e-9b42-0c3817b3c72b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eab2cbff5984fa6a8e715ed6553db82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:28.330269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d6438-62fc-439e-9b42-0c3817b3c72b service placement] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:28.330816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d6438-62fc-439e-9b42-0c3817b3c72b service placement] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:28.331307 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d6438-62fc-439e-9b42-0c3817b3c72b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:28.334494 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-709d6438-62fc-439e-9b42-0c3817b3c72b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:28.356566 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d6438-62fc-439e-9b42-0c3817b3c72b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:28.359776 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d6438-62fc-439e-9b42-0c3817b3c72b service placement] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:28.380020 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1385/2782] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:38:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:38:31.420108 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112116fa-2abb-429d-b060-e128d9599e28 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:31.421707 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-112116fa-2abb-429d-b060-e128d9599e28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:31.476465 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:31.488525 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112116fa-2abb-429d-b060-e128d9599e28 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:31.493015 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca09a7-cc32-461e-96b7-628bf2d9a726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:31.494180 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca09a7-cc32-461e-96b7-628bf2d9a726 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:31.494455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca09a7-cc32-461e-96b7-628bf2d9a726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:31.494778 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca09a7-cc32-461e-96b7-628bf2d9a726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:31.497023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-7cca09a7-cc32-461e-96b7-628bf2d9a726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:31.594268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca09a7-cc32-461e-96b7-628bf2d9a726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:31.597161 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca09a7-cc32-461e-96b7-628bf2d9a726 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:31.613357 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1398/2783] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:38:32.129776 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d6438-62fc-439e-9b42-0c3817b3c72b service placement] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:32.142078 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d6438-62fc-439e-9b42-0c3817b3c72b service placement] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:32.147322 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49364f50-0653-495a-b048-717a9b6aceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:32.147968 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49364f50-0653-495a-b048-717a9b6aceb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:32.148250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49364f50-0653-495a-b048-717a9b6aceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:32.148513 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49364f50-0653-495a-b048-717a9b6aceb0 admin admin] PATH_INFO: `/v3/users/e51f67a5e711493089f92bd6cca4c538` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:32.150450 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49364f50-0653-495a-b048-717a9b6aceb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e51f67a5e711493089f92bd6cca4c538)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:32.152435 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49364f50-0653-495a-b048-717a9b6aceb0 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:32.371554 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:32.384112 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-49364f50-0653-495a-b048-717a9b6aceb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e51f67a5e711493089f92bd6cca4c538'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:32.397304 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-49364f50-0653-495a-b048-717a9b6aceb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e51f67a5e711493089f92bd6cca4c538'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:32.485897 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-49364f50-0653-495a-b048-717a9b6aceb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e51f67a5e711493089f92bd6cca4c538'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:32.486626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-49364f50-0653-495a-b048-717a9b6aceb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e51f67a5e711493089f92bd6cca4c538'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:32.497334 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-49364f50-0653-495a-b048-717a9b6aceb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e51f67a5e711493089f92bd6cca4c538'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:32.509408 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1386/2784] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:38:32 2022] DELETE /identity/v3/users/e51f67a5e711493089f92bd6cca4c538 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:32.514269 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c287f-e286-475d-97d9-d4322f0b1549 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:32.515197 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c287f-e286-475d-97d9-d4322f0b1549 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:32.515197 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c287f-e286-475d-97d9-d4322f0b1549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:32.539192 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-250c287f-e286-475d-97d9-d4322f0b1549 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:32.540763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-250c287f-e286-475d-97d9-d4322f0b1549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:32.620665 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1399/2785] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:38:32.634367 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49364f50-0653-495a-b048-717a9b6aceb0 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:32.636027 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-49364f50-0653-495a-b048-717a9b6aceb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:32.707182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49364f50-0653-495a-b048-717a9b6aceb0 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:32.711070 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6360239-b7c1-49fa-8a45-9b650fdbc72a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:32.711685 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6360239-b7c1-49fa-8a45-9b650fdbc72a service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:32.711997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6360239-b7c1-49fa-8a45-9b650fdbc72a service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:32.712806 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6360239-b7c1-49fa-8a45-9b650fdbc72a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:32.724003 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6360239-b7c1-49fa-8a45-9b650fdbc72a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:32.725803 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6360239-b7c1-49fa-8a45-9b650fdbc72a service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:32.736124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1387/2786] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:38:33.625381 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c287f-e286-475d-97d9-d4322f0b1549 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:33.631759 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-250c287f-e286-475d-97d9-d4322f0b1549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:33.650282 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c287f-e286-475d-97d9-d4322f0b1549 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:33.667537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e520493-8543-4690-85e8-6f87985ad9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:33.669073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e520493-8543-4690-85e8-6f87985ad9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:33.669567 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e520493-8543-4690-85e8-6f87985ad9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:33.670308 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e520493-8543-4690-85e8-6f87985ad9f7 admin admin] PATH_INFO: `/v3/projects/139db1211d8043bba908c7d0e1b83ca5` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:33.672881 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e520493-8543-4690-85e8-6f87985ad9f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=139db1211d8043bba908c7d0e1b83ca5)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:33.678242 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e520493-8543-4690-85e8-6f87985ad9f7 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:33.848418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3e520493-8543-4690-85e8-6f87985ad9f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '139db1211d8043bba908c7d0e1b83ca5', 'request_id': 'req-3e520493-8543-4690-85e8-6f87985ad9f7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:34.085395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3e520493-8543-4690-85e8-6f87985ad9f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '139db1211d8043bba908c7d0e1b83ca5', 'request_id': 'req-3e520493-8543-4690-85e8-6f87985ad9f7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:34.091942 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3e520493-8543-4690-85e8-6f87985ad9f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '139db1211d8043bba908c7d0e1b83ca5', 'request_id': 'req-3e520493-8543-4690-85e8-6f87985ad9f7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:34.113390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3e520493-8543-4690-85e8-6f87985ad9f7 admin admin] The token cache is being invalidate because project 139db1211d8043bba908c7d0e1b83ca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:38:34.113390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3e520493-8543-4690-85e8-6f87985ad9f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:34.113390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-3e520493-8543-4690-85e8-6f87985ad9f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:34.113390 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1400/2787] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:38:33 2022] DELETE /identity/v3/projects/139db1211d8043bba908c7d0e1b83ca5 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:34.117755 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6360239-b7c1-49fa-8a45-9b650fdbc72a service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:34.139887 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6360239-b7c1-49fa-8a45-9b650fdbc72a service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:34.255210 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de4a5b-0e0b-4241-81a1-61ba09586128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:34.255901 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de4a5b-0e0b-4241-81a1-61ba09586128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:34.256180 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de4a5b-0e0b-4241-81a1-61ba09586128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:34.256451 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de4a5b-0e0b-4241-81a1-61ba09586128 admin admin] PATH_INFO: `/v3/users/4faa70b474b04f77a3e98f69df43faf1` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:34.257959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de4a5b-0e0b-4241-81a1-61ba09586128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4faa70b474b04f77a3e98f69df43faf1)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:34.260509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de4a5b-0e0b-4241-81a1-61ba09586128 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:34.866438 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a3de4a5b-0e0b-4241-81a1-61ba09586128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4faa70b474b04f77a3e98f69df43faf1'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:34.881919 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:34.893372 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a3de4a5b-0e0b-4241-81a1-61ba09586128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4faa70b474b04f77a3e98f69df43faf1'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:35.019892 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a3de4a5b-0e0b-4241-81a1-61ba09586128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4faa70b474b04f77a3e98f69df43faf1'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:35.020580 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a3de4a5b-0e0b-4241-81a1-61ba09586128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4faa70b474b04f77a3e98f69df43faf1'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:35.031752 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-a3de4a5b-0e0b-4241-81a1-61ba09586128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4faa70b474b04f77a3e98f69df43faf1'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:35.040060 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1388/2788] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:38:34 2022] DELETE /identity/v3/users/4faa70b474b04f77a3e98f69df43faf1 => generated 0 bytes in 924 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:35.724800 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e520493-8543-4690-85e8-6f87985ad9f7 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:35.728808 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-3e520493-8543-4690-85e8-6f87985ad9f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:35.780921 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e520493-8543-4690-85e8-6f87985ad9f7 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:35.803164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:35.870164 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333018be-f250-40d8-9110-8184514a7eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:35.871190 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333018be-f250-40d8-9110-8184514a7eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:35.871611 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333018be-f250-40d8-9110-8184514a7eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:35.872651 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333018be-f250-40d8-9110-8184514a7eed admin admin] PATH_INFO: `/v3/projects/1ac438629abd43b3bffc46da5b9fdc9d` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:35.874994 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333018be-f250-40d8-9110-8184514a7eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac438629abd43b3bffc46da5b9fdc9d)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:35.877285 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333018be-f250-40d8-9110-8184514a7eed admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:36.044272 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-333018be-f250-40d8-9110-8184514a7eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac438629abd43b3bffc46da5b9fdc9d', 'request_id': 'req-333018be-f250-40d8-9110-8184514a7eed'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:36.224985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-333018be-f250-40d8-9110-8184514a7eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac438629abd43b3bffc46da5b9fdc9d', 'request_id': 'req-333018be-f250-40d8-9110-8184514a7eed'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:36.250999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-333018be-f250-40d8-9110-8184514a7eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac438629abd43b3bffc46da5b9fdc9d', 'request_id': 'req-333018be-f250-40d8-9110-8184514a7eed'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:36.279270 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-333018be-f250-40d8-9110-8184514a7eed admin admin] The token cache is being invalidate because project 1ac438629abd43b3bffc46da5b9fdc9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:38:36.279908 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-333018be-f250-40d8-9110-8184514a7eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:36.281286 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-333018be-f250-40d8-9110-8184514a7eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:36.291225 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1401/2789] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:38:35 2022] DELETE /identity/v3/projects/1ac438629abd43b3bffc46da5b9fdc9d => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:36.295141 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30426a36-75bb-42c0-b03b-69e732e488c3 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:36.295805 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30426a36-75bb-42c0-b03b-69e732e488c3 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:36.296166 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30426a36-75bb-42c0-b03b-69e732e488c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:36.336490 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-30426a36-75bb-42c0-b03b-69e732e488c3 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:36.338151 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-30426a36-75bb-42c0-b03b-69e732e488c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:36.426632 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1389/2790] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:38:36.439805 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ba412-3c2f-4649-a94c-302c11873d16 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:36.440293 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ba412-3c2f-4649-a94c-302c11873d16 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:36.440770 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ba412-3c2f-4649-a94c-302c11873d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:36.481292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-791ba412-3c2f-4649-a94c-302c11873d16 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:36.482743 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-791ba412-3c2f-4649-a94c-302c11873d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:36.496629 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1402/2791] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:38:36.501512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30426a36-75bb-42c0-b03b-69e732e488c3 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:36.512828 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30426a36-75bb-42c0-b03b-69e732e488c3 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:36.521168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff585718-9c6d-4b30-9952-b18981557e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:36.521168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff585718-9c6d-4b30-9952-b18981557e6e admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:36.521168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff585718-9c6d-4b30-9952-b18981557e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:36.521168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff585718-9c6d-4b30-9952-b18981557e6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:36.521580 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff585718-9c6d-4b30-9952-b18981557e6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:38:36.521580 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff585718-9c6d-4b30-9952-b18981557e6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:36.522801 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff585718-9c6d-4b30-9952-b18981557e6e admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:36.540991 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1390/2792] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 01:38:36.546522 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ba412-3c2f-4649-a94c-302c11873d16 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:36.552543 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ba412-3c2f-4649-a94c-302c11873d16 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:36.558362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c687638-6a9d-499a-9e32-64a39a6f4590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:36.559080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c687638-6a9d-499a-9e32-64a39a6f4590 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:36.559316 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c687638-6a9d-499a-9e32-64a39a6f4590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:36.559624 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c687638-6a9d-499a-9e32-64a39a6f4590 admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:36.560240 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c687638-6a9d-499a-9e32-64a39a6f4590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:36.562156 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c687638-6a9d-499a-9e32-64a39a6f4590 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:36.729695 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1403/2793] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:38:36 2022] POST /identity/v3/projects => generated 391 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:38:36.735156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff585718-9c6d-4b30-9952-b18981557e6e admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:36.746481 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff585718-9c6d-4b30-9952-b18981557e6e admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:36.826407 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9527e1-8358-436b-9e39-49e62e0d9f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:36.827160 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9527e1-8358-436b-9e39-49e62e0d9f17 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:36.827570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9527e1-8358-436b-9e39-49e62e0d9f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:36.827948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9527e1-8358-436b-9e39-49e62e0d9f17 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:36.828710 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9527e1-8358-436b-9e39-49e62e0d9f17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:36.830849 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9527e1-8358-436b-9e39-49e62e0d9f17 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:36.979349 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1391/2794] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:38:36 2022] POST /identity/v3/users => generated 296 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:38:36.983807 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c687638-6a9d-499a-9e32-64a39a6f4590 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:36.999927 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c687638-6a9d-499a-9e32-64a39a6f4590 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:37.007671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c21bc3-4144-4417-a2ce-3b1330487da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:37.008656 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c21bc3-4144-4417-a2ce-3b1330487da2 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:37.009225 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c21bc3-4144-4417-a2ce-3b1330487da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:37.009719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c21bc3-4144-4417-a2ce-3b1330487da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:37.010952 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c21bc3-4144-4417-a2ce-3b1330487da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:37.013942 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c21bc3-4144-4417-a2ce-3b1330487da2 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:37.036493 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1404/2795] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:38:37.037865 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9527e1-8358-436b-9e39-49e62e0d9f17 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:37.049741 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9527e1-8358-436b-9e39-49e62e0d9f17 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:37.054965 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52bef7-a06a-4e4f-8c05-0014a251feb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:37.055610 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52bef7-a06a-4e4f-8c05-0014a251feb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:37.056421 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52bef7-a06a-4e4f-8c05-0014a251feb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:37.056690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52bef7-a06a-4e4f-8c05-0014a251feb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:37.057340 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52bef7-a06a-4e4f-8c05-0014a251feb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:37.059477 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52bef7-a06a-4e4f-8c05-0014a251feb9 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:37.073038 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1392/2796] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:38:37.078354 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c21bc3-4144-4417-a2ce-3b1330487da2 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:37.098001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c21bc3-4144-4417-a2ce-3b1330487da2 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:37.108491 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01380b-0b61-4c35-a78f-4f398a4f0c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:37.109805 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01380b-0b61-4c35-a78f-4f398a4f0c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:37.110322 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01380b-0b61-4c35-a78f-4f398a4f0c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:37.110840 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01380b-0b61-4c35-a78f-4f398a4f0c37 admin admin] PATH_INFO: `/v3/projects/074035b2c39640859428ac9653dcfa2a/users/c5617de02fd744cf98254c2a821ace1a/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:37.138314 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01380b-0b61-4c35-a78f-4f398a4f0c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=074035b2c39640859428ac9653dcfa2a, user_id=c5617de02fd744cf98254c2a821ace1a, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:37.144845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01380b-0b61-4c35-a78f-4f398a4f0c37 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:37.251260 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1405/2797] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:38:37 2022] PUT /identity/v3/projects/074035b2c39640859428ac9653dcfa2a/users/c5617de02fd744cf98254c2a821ace1a/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:37.325511 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02dfbf-1da8-4996-8d0b-c039a58e661b None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:37.326125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02dfbf-1da8-4996-8d0b-c039a58e661b None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:37.326125 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02dfbf-1da8-4996-8d0b-c039a58e661b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:37.361546 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-af02dfbf-1da8-4996-8d0b-c039a58e661b None None] MFA Rules not processed for user `c5617de02fd744cf98254c2a821ace1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:37.364360 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-af02dfbf-1da8-4996-8d0b-c039a58e661b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:37.410534 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:37.460963 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1393/2798] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:38:37.478455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01380b-0b61-4c35-a78f-4f398a4f0c37 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:37.480343 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ea01380b-0b61-4c35-a78f-4f398a4f0c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:37.733728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:37.733728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01380b-0b61-4c35-a78f-4f398a4f0c37 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:37.733728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5acc7f-6699-4b1f-a316-9391fcc9bdcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:37.733728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5acc7f-6699-4b1f-a316-9391fcc9bdcb service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:37.736687 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5acc7f-6699-4b1f-a316-9391fcc9bdcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:37.736687 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5acc7f-6699-4b1f-a316-9391fcc9bdcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:37.736687 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5acc7f-6699-4b1f-a316-9391fcc9bdcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:37.736687 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5acc7f-6699-4b1f-a316-9391fcc9bdcb service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:37.736687 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1406/2799] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:38:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:38:40.729090 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02dfbf-1da8-4996-8d0b-c039a58e661b None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:40.731889 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-af02dfbf-1da8-4996-8d0b-c039a58e661b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:40.829468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02dfbf-1da8-4996-8d0b-c039a58e661b None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:40.838032 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccb8e1-4729-4133-a079-46913f9864d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eab2cbff5984fa6a8e715ed6553db82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:40.838689 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccb8e1-4729-4133-a079-46913f9864d7 service placement] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:40.838992 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccb8e1-4729-4133-a079-46913f9864d7 service placement] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:40.839342 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccb8e1-4729-4133-a079-46913f9864d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:40.841293 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-5cccb8e1-4729-4133-a079-46913f9864d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:40.856317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccb8e1-4729-4133-a079-46913f9864d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:40.858072 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccb8e1-4729-4133-a079-46913f9864d7 service placement] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:40.871480 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1394/2800] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:38:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:38:40.873850 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5acc7f-6699-4b1f-a316-9391fcc9bdcb service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:40.876011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-de5acc7f-6699-4b1f-a316-9391fcc9bdcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:40.984260 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5acc7f-6699-4b1f-a316-9391fcc9bdcb service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:40.989343 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c85148-ea72-4945-bbf5-774add699edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:40.989977 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c85148-ea72-4945-bbf5-774add699edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:40.990254 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c85148-ea72-4945-bbf5-774add699edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:40.990619 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c85148-ea72-4945-bbf5-774add699edf admin admin] PATH_INFO: `/v3/users/39a11b66e3564a0a8bf369242b4318eb` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:40.991801 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c85148-ea72-4945-bbf5-774add699edf admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a11b66e3564a0a8bf369242b4318eb)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:40.993810 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c85148-ea72-4945-bbf5-774add699edf admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:41.222493 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-61c85148-ea72-4945-bbf5-774add699edf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a11b66e3564a0a8bf369242b4318eb'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:41.325217 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-61c85148-ea72-4945-bbf5-774add699edf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a11b66e3564a0a8bf369242b4318eb'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:41.325876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-61c85148-ea72-4945-bbf5-774add699edf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a11b66e3564a0a8bf369242b4318eb'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:41.335267 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-61c85148-ea72-4945-bbf5-774add699edf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a11b66e3564a0a8bf369242b4318eb'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:41.336011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-61c85148-ea72-4945-bbf5-774add699edf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a11b66e3564a0a8bf369242b4318eb'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:41.364004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1407/2801] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:38:40 2022] DELETE /identity/v3/users/39a11b66e3564a0a8bf369242b4318eb => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:41.662442 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccb8e1-4729-4133-a079-46913f9864d7 service placement] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:41.673227 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccb8e1-4729-4133-a079-46913f9864d7 service placement] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:41.740437 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df6724-6197-40ce-b12f-c96bbfc56dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:41.741092 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df6724-6197-40ce-b12f-c96bbfc56dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:41.741417 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df6724-6197-40ce-b12f-c96bbfc56dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:41.741694 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df6724-6197-40ce-b12f-c96bbfc56dcc admin admin] PATH_INFO: `/v3/projects/9cb4651121bb4a908147a675515b8f1d` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:41.743207 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df6724-6197-40ce-b12f-c96bbfc56dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cb4651121bb4a908147a675515b8f1d)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:41.745115 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df6724-6197-40ce-b12f-c96bbfc56dcc admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:41.995626 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-22df6724-6197-40ce-b12f-c96bbfc56dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cb4651121bb4a908147a675515b8f1d', 'request_id': 'req-22df6724-6197-40ce-b12f-c96bbfc56dcc'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:42.181428 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-22df6724-6197-40ce-b12f-c96bbfc56dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cb4651121bb4a908147a675515b8f1d', 'request_id': 'req-22df6724-6197-40ce-b12f-c96bbfc56dcc'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:42.186449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:42.189395 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-22df6724-6197-40ce-b12f-c96bbfc56dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cb4651121bb4a908147a675515b8f1d', 'request_id': 'req-22df6724-6197-40ce-b12f-c96bbfc56dcc'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:42.205441 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-22df6724-6197-40ce-b12f-c96bbfc56dcc admin admin] The token cache is being invalidate because project 9cb4651121bb4a908147a675515b8f1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:38:42.205714 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-22df6724-6197-40ce-b12f-c96bbfc56dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:42.206457 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-22df6724-6197-40ce-b12f-c96bbfc56dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:42.208032 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1395/2802] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:38:41 2022] DELETE /identity/v3/projects/9cb4651121bb4a908147a675515b8f1d => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:42.214739 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c85148-ea72-4945-bbf5-774add699edf admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:42.217718 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-61c85148-ea72-4945-bbf5-774add699edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:42.232317 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c85148-ea72-4945-bbf5-774add699edf admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:42.294002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4f6d8-8025-4c3e-acf5-fa1bed67a4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:42.294689 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4f6d8-8025-4c3e-acf5-fa1bed67a4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:42.294985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4f6d8-8025-4c3e-acf5-fa1bed67a4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:42.295271 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4f6d8-8025-4c3e-acf5-fa1bed67a4b8 admin admin] PATH_INFO: `/v3/users/2b2670bafddd408397d16ec8ae031c4d` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:42.296455 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4f6d8-8025-4c3e-acf5-fa1bed67a4b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2670bafddd408397d16ec8ae031c4d)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:42.298400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4f6d8-8025-4c3e-acf5-fa1bed67a4b8 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:42.304583 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:42.628709 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d2b4f6d8-8025-4c3e-acf5-fa1bed67a4b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2670bafddd408397d16ec8ae031c4d'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:42.736816 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d2b4f6d8-8025-4c3e-acf5-fa1bed67a4b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2670bafddd408397d16ec8ae031c4d'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:42.737511 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d2b4f6d8-8025-4c3e-acf5-fa1bed67a4b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2670bafddd408397d16ec8ae031c4d'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:42.747191 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d2b4f6d8-8025-4c3e-acf5-fa1bed67a4b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2670bafddd408397d16ec8ae031c4d'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:42.748052 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-d2b4f6d8-8025-4c3e-acf5-fa1bed67a4b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2670bafddd408397d16ec8ae031c4d'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:42.769525 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1408/2803] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:38:42 2022] DELETE /identity/v3/users/2b2670bafddd408397d16ec8ae031c4d => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:43.111005 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df6724-6197-40ce-b12f-c96bbfc56dcc admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:43.115015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-22df6724-6197-40ce-b12f-c96bbfc56dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:43.132536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df6724-6197-40ce-b12f-c96bbfc56dcc admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:43.220791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b252a-18b4-4f0d-b299-5f5ab80ccf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:43.221892 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b252a-18b4-4f0d-b299-5f5ab80ccf79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:43.222387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b252a-18b4-4f0d-b299-5f5ab80ccf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:43.222920 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b252a-18b4-4f0d-b299-5f5ab80ccf79 admin admin] PATH_INFO: `/v3/projects/4f43a57e5f364075941d061e6aef51d7` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:43.224969 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b252a-18b4-4f0d-b299-5f5ab80ccf79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f43a57e5f364075941d061e6aef51d7)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:43.228783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b252a-18b4-4f0d-b299-5f5ab80ccf79 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:43.376210 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-826b252a-18b4-4f0d-b299-5f5ab80ccf79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f43a57e5f364075941d061e6aef51d7', 'request_id': 'req-826b252a-18b4-4f0d-b299-5f5ab80ccf79'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:43.558863 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-826b252a-18b4-4f0d-b299-5f5ab80ccf79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f43a57e5f364075941d061e6aef51d7', 'request_id': 'req-826b252a-18b4-4f0d-b299-5f5ab80ccf79'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:43.567527 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-826b252a-18b4-4f0d-b299-5f5ab80ccf79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f43a57e5f364075941d061e6aef51d7', 'request_id': 'req-826b252a-18b4-4f0d-b299-5f5ab80ccf79'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:43.591110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-826b252a-18b4-4f0d-b299-5f5ab80ccf79 admin admin] The token cache is being invalidate because project 4f43a57e5f364075941d061e6aef51d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:38:43.591450 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-826b252a-18b4-4f0d-b299-5f5ab80ccf79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:43.592177 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-826b252a-18b4-4f0d-b299-5f5ab80ccf79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:43.593989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1396/2804] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:38:43 2022] DELETE /identity/v3/projects/4f43a57e5f364075941d061e6aef51d7 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:50.393425 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4f6d8-8025-4c3e-acf5-fa1bed67a4b8 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:50.394990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-d2b4f6d8-8025-4c3e-acf5-fa1bed67a4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:50.411456 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4f6d8-8025-4c3e-acf5-fa1bed67a4b8 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:50.479748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20f92b-c246-44ae-9f49-e712723af379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:50.480699 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20f92b-c246-44ae-9f49-e712723af379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:50.481076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20f92b-c246-44ae-9f49-e712723af379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:50.481444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20f92b-c246-44ae-9f49-e712723af379 admin admin] PATH_INFO: `/v3/users/c5617de02fd744cf98254c2a821ace1a` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:50.483271 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20f92b-c246-44ae-9f49-e712723af379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5617de02fd744cf98254c2a821ace1a)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:50.485941 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20f92b-c246-44ae-9f49-e712723af379 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:50.906398 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bd20f92b-c246-44ae-9f49-e712723af379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5617de02fd744cf98254c2a821ace1a'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:51.011062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bd20f92b-c246-44ae-9f49-e712723af379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5617de02fd744cf98254c2a821ace1a'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:51.011704 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bd20f92b-c246-44ae-9f49-e712723af379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5617de02fd744cf98254c2a821ace1a'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:51.020686 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bd20f92b-c246-44ae-9f49-e712723af379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5617de02fd744cf98254c2a821ace1a'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:51.021660 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-bd20f92b-c246-44ae-9f49-e712723af379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5617de02fd744cf98254c2a821ace1a'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:51.045648 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1409/2805] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:38:50 2022] DELETE /identity/v3/users/c5617de02fd744cf98254c2a821ace1a => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:51.050512 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff97007-4d9f-4b96-90da-cba0e68abdc6 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:51.051760 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff97007-4d9f-4b96-90da-cba0e68abdc6 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:51.051760 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff97007-4d9f-4b96-90da-cba0e68abdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:51.073667 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-9ff97007-4d9f-4b96-90da-cba0e68abdc6 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:51.075102 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-9ff97007-4d9f-4b96-90da-cba0e68abdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:51.151818 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1397/2806] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:38:51.162152 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20f92b-c246-44ae-9f49-e712723af379 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:51.163672 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-bd20f92b-c246-44ae-9f49-e712723af379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:51.171181 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:51.233451 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20f92b-c246-44ae-9f49-e712723af379 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:51.237382 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf47672-e222-4350-822f-44e0b8333107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:51.238278 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf47672-e222-4350-822f-44e0b8333107 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:51.239012 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf47672-e222-4350-822f-44e0b8333107 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:51.239287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf47672-e222-4350-822f-44e0b8333107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:51.250276 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf47672-e222-4350-822f-44e0b8333107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:51.252090 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf47672-e222-4350-822f-44e0b8333107 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:51.264529 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1410/2807] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:38:51.728468 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff97007-4d9f-4b96-90da-cba0e68abdc6 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:51.730130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-9ff97007-4d9f-4b96-90da-cba0e68abdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:51.743980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff97007-4d9f-4b96-90da-cba0e68abdc6 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:51.753033 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91372a75-31ff-45a8-9592-11220a277aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:51.753033 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91372a75-31ff-45a8-9592-11220a277aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:51.753033 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91372a75-31ff-45a8-9592-11220a277aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:51.753033 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91372a75-31ff-45a8-9592-11220a277aaf admin admin] PATH_INFO: `/v3/projects/074035b2c39640859428ac9653dcfa2a` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:51.754729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91372a75-31ff-45a8-9592-11220a277aaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=074035b2c39640859428ac9653dcfa2a)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:51.754729 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91372a75-31ff-45a8-9592-11220a277aaf admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:51.785148 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:51.907409 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-91372a75-31ff-45a8-9592-11220a277aaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '074035b2c39640859428ac9653dcfa2a', 'request_id': 'req-91372a75-31ff-45a8-9592-11220a277aaf'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:51.964935 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-91372a75-31ff-45a8-9592-11220a277aaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '074035b2c39640859428ac9653dcfa2a', 'request_id': 'req-91372a75-31ff-45a8-9592-11220a277aaf'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:51.975605 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-91372a75-31ff-45a8-9592-11220a277aaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '074035b2c39640859428ac9653dcfa2a', 'request_id': 'req-91372a75-31ff-45a8-9592-11220a277aaf'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:51.995710 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-91372a75-31ff-45a8-9592-11220a277aaf admin admin] The token cache is being invalidate because project 074035b2c39640859428ac9653dcfa2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:38:51.996050 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-91372a75-31ff-45a8-9592-11220a277aaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:51.996721 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-91372a75-31ff-45a8-9592-11220a277aaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:38:51.998247 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1398/2808] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:38:51 2022] DELETE /identity/v3/projects/074035b2c39640859428ac9653dcfa2a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:52.003592 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4824b-47c2-4021-b88b-fba9e0a8df34 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:52.004424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4824b-47c2-4021-b88b-fba9e0a8df34 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:52.004654 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4824b-47c2-4021-b88b-fba9e0a8df34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:52.028307 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-ceb4824b-47c2-4021-b88b-fba9e0a8df34 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:52.034240 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-ceb4824b-47c2-4021-b88b-fba9e0a8df34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:52.094949 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1411/2809] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:38:52.103336 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac2d3b-91f0-4d65-87b8-9022de4e1020 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:52.103918 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac2d3b-91f0-4d65-87b8-9022de4e1020 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:52.103918 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac2d3b-91f0-4d65-87b8-9022de4e1020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:52.125685 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-feac2d3b-91f0-4d65-87b8-9022de4e1020 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:52.126958 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-feac2d3b-91f0-4d65-87b8-9022de4e1020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:52.135798 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1399/2810] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:38:52.140490 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4824b-47c2-4021-b88b-fba9e0a8df34 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:52.153619 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4824b-47c2-4021-b88b-fba9e0a8df34 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:52.159083 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cd383-1a79-4d7e-9faf-fa1d5dc3214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:52.159706 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cd383-1a79-4d7e-9faf-fa1d5dc3214b admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:52.159990 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cd383-1a79-4d7e-9faf-fa1d5dc3214b admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:52.160265 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cd383-1a79-4d7e-9faf-fa1d5dc3214b admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:52.160905 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cd383-1a79-4d7e-9faf-fa1d5dc3214b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:38:52.161207 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cd383-1a79-4d7e-9faf-fa1d5dc3214b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:52.162832 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cd383-1a79-4d7e-9faf-fa1d5dc3214b admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:52.175415 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1412/2811] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:38:52.181299 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac2d3b-91f0-4d65-87b8-9022de4e1020 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:52.190952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac2d3b-91f0-4d65-87b8-9022de4e1020 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:52.195808 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826bb83-5273-419a-ac8a-4f5330ca5983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:52.196951 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826bb83-5273-419a-ac8a-4f5330ca5983 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:52.197234 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826bb83-5273-419a-ac8a-4f5330ca5983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:52.197509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826bb83-5273-419a-ac8a-4f5330ca5983 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:52.198157 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826bb83-5273-419a-ac8a-4f5330ca5983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:52.200107 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826bb83-5273-419a-ac8a-4f5330ca5983 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:52.288197 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1400/2812] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:38:52 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:38:52.293467 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cd383-1a79-4d7e-9faf-fa1d5dc3214b admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:52.304895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cd383-1a79-4d7e-9faf-fa1d5dc3214b admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:52.369885 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5d416-f1ae-473e-adc0-45334a202363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:52.370503 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5d416-f1ae-473e-adc0-45334a202363 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:52.370815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5d416-f1ae-473e-adc0-45334a202363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:52.371088 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5d416-f1ae-473e-adc0-45334a202363 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:52.371746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5d416-f1ae-473e-adc0-45334a202363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:52.373716 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5d416-f1ae-473e-adc0-45334a202363 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:52.452639 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1413/2813] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:38:52 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:38:52.456856 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826bb83-5273-419a-ac8a-4f5330ca5983 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:52.469063 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826bb83-5273-419a-ac8a-4f5330ca5983 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:52.480051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b3b7a-b242-46b2-93cf-e48fcbcdadbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:52.481113 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b3b7a-b242-46b2-93cf-e48fcbcdadbb admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:52.481602 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b3b7a-b242-46b2-93cf-e48fcbcdadbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:52.482081 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b3b7a-b242-46b2-93cf-e48fcbcdadbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:52.483024 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b3b7a-b242-46b2-93cf-e48fcbcdadbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:52.484754 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b3b7a-b242-46b2-93cf-e48fcbcdadbb admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:52.501026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1401/2814] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:38:52.506000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5d416-f1ae-473e-adc0-45334a202363 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:52.520151 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5d416-f1ae-473e-adc0-45334a202363 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:52.527895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd87f4-f6b7-45ca-b4bd-aef6a4c9496d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:52.528934 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd87f4-f6b7-45ca-b4bd-aef6a4c9496d admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:52.529466 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd87f4-f6b7-45ca-b4bd-aef6a4c9496d admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:52.530144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd87f4-f6b7-45ca-b4bd-aef6a4c9496d admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:52.531586 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd87f4-f6b7-45ca-b4bd-aef6a4c9496d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:52.534434 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd87f4-f6b7-45ca-b4bd-aef6a4c9496d admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:52.552471 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1414/2815] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:38:52.557102 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b3b7a-b242-46b2-93cf-e48fcbcdadbb admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:52.573308 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b3b7a-b242-46b2-93cf-e48fcbcdadbb admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:52.578531 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097d75d-e5b8-4bbd-8c87-250485a5f292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:52.579243 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097d75d-e5b8-4bbd-8c87-250485a5f292 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:52.579525 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097d75d-e5b8-4bbd-8c87-250485a5f292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:52.579799 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097d75d-e5b8-4bbd-8c87-250485a5f292 admin admin] PATH_INFO: `/v3/projects/9dd361d272f1454a8e71dc3a1de1cb3e/users/cd523ea044f9459b8362166753c817f2/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:52.597929 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097d75d-e5b8-4bbd-8c87-250485a5f292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd361d272f1454a8e71dc3a1de1cb3e, user_id=cd523ea044f9459b8362166753c817f2, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:52.600750 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097d75d-e5b8-4bbd-8c87-250485a5f292 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:52.696685 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1402/2816] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:38:52 2022] PUT /identity/v3/projects/9dd361d272f1454a8e71dc3a1de1cb3e/users/cd523ea044f9459b8362166753c817f2/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:38:52.706137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505a2f4-b4da-44e7-9578-ac4b201d1159 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:52.706137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505a2f4-b4da-44e7-9578-ac4b201d1159 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:52.706137 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505a2f4-b4da-44e7-9578-ac4b201d1159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:52.725553 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-a505a2f4-b4da-44e7-9578-ac4b201d1159 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:52.726827 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-a505a2f4-b4da-44e7-9578-ac4b201d1159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:52.737134 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:52.805023 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1415/2817] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:38:52.816344 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097d75d-e5b8-4bbd-8c87-250485a5f292 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:52.819208 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-d097d75d-e5b8-4bbd-8c87-250485a5f292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:52.892367 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097d75d-e5b8-4bbd-8c87-250485a5f292 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:52.896149 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25279ce4-e380-4f6e-aee1-d987b080daaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:52.896764 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25279ce4-e380-4f6e-aee1-d987b080daaf service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:52.897044 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25279ce4-e380-4f6e-aee1-d987b080daaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:52.897314 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25279ce4-e380-4f6e-aee1-d987b080daaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:52.908156 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25279ce4-e380-4f6e-aee1-d987b080daaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:52.909623 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25279ce4-e380-4f6e-aee1-d987b080daaf service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:52.920797 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1403/2818] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:38:59.549006 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2e79f-e5e6-46ea-be73-9a2098a57f8c None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:59.549613 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2e79f-e5e6-46ea-be73-9a2098a57f8c None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:59.549812 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2e79f-e5e6-46ea-be73-9a2098a57f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:59.590011 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-0cf2e79f-e5e6-46ea-be73-9a2098a57f8c None None] MFA Rules not processed for user `cd523ea044f9459b8362166753c817f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:38:59.591310 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-0cf2e79f-e5e6-46ea-be73-9a2098a57f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:38:59.686779 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1416/2819] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:38:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:38:59.688371 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25279ce4-e380-4f6e-aee1-d987b080daaf service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:59.710561 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25279ce4-e380-4f6e-aee1-d987b080daaf service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:59.710561 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07c0b5-492d-4497-acbd-6889f544de52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:59.710561 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07c0b5-492d-4497-acbd-6889f544de52 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:59.710561 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07c0b5-492d-4497-acbd-6889f544de52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:59.711068 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07c0b5-492d-4497-acbd-6889f544de52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:59.711068 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07c0b5-492d-4497-acbd-6889f544de52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:59.711068 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07c0b5-492d-4497-acbd-6889f544de52 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:38:59.831984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1404/2820] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:38:59 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:38:59.839510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2e79f-e5e6-46ea-be73-9a2098a57f8c None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:38:59.857007 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2e79f-e5e6-46ea-be73-9a2098a57f8c None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:38:59.932822 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842b727-17d3-4477-b5d9-04b4ce9b2f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:38:59.933459 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842b727-17d3-4477-b5d9-04b4ce9b2f74 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:38:59.933788 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842b727-17d3-4477-b5d9-04b4ce9b2f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:38:59.934058 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842b727-17d3-4477-b5d9-04b4ce9b2f74 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:38:59.934829 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842b727-17d3-4477-b5d9-04b4ce9b2f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:38:59.936920 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842b727-17d3-4477-b5d9-04b4ce9b2f74 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:39:00.085438 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1417/2821] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:38:59 2022] POST /identity/v3/users => generated 298 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:39:00.090278 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07c0b5-492d-4497-acbd-6889f544de52 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:39:00.104273 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07c0b5-492d-4497-acbd-6889f544de52 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:39:00.109637 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fad01-f5fa-4f03-827a-d1d04278a1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:39:00.110246 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fad01-f5fa-4f03-827a-d1d04278a1ce admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:39:00.110573 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fad01-f5fa-4f03-827a-d1d04278a1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:39:00.110829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fad01-f5fa-4f03-827a-d1d04278a1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:39:00.111776 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fad01-f5fa-4f03-827a-d1d04278a1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:39:00.114144 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fad01-f5fa-4f03-827a-d1d04278a1ce admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:39:00.131287 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1405/2822] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:39:00.136668 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842b727-17d3-4477-b5d9-04b4ce9b2f74 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:39:00.149095 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842b727-17d3-4477-b5d9-04b4ce9b2f74 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:39:00.156577 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfaade-a73c-4679-b0b5-d44463985fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:39:00.157412 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfaade-a73c-4679-b0b5-d44463985fac admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:39:00.157859 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfaade-a73c-4679-b0b5-d44463985fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:39:00.158352 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfaade-a73c-4679-b0b5-d44463985fac admin admin] PATH_INFO: `/v3/projects/37580294b6a64983be42d862d2dcc86f/users/a75f3948af2d41f3a21a2a66a0620498/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:39:00.184353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfaade-a73c-4679-b0b5-d44463985fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=37580294b6a64983be42d862d2dcc86f, user_id=a75f3948af2d41f3a21a2a66a0620498, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:39:00.187770 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfaade-a73c-4679-b0b5-d44463985fac admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:39:00.268915 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1418/2823] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:39:00 2022] PUT /identity/v3/projects/37580294b6a64983be42d862d2dcc86f/users/a75f3948af2d41f3a21a2a66a0620498/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:39:00.271627 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fad01-f5fa-4f03-827a-d1d04278a1ce admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:39:00.284136 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fad01-f5fa-4f03-827a-d1d04278a1ce admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:39:00.291308 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:00.366725 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a9d1f-d2c8-47b9-899c-1fda31c391cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:39:00.371412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a9d1f-d2c8-47b9-899c-1fda31c391cd admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:39:00.371412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a9d1f-d2c8-47b9-899c-1fda31c391cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:39:00.371412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a9d1f-d2c8-47b9-899c-1fda31c391cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:39:00.371412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a9d1f-d2c8-47b9-899c-1fda31c391cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:39:00.371412 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a9d1f-d2c8-47b9-899c-1fda31c391cd admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:39:00.383048 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1406/2824] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:39:00.389424 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfaade-a73c-4679-b0b5-d44463985fac admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:39:00.401985 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfaade-a73c-4679-b0b5-d44463985fac admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:39:00.408928 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b7157-1ffd-43dd-b1cc-893b035ed306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:39:00.411692 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b7157-1ffd-43dd-b1cc-893b035ed306 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:39:00.411692 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b7157-1ffd-43dd-b1cc-893b035ed306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:39:00.411692 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b7157-1ffd-43dd-b1cc-893b035ed306 admin admin] PATH_INFO: `/v3/projects/37580294b6a64983be42d862d2dcc86f/users/a75f3948af2d41f3a21a2a66a0620498/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:39:00.413726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b7157-1ffd-43dd-b1cc-893b035ed306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37580294b6a64983be42d862d2dcc86f, user_id=a75f3948af2d41f3a21a2a66a0620498, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:39:00.417818 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b7157-1ffd-43dd-b1cc-893b035ed306 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:39:00.421878 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:00.437211 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1419/2825] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:39:00 2022] PUT /identity/v3/projects/37580294b6a64983be42d862d2dcc86f/users/a75f3948af2d41f3a21a2a66a0620498/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:39:08.721310 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4992a5f-34b5-4b2c-a766-4fbfd539b291 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:39:08.721310 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4992a5f-34b5-4b2c-a766-4fbfd539b291 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:39:08.721310 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4992a5f-34b5-4b2c-a766-4fbfd539b291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:39:08.768315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-f4992a5f-34b5-4b2c-a766-4fbfd539b291 None None] MFA Rules not processed for user `a75f3948af2d41f3a21a2a66a0620498`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:39:08.770552 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-f4992a5f-34b5-4b2c-a766-4fbfd539b291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:39:08.902280 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1407/2826] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:39:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:39:08.911611 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b7157-1ffd-43dd-b1cc-893b035ed306 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:39:08.917205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-970b7157-1ffd-43dd-b1cc-893b035ed306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:39:08.988927 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b7157-1ffd-43dd-b1cc-893b035ed306 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:39:08.992617 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c75ddd-d1a3-4915-bebc-02f056e10d2d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5b3a7a9a08e40718980143d7c4880ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:39:08.993759 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c75ddd-d1a3-4915-bebc-02f056e10d2d service glance] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:39:08.994110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c75ddd-d1a3-4915-bebc-02f056e10d2d service glance] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:39:08.994318 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c75ddd-d1a3-4915-bebc-02f056e10d2d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:39:09.061584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c75ddd-d1a3-4915-bebc-02f056e10d2d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:39:09.065936 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c75ddd-d1a3-4915-bebc-02f056e10d2d service glance] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:39:09.073320 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1420/2827] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:39:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:39:09.431307 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c66ec-1215-4100-b3df-c0567f834be0 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:39:09.431661 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c66ec-1215-4100-b3df-c0567f834be0 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:39:09.431941 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c66ec-1215-4100-b3df-c0567f834be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:39:09.457673 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-4f5c66ec-1215-4100-b3df-c0567f834be0 None None] MFA Rules not processed for user `f2cea4c08f324769bf6dcea58c9394b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:39:09.458949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4f5c66ec-1215-4100-b3df-c0567f834be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:39:09.526261 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1408/2828] 10.222.0.83 () {58 vars in 1009 bytes} [Fri Sep 23 01:39:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:39:09.548468 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c75ddd-d1a3-4915-bebc-02f056e10d2d service glance] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:39:09.549901 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-68c75ddd-d1a3-4915-bebc-02f056e10d2d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:39:09.626054 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c75ddd-d1a3-4915-bebc-02f056e10d2d service glance] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:39:09.631462 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f77d8-fec0-40d2-9177-fc2cbeea3222 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526c7ad227943d1a2bba7b5e2e039e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:39:09.632328 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f77d8-fec0-40d2-9177-fc2cbeea3222 service swift] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:39:09.632606 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f77d8-fec0-40d2-9177-fc2cbeea3222 service swift] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:39:09.632880 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f77d8-fec0-40d2-9177-fc2cbeea3222 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:39:09.641947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f77d8-fec0-40d2-9177-fc2cbeea3222 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:39:09.643580 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f77d8-fec0-40d2-9177-fc2cbeea3222 service swift] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:39:09.662133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1421/2829] 10.222.0.83 () {60 vars in 1384 bytes} [Fri Sep 23 01:39:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 01:39:13.780085 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bbdbd-2842-4c1b-845d-dc53e0ee3476 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:39:13.780562 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bbdbd-2842-4c1b-845d-dc53e0ee3476 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:39:13.780781 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bbdbd-2842-4c1b-845d-dc53e0ee3476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:39:13.814496 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-367bbdbd-2842-4c1b-845d-dc53e0ee3476 None None] MFA Rules not processed for user `6dd52c257878410f97776b2a1739bca8`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:39:13.817994 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-367bbdbd-2842-4c1b-845d-dc53e0ee3476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:39:13.908025 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:13.951084 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1409/2830] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:39:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:39:19.648955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=82 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:22.288779 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7399962-cc0c-4738-ba0e-e2a3558785f8 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:39:22.289448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7399962-cc0c-4738-ba0e-e2a3558785f8 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:39:22.289448 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7399962-cc0c-4738-ba0e-e2a3558785f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:39:22.310032 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-e7399962-cc0c-4738-ba0e-e2a3558785f8 None None] MFA Rules not processed for user `cd523ea044f9459b8362166753c817f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:39:22.311276 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-e7399962-cc0c-4738-ba0e-e2a3558785f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:39:22.318351 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1422/2831] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:39:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:39:23.958842 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=9 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:27.311502 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23391b9b-785d-4c69-a909-254107606a4c None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:39:27.312198 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23391b9b-785d-4c69-a909-254107606a4c None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:39:27.312198 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23391b9b-785d-4c69-a909-254107606a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:39:27.342766 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-23391b9b-785d-4c69-a909-254107606a4c None None] MFA Rules not processed for user `f2cea4c08f324769bf6dcea58c9394b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:39:27.344542 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-23391b9b-785d-4c69-a909-254107606a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:39:27.353875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1410/2832] 10.222.0.83 () {58 vars in 1009 bytes} [Fri Sep 23 01:39:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:39:27.368263 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7399962-cc0c-4738-ba0e-e2a3558785f8 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:39:27.382259 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7399962-cc0c-4738-ba0e-e2a3558785f8 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:39:27.387854 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66588f8-15e0-443b-b8bb-f762f3a7d81b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526c7ad227943d1a2bba7b5e2e039e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:39:27.388583 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66588f8-15e0-443b-b8bb-f762f3a7d81b service swift] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:39:27.388935 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66588f8-15e0-443b-b8bb-f762f3a7d81b service swift] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:39:27.389294 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66588f8-15e0-443b-b8bb-f762f3a7d81b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:39:27.399084 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66588f8-15e0-443b-b8bb-f762f3a7d81b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:39:27.401218 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66588f8-15e0-443b-b8bb-f762f3a7d81b service swift] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:39:27.413532 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1423/2833] 10.222.0.83 () {60 vars in 1384 bytes} [Fri Sep 23 01:39:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 01:39:37.342953 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:37.407820 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=9 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:55.875875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23391b9b-785d-4c69-a909-254107606a4c None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:39:55.877845 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-23391b9b-785d-4c69-a909-254107606a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:39:55.962269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23391b9b-785d-4c69-a909-254107606a4c None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:39:55.968986 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b3e5e-f4e2-4d47-a1f9-c6b385e086bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:39:55.970055 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b3e5e-f4e2-4d47-a1f9-c6b385e086bd service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:39:55.970563 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b3e5e-f4e2-4d47-a1f9-c6b385e086bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:39:55.971110 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b3e5e-f4e2-4d47-a1f9-c6b385e086bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:39:55.988942 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b3e5e-f4e2-4d47-a1f9-c6b385e086bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:39:55.992240 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b3e5e-f4e2-4d47-a1f9-c6b385e086bd service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:39:56.011447 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1411/2834] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:39:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:40:01.927028 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66588f8-15e0-443b-b8bb-f762f3a7d81b service swift] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:40:01.937461 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66588f8-15e0-443b-b8bb-f762f3a7d81b service swift] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:40:01.941865 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649952b-af2f-4e7a-a14e-6afc2f006a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:40:01.942484 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649952b-af2f-4e7a-a14e-6afc2f006a69 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:40:01.942795 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649952b-af2f-4e7a-a14e-6afc2f006a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:40:01.943064 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649952b-af2f-4e7a-a14e-6afc2f006a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:40:01.945690 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-e649952b-af2f-4e7a-a14e-6afc2f006a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:40:02.029383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649952b-af2f-4e7a-a14e-6afc2f006a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:40:02.030958 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649952b-af2f-4e7a-a14e-6afc2f006a69 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:40:02.043638 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1424/2835] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:40:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:40:02.681339 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b3e5e-f4e2-4d47-a1f9-c6b385e086bd service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:40:02.697220 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b3e5e-f4e2-4d47-a1f9-c6b385e086bd service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:40:02.707956 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917b292-b3a3-4cbf-9dde-cb9e9b65e5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:40:02.708999 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917b292-b3a3-4cbf-9dde-cb9e9b65e5fc service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:40:02.709482 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917b292-b3a3-4cbf-9dde-cb9e9b65e5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:40:02.710047 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917b292-b3a3-4cbf-9dde-cb9e9b65e5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:40:02.714388 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e917b292-b3a3-4cbf-9dde-cb9e9b65e5fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:40:02.740383 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917b292-b3a3-4cbf-9dde-cb9e9b65e5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:40:02.743783 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917b292-b3a3-4cbf-9dde-cb9e9b65e5fc service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:40:02.769373 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1412/2836] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:40:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:40:12.037509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=34 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:40:12.761917 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=32 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:40:32.924177 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b38b94-5779-43bc-b4d9-822a346d9763 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:40:32.924769 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b38b94-5779-43bc-b4d9-822a346d9763 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:40:32.925178 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b38b94-5779-43bc-b4d9-822a346d9763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:40:32.964304 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-50b38b94-5779-43bc-b4d9-822a346d9763 None None] MFA Rules not processed for user `f2cea4c08f324769bf6dcea58c9394b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:40:32.966406 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-50b38b94-5779-43bc-b4d9-822a346d9763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:40:32.980590 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1425/2837] 10.222.0.83 () {58 vars in 1009 bytes} [Fri Sep 23 01:40:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:40:33.039845 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917b292-b3a3-4cbf-9dde-cb9e9b65e5fc service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:40:33.053002 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917b292-b3a3-4cbf-9dde-cb9e9b65e5fc service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:40:33.066827 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b377fc-b8b9-4402-9bc0-dea474b07710 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526c7ad227943d1a2bba7b5e2e039e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:40:33.067463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b377fc-b8b9-4402-9bc0-dea474b07710 service swift] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:40:33.067744 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b377fc-b8b9-4402-9bc0-dea474b07710 service swift] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:40:33.068018 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b377fc-b8b9-4402-9bc0-dea474b07710 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:40:33.083643 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b377fc-b8b9-4402-9bc0-dea474b07710 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:40:33.085404 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b377fc-b8b9-4402-9bc0-dea474b07710 service swift] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:40:33.107372 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1413/2838] 10.222.0.83 () {60 vars in 1384 bytes} [Fri Sep 23 01:40:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 01:40:42.953366 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:40:43.092083 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=6 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:40:52.193359 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229db1dd-c45c-4e37-9fb5-abfb7117416a None None] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:40:52.194022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229db1dd-c45c-4e37-9fb5-abfb7117416a None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:40:52.194022 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229db1dd-c45c-4e37-9fb5-abfb7117416a None None] PATH_INFO: `/` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:40:52.195320 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1426/2839] 10.222.0.83 () {54 vars in 921 bytes} [Fri Sep 23 01:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 01:40:52.200834 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ea661-ddcf-40bb-bb2c-97f86cca4eb8 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:40:52.201344 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ea661-ddcf-40bb-bb2c-97f86cca4eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:40:52.201449 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ea661-ddcf-40bb-bb2c-97f86cca4eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:40:52.244556 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-0d9ea661-ddcf-40bb-bb2c-97f86cca4eb8 None None] MFA Rules not processed for user `824648d693af4b44ae5df853a3d258f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:40:52.251257 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-0d9ea661-ddcf-40bb-bb2c-97f86cca4eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:40:52.262702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1414/2840] 10.222.0.83 () {58 vars in 1018 bytes} [Fri Sep 23 01:40:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:40:52.274892 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229db1dd-c45c-4e37-9fb5-abfb7117416a None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:40:52.294005 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229db1dd-c45c-4e37-9fb5-abfb7117416a None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:40:52.298851 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27ccd7-7651-4a73-964e-1035273d44da service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5b3a7a9a08e40718980143d7c4880ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:40:52.300108 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27ccd7-7651-4a73-964e-1035273d44da service glance] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:40:52.300383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27ccd7-7651-4a73-964e-1035273d44da service glance] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:40:52.300677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27ccd7-7651-4a73-964e-1035273d44da service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:40:52.312162 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27ccd7-7651-4a73-964e-1035273d44da service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:40:52.313614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27ccd7-7651-4a73-964e-1035273d44da service glance] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:40:52.326839 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1427/2841] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:40:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:40:52.675774 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ea661-ddcf-40bb-bb2c-97f86cca4eb8 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:40:52.677223 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-0d9ea661-ddcf-40bb-bb2c-97f86cca4eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:40:52.754356 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ea661-ddcf-40bb-bb2c-97f86cca4eb8 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:40:52.760946 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299877df-112a-451d-b38c-dcc137e9a4f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eab2cbff5984fa6a8e715ed6553db82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:40:52.761579 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299877df-112a-451d-b38c-dcc137e9a4f8 service placement] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:40:52.761856 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299877df-112a-451d-b38c-dcc137e9a4f8 service placement] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:40:52.762127 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299877df-112a-451d-b38c-dcc137e9a4f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:40:52.763948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-299877df-112a-451d-b38c-dcc137e9a4f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:40:52.777510 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299877df-112a-451d-b38c-dcc137e9a4f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:40:52.779208 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299877df-112a-451d-b38c-dcc137e9a4f8 service placement] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:40:52.790989 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1415/2842] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:40:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:40:54.546218 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27ccd7-7651-4a73-964e-1035273d44da service glance] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:40:54.556138 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27ccd7-7651-4a73-964e-1035273d44da service glance] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:40:54.559891 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a8c2a-f4ff-4f89-b6e9-79a8cc57c108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:40:54.560533 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a8c2a-f4ff-4f89-b6e9-79a8cc57c108 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:40:54.560815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a8c2a-f4ff-4f89-b6e9-79a8cc57c108 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:40:54.561083 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a8c2a-f4ff-4f89-b6e9-79a8cc57c108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:40:54.562950 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b42a8c2a-f4ff-4f89-b6e9-79a8cc57c108 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:40:54.573861 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a8c2a-f4ff-4f89-b6e9-79a8cc57c108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:40:54.575445 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a8c2a-f4ff-4f89-b6e9-79a8cc57c108 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:40:54.586511 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1428/2843] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:40:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:40:55.706857 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07d1d3-0835-49cb-a400-864fdf05d935 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:40:55.707432 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07d1d3-0835-49cb-a400-864fdf05d935 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:40:55.707432 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07d1d3-0835-49cb-a400-864fdf05d935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:40:55.769858 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-4a07d1d3-0835-49cb-a400-864fdf05d935 None None] MFA Rules not processed for user `f2cea4c08f324769bf6dcea58c9394b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:40:55.771176 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4a07d1d3-0835-49cb-a400-864fdf05d935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:40:55.791026 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1416/2844] 10.222.0.83 () {58 vars in 1009 bytes} [Fri Sep 23 01:40:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:40:55.804306 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a8c2a-f4ff-4f89-b6e9-79a8cc57c108 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:40:55.833037 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a8c2a-f4ff-4f89-b6e9-79a8cc57c108 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:40:55.838646 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea52f7b-7e30-4622-9a0a-b8fc406df6aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526c7ad227943d1a2bba7b5e2e039e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:40:55.839315 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea52f7b-7e30-4622-9a0a-b8fc406df6aa service swift] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:40:55.839594 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea52f7b-7e30-4622-9a0a-b8fc406df6aa service swift] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:40:55.839868 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea52f7b-7e30-4622-9a0a-b8fc406df6aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:40:55.852656 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea52f7b-7e30-4622-9a0a-b8fc406df6aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:40:55.854494 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea52f7b-7e30-4622-9a0a-b8fc406df6aa service swift] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:40:55.865736 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1429/2845] 10.222.0.83 () {60 vars in 1384 bytes} [Fri Sep 23 01:40:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 01:41:05.787589 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=59 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:41:05.860378 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=22 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:41:06.523837 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07d1d3-0835-49cb-a400-864fdf05d935 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:41:06.525106 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4a07d1d3-0835-49cb-a400-864fdf05d935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:41:06.541586 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07d1d3-0835-49cb-a400-864fdf05d935 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:41:06.547724 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b1b23-94cc-4163-9390-fc2a569e0285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:41:06.548990 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b1b23-94cc-4163-9390-fc2a569e0285 service nova] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:41:06.549983 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b1b23-94cc-4163-9390-fc2a569e0285 service nova] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:41:06.550281 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b1b23-94cc-4163-9390-fc2a569e0285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:41:06.552181 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e69b1b23-94cc-4163-9390-fc2a569e0285 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:41:06.564414 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b1b23-94cc-4163-9390-fc2a569e0285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:41:06.566777 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b1b23-94cc-4163-9390-fc2a569e0285 service nova] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:41:06.578329 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1417/2846] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:41:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:41:12.854316 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3972c-f546-4d15-a759-a53848b98e82 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:41:12.854858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3972c-f546-4d15-a759-a53848b98e82 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:41:12.854959 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3972c-f546-4d15-a759-a53848b98e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:41:12.873996 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-efc3972c-f546-4d15-a759-a53848b98e82 None None] MFA Rules not processed for user `f2cea4c08f324769bf6dcea58c9394b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:41:12.875215 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-efc3972c-f546-4d15-a759-a53848b98e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:41:12.883008 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1430/2847] 10.222.0.83 () {58 vars in 967 bytes} [Fri Sep 23 01:41:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:41:12.896013 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b1b23-94cc-4163-9390-fc2a569e0285 service nova] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:41:12.907317 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b1b23-94cc-4163-9390-fc2a569e0285 service nova] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:41:12.912370 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7fd73-eb18-469a-8a86-47377c5a9dfb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526c7ad227943d1a2bba7b5e2e039e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:41:12.912986 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7fd73-eb18-469a-8a86-47377c5a9dfb service swift] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:41:12.913292 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7fd73-eb18-469a-8a86-47377c5a9dfb service swift] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:41:12.913565 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7fd73-eb18-469a-8a86-47377c5a9dfb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:41:12.921984 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7fd73-eb18-469a-8a86-47377c5a9dfb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:41:12.923588 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7fd73-eb18-469a-8a86-47377c5a9dfb service swift] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:41:12.931819 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1418/2848] 10.222.0.83 () {60 vars in 1384 bytes} [Fri Sep 23 01:41:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 01:41:15.869948 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3972c-f546-4d15-a759-a53848b98e82 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:41:15.894629 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3972c-f546-4d15-a759-a53848b98e82 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:41:15.898908 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47713cb5-dd76-4569-9c46-99f202d2b58e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:41:15.899782 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713cb5-dd76-4569-9c46-99f202d2b58e service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:41:15.900133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713cb5-dd76-4569-9c46-99f202d2b58e service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:41:15.900494 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713cb5-dd76-4569-9c46-99f202d2b58e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:41:15.903669 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-47713cb5-dd76-4569-9c46-99f202d2b58e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:41:15.917282 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47713cb5-dd76-4569-9c46-99f202d2b58e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:41:15.919109 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47713cb5-dd76-4569-9c46-99f202d2b58e service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:41:15.932130 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1431/2849] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:41:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:41:22.928558 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=12 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:41:25.266577 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb491a6-2cb3-41a9-80cb-92bd2043e5c5 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:41:25.267486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb491a6-2cb3-41a9-80cb-92bd2043e5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:41:25.267486 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb491a6-2cb3-41a9-80cb-92bd2043e5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:41:25.286952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-ffb491a6-2cb3-41a9-80cb-92bd2043e5c5 None None] MFA Rules not processed for user `f2cea4c08f324769bf6dcea58c9394b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:41:25.288215 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-ffb491a6-2cb3-41a9-80cb-92bd2043e5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:41:25.296020 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1419/2850] 10.222.0.83 () {58 vars in 967 bytes} [Fri Sep 23 01:41:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:41:25.311179 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47713cb5-dd76-4569-9c46-99f202d2b58e service nova] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:41:25.323523 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47713cb5-dd76-4569-9c46-99f202d2b58e service nova] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:41:25.332854 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6dc9bb-2f79-41b5-92a4-b19576d9a33f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526c7ad227943d1a2bba7b5e2e039e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:41:25.333719 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dc9bb-2f79-41b5-92a4-b19576d9a33f service swift] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:41:25.334004 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dc9bb-2f79-41b5-92a4-b19576d9a33f service swift] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:41:25.334358 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dc9bb-2f79-41b5-92a4-b19576d9a33f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:41:25.343975 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6dc9bb-2f79-41b5-92a4-b19576d9a33f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:41:25.345397 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6dc9bb-2f79-41b5-92a4-b19576d9a33f service swift] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:41:25.354497 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1432/2851] 10.222.0.83 () {60 vars in 1384 bytes} [Fri Sep 23 01:41:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 01:41:33.763931 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb491a6-2cb3-41a9-80cb-92bd2043e5c5 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:41:33.842858 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb491a6-2cb3-41a9-80cb-92bd2043e5c5 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:41:33.848692 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8323402-e32c-4f98-8750-a92f89f37199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:41:33.849091 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8323402-e32c-4f98-8750-a92f89f37199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:41:33.849478 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8323402-e32c-4f98-8750-a92f89f37199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:41:33.849684 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8323402-e32c-4f98-8750-a92f89f37199 admin admin] PATH_INFO: `/v3/users/cd523ea044f9459b8362166753c817f2` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:41:33.850949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8323402-e32c-4f98-8750-a92f89f37199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd523ea044f9459b8362166753c817f2)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:41:33.853504 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8323402-e32c-4f98-8750-a92f89f37199 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:41:34.088228 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-e8323402-e32c-4f98-8750-a92f89f37199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd523ea044f9459b8362166753c817f2'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:34.100536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-e8323402-e32c-4f98-8750-a92f89f37199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd523ea044f9459b8362166753c817f2'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:34.185674 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-e8323402-e32c-4f98-8750-a92f89f37199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd523ea044f9459b8362166753c817f2'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:34.186308 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-e8323402-e32c-4f98-8750-a92f89f37199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd523ea044f9459b8362166753c817f2'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:34.194764 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-e8323402-e32c-4f98-8750-a92f89f37199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd523ea044f9459b8362166753c817f2'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:34.200933 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1420/2852] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:41:33 2022] DELETE /identity/v3/users/cd523ea044f9459b8362166753c817f2 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:41:34.456279 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6dc9bb-2f79-41b5-92a4-b19576d9a33f service swift] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:41:34.471000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6dc9bb-2f79-41b5-92a4-b19576d9a33f service swift] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:41:34.528818 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b61f0c-cdaa-4fec-83d6-010bf93e0891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:41:34.529454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b61f0c-cdaa-4fec-83d6-010bf93e0891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:41:34.529733 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b61f0c-cdaa-4fec-83d6-010bf93e0891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:41:34.530005 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b61f0c-cdaa-4fec-83d6-010bf93e0891 admin admin] PATH_INFO: `/v3/projects/9dd361d272f1454a8e71dc3a1de1cb3e` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:41:34.531150 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b61f0c-cdaa-4fec-83d6-010bf93e0891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd361d272f1454a8e71dc3a1de1cb3e)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:41:34.533185 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b61f0c-cdaa-4fec-83d6-010bf93e0891 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:41:34.672313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-08b61f0c-cdaa-4fec-83d6-010bf93e0891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd361d272f1454a8e71dc3a1de1cb3e', 'request_id': 'req-08b61f0c-cdaa-4fec-83d6-010bf93e0891'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:34.922845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-08b61f0c-cdaa-4fec-83d6-010bf93e0891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd361d272f1454a8e71dc3a1de1cb3e', 'request_id': 'req-08b61f0c-cdaa-4fec-83d6-010bf93e0891'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:34.929201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-08b61f0c-cdaa-4fec-83d6-010bf93e0891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd361d272f1454a8e71dc3a1de1cb3e', 'request_id': 'req-08b61f0c-cdaa-4fec-83d6-010bf93e0891'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:34.941055 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-08b61f0c-cdaa-4fec-83d6-010bf93e0891 admin admin] The token cache is being invalidate because project 9dd361d272f1454a8e71dc3a1de1cb3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:41:34.941772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-08b61f0c-cdaa-4fec-83d6-010bf93e0891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:34.942074 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-08b61f0c-cdaa-4fec-83d6-010bf93e0891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:34.943567 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1433/2853] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:41:34 2022] DELETE /identity/v3/projects/9dd361d272f1454a8e71dc3a1de1cb3e => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:41:34.948318 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8323402-e32c-4f98-8750-a92f89f37199 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:41:34.949775 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e8323402-e32c-4f98-8750-a92f89f37199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:41:34.963223 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8323402-e32c-4f98-8750-a92f89f37199 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:41:35.023069 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5b681-ba18-422e-8ce0-09004ee2d43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:41:35.023705 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5b681-ba18-422e-8ce0-09004ee2d43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:41:35.024010 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5b681-ba18-422e-8ce0-09004ee2d43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:41:35.024312 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5b681-ba18-422e-8ce0-09004ee2d43c admin admin] PATH_INFO: `/v3/users/a75f3948af2d41f3a21a2a66a0620498` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:41:35.025515 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5b681-ba18-422e-8ce0-09004ee2d43c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a75f3948af2d41f3a21a2a66a0620498)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:41:35.027498 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5b681-ba18-422e-8ce0-09004ee2d43c admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:41:35.042256 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:41:35.257629 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-00e5b681-ba18-422e-8ce0-09004ee2d43c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a75f3948af2d41f3a21a2a66a0620498'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:35.270726 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-00e5b681-ba18-422e-8ce0-09004ee2d43c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a75f3948af2d41f3a21a2a66a0620498'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:35.356190 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-00e5b681-ba18-422e-8ce0-09004ee2d43c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a75f3948af2d41f3a21a2a66a0620498'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:35.356978 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-00e5b681-ba18-422e-8ce0-09004ee2d43c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a75f3948af2d41f3a21a2a66a0620498'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:35.364697 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-00e5b681-ba18-422e-8ce0-09004ee2d43c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a75f3948af2d41f3a21a2a66a0620498'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:35.371587 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1421/2854] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:41:34 2022] DELETE /identity/v3/users/a75f3948af2d41f3a21a2a66a0620498 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:41:35.895943 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b61f0c-cdaa-4fec-83d6-010bf93e0891 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:41:35.901874 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-08b61f0c-cdaa-4fec-83d6-010bf93e0891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:41:35.905129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=67,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:41:35.910882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b61f0c-cdaa-4fec-83d6-010bf93e0891 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:41:35.969937 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15230afa-7e80-42a5-bee0-a51ea2a7aad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:41:35.970500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15230afa-7e80-42a5-bee0-a51ea2a7aad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:41:35.970828 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15230afa-7e80-42a5-bee0-a51ea2a7aad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:41:35.971265 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15230afa-7e80-42a5-bee0-a51ea2a7aad0 admin admin] PATH_INFO: `/v3/projects/37580294b6a64983be42d862d2dcc86f` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:41:35.973115 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15230afa-7e80-42a5-bee0-a51ea2a7aad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37580294b6a64983be42d862d2dcc86f)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:41:35.975106 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15230afa-7e80-42a5-bee0-a51ea2a7aad0 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:41:36.130305 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-15230afa-7e80-42a5-bee0-a51ea2a7aad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37580294b6a64983be42d862d2dcc86f', 'request_id': 'req-15230afa-7e80-42a5-bee0-a51ea2a7aad0'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:36.242988 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-15230afa-7e80-42a5-bee0-a51ea2a7aad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37580294b6a64983be42d862d2dcc86f', 'request_id': 'req-15230afa-7e80-42a5-bee0-a51ea2a7aad0'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:36.249757 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-15230afa-7e80-42a5-bee0-a51ea2a7aad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37580294b6a64983be42d862d2dcc86f', 'request_id': 'req-15230afa-7e80-42a5-bee0-a51ea2a7aad0'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:36.262043 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-15230afa-7e80-42a5-bee0-a51ea2a7aad0 admin admin] The token cache is being invalidate because project 37580294b6a64983be42d862d2dcc86f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:41:36.262370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-15230afa-7e80-42a5-bee0-a51ea2a7aad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:36.263013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-15230afa-7e80-42a5-bee0-a51ea2a7aad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:41:36.264766 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1434/2855] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:41:35 2022] DELETE /identity/v3/projects/37580294b6a64983be42d862d2dcc86f => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:41:45.367431 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=21,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:41:46.258822 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:41:58.597345 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5b681-ba18-422e-8ce0-09004ee2d43c admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:41:58.599237 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-00e5b681-ba18-422e-8ce0-09004ee2d43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:41:58.692948 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5b681-ba18-422e-8ce0-09004ee2d43c admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:41:58.757738 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57252dc9-501b-4251-914e-cdf3e1290143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:41:58.758364 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57252dc9-501b-4251-914e-cdf3e1290143 service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:41:58.758674 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57252dc9-501b-4251-914e-cdf3e1290143 service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:41:58.759022 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57252dc9-501b-4251-914e-cdf3e1290143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:41:58.761321 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-57252dc9-501b-4251-914e-cdf3e1290143 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:41:58.835168 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57252dc9-501b-4251-914e-cdf3e1290143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:41:58.836983 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57252dc9-501b-4251-914e-cdf3e1290143 service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:41:58.850211 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1422/2856] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:41:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:42:03.140292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15230afa-7e80-42a5-bee0-a51ea2a7aad0 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:03.140292 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-15230afa-7e80-42a5-bee0-a51ea2a7aad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:03.153042 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15230afa-7e80-42a5-bee0-a51ea2a7aad0 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:03.158882 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c513db3-0a63-43d5-8f62-2f7faa07af66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:03.159540 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c513db3-0a63-43d5-8f62-2f7faa07af66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:03.159815 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c513db3-0a63-43d5-8f62-2f7faa07af66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:03.160080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c513db3-0a63-43d5-8f62-2f7faa07af66 admin admin] PATH_INFO: `/v3/users/6dd52c257878410f97776b2a1739bca8` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:03.161249 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c513db3-0a63-43d5-8f62-2f7faa07af66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dd52c257878410f97776b2a1739bca8)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:03.163662 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c513db3-0a63-43d5-8f62-2f7faa07af66 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:03.430770 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-5c513db3-0a63-43d5-8f62-2f7faa07af66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dd52c257878410f97776b2a1739bca8'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:03.506133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-5c513db3-0a63-43d5-8f62-2f7faa07af66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dd52c257878410f97776b2a1739bca8'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:03.506927 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-5c513db3-0a63-43d5-8f62-2f7faa07af66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dd52c257878410f97776b2a1739bca8'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:03.518786 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-5c513db3-0a63-43d5-8f62-2f7faa07af66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dd52c257878410f97776b2a1739bca8'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:03.519552 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-5c513db3-0a63-43d5-8f62-2f7faa07af66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dd52c257878410f97776b2a1739bca8'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:03.542327 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1435/2857] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:42:03 2022] DELETE /identity/v3/users/6dd52c257878410f97776b2a1739bca8 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:42:03.845712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57252dc9-501b-4251-914e-cdf3e1290143 service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:03.856585 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57252dc9-501b-4251-914e-cdf3e1290143 service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:03.937569 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca3637-9a97-4a85-8143-d456110b03a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:03.938293 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca3637-9a97-4a85-8143-d456110b03a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:03.938608 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca3637-9a97-4a85-8143-d456110b03a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:03.938898 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca3637-9a97-4a85-8143-d456110b03a5 admin admin] PATH_INFO: `/v3/projects/6ee88a9c3cac404fa07e13ba0ca7ab05` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:03.940095 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca3637-9a97-4a85-8143-d456110b03a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ee88a9c3cac404fa07e13ba0ca7ab05)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:03.942127 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca3637-9a97-4a85-8143-d456110b03a5 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:03.951829 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=100 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:04.085057 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-7fca3637-9a97-4a85-8143-d456110b03a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ee88a9c3cac404fa07e13ba0ca7ab05', 'request_id': 'req-7fca3637-9a97-4a85-8143-d456110b03a5'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:04.197137 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-7fca3637-9a97-4a85-8143-d456110b03a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ee88a9c3cac404fa07e13ba0ca7ab05', 'request_id': 'req-7fca3637-9a97-4a85-8143-d456110b03a5'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:04.204124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-7fca3637-9a97-4a85-8143-d456110b03a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ee88a9c3cac404fa07e13ba0ca7ab05', 'request_id': 'req-7fca3637-9a97-4a85-8143-d456110b03a5'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:04.216819 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-7fca3637-9a97-4a85-8143-d456110b03a5 admin admin] The token cache is being invalidate because project 6ee88a9c3cac404fa07e13ba0ca7ab05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:42:04.217113 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-7fca3637-9a97-4a85-8143-d456110b03a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:04.217791 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-7fca3637-9a97-4a85-8143-d456110b03a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:04.219386 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1423/2858] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:42:03 2022] DELETE /identity/v3/projects/6ee88a9c3cac404fa07e13ba0ca7ab05 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:04.225670 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f765f-d3cc-46d3-a136-586ca9d54642 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:04.226229 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f765f-d3cc-46d3-a136-586ca9d54642 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:04.226229 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f765f-d3cc-46d3-a136-586ca9d54642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:04.248616 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-225f765f-d3cc-46d3-a136-586ca9d54642 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:04.250419 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-225f765f-d3cc-46d3-a136-586ca9d54642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:04.315177 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1436/2859] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:04.323451 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2203e-4780-46f2-8641-a1d528a37da4 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:04.323836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2203e-4780-46f2-8641-a1d528a37da4 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:04.323997 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2203e-4780-46f2-8641-a1d528a37da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:04.344904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-d7b2203e-4780-46f2-8641-a1d528a37da4 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:04.346051 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-d7b2203e-4780-46f2-8641-a1d528a37da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:04.354218 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1424/2860] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:04.359456 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f765f-d3cc-46d3-a136-586ca9d54642 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:04.376337 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f765f-d3cc-46d3-a136-586ca9d54642 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:04.383195 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba3893-537b-49c9-a1f9-f86916fa6256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:04.383866 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba3893-537b-49c9-a1f9-f86916fa6256 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:04.384341 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba3893-537b-49c9-a1f9-f86916fa6256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:04.384782 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba3893-537b-49c9-a1f9-f86916fa6256 admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:04.385688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba3893-537b-49c9-a1f9-f86916fa6256 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:42:04.386006 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba3893-537b-49c9-a1f9-f86916fa6256 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:04.388141 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba3893-537b-49c9-a1f9-f86916fa6256 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:04.402006 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1437/2861] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:42:04.408537 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2203e-4780-46f2-8641-a1d528a37da4 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:04.419142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2203e-4780-46f2-8641-a1d528a37da4 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:04.425584 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab22e5-ed66-42ab-8b50-40d58f1ea760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:04.426182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab22e5-ed66-42ab-8b50-40d58f1ea760 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:04.426456 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab22e5-ed66-42ab-8b50-40d58f1ea760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:04.426749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab22e5-ed66-42ab-8b50-40d58f1ea760 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:04.427405 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab22e5-ed66-42ab-8b50-40d58f1ea760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:04.429343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab22e5-ed66-42ab-8b50-40d58f1ea760 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:04.536495 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1425/2862] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:42:04 2022] POST /identity/v3/projects => generated 403 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:42:04.541166 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba3893-537b-49c9-a1f9-f86916fa6256 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:04.552864 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba3893-537b-49c9-a1f9-f86916fa6256 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:04.612979 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef722691-875f-4e18-9541-ae8b483eee7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:04.613504 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef722691-875f-4e18-9541-ae8b483eee7a admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:04.613781 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef722691-875f-4e18-9541-ae8b483eee7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:04.614057 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef722691-875f-4e18-9541-ae8b483eee7a admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:04.614725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef722691-875f-4e18-9541-ae8b483eee7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:04.616908 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef722691-875f-4e18-9541-ae8b483eee7a admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:04.625319 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:04.700945 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1438/2863] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:42:04 2022] POST /identity/v3/users => generated 302 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:42:04.705224 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab22e5-ed66-42ab-8b50-40d58f1ea760 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:04.715899 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab22e5-ed66-42ab-8b50-40d58f1ea760 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:04.721155 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4dd0a-0e98-4403-869c-4b34658e29a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:04.721754 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4dd0a-0e98-4403-869c-4b34658e29a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:04.722029 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4dd0a-0e98-4403-869c-4b34658e29a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:04.722300 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4dd0a-0e98-4403-869c-4b34658e29a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:04.722969 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4dd0a-0e98-4403-869c-4b34658e29a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:04.724581 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4dd0a-0e98-4403-869c-4b34658e29a0 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:04.735432 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1426/2864] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:42:04.739750 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef722691-875f-4e18-9541-ae8b483eee7a admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:04.751376 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef722691-875f-4e18-9541-ae8b483eee7a admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:04.756228 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85343a-6589-4cce-8391-ef2fdd54f4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:04.756926 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85343a-6589-4cce-8391-ef2fdd54f4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:04.757204 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85343a-6589-4cce-8391-ef2fdd54f4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:04.757380 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85343a-6589-4cce-8391-ef2fdd54f4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:04.758024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85343a-6589-4cce-8391-ef2fdd54f4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:04.759666 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85343a-6589-4cce-8391-ef2fdd54f4f3 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:04.771827 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1439/2865] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:42:04.777180 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4dd0a-0e98-4403-869c-4b34658e29a0 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:04.788632 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4dd0a-0e98-4403-869c-4b34658e29a0 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:04.793646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10beff2f-2cd9-4660-9b3b-6cd31c18c36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:04.794327 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beff2f-2cd9-4660-9b3b-6cd31c18c36b admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:04.794614 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beff2f-2cd9-4660-9b3b-6cd31c18c36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:04.794896 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beff2f-2cd9-4660-9b3b-6cd31c18c36b admin admin] PATH_INFO: `/v3/projects/a238b019b4db43bea693ed62ec50f461/users/eadbb583ac2a49c98906f0b39fcd5599/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:04.813747 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10beff2f-2cd9-4660-9b3b-6cd31c18c36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a238b019b4db43bea693ed62ec50f461, user_id=eadbb583ac2a49c98906f0b39fcd5599, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:04.816438 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10beff2f-2cd9-4660-9b3b-6cd31c18c36b admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:04.895303 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1427/2866] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:42:04 2022] PUT /identity/v3/projects/a238b019b4db43bea693ed62ec50f461/users/eadbb583ac2a49c98906f0b39fcd5599/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:04.900618 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d30a95-a7ae-43f7-910f-2da9dbb36dd8 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:04.900916 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d30a95-a7ae-43f7-910f-2da9dbb36dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:04.901304 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d30a95-a7ae-43f7-910f-2da9dbb36dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:04.924153 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-54d30a95-a7ae-43f7-910f-2da9dbb36dd8 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:04.925555 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-54d30a95-a7ae-43f7-910f-2da9dbb36dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:04.992133 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1440/2867] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:05.002300 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10beff2f-2cd9-4660-9b3b-6cd31c18c36b admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:05.004222 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-10beff2f-2cd9-4660-9b3b-6cd31c18c36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:05.072520 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10beff2f-2cd9-4660-9b3b-6cd31c18c36b admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:05.076796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb24a85-1bb2-4631-a823-1de228ef2d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:05.078069 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb24a85-1bb2-4631-a823-1de228ef2d4e service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:05.078482 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb24a85-1bb2-4631-a823-1de228ef2d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:05.078833 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb24a85-1bb2-4631-a823-1de228ef2d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:05.089530 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb24a85-1bb2-4631-a823-1de228ef2d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:05.091056 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb24a85-1bb2-4631-a823-1de228ef2d4e service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:05.102544 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1428/2868] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:42:06.656889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0968c8a-9094-4589-8076-3c0bcfd978a6 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:06.659031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0968c8a-9094-4589-8076-3c0bcfd978a6 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:06.659031 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0968c8a-9094-4589-8076-3c0bcfd978a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:06.686581 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-e0968c8a-9094-4589-8076-3c0bcfd978a6 None None] MFA Rules not processed for user `eadbb583ac2a49c98906f0b39fcd5599`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:06.688354 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-e0968c8a-9094-4589-8076-3c0bcfd978a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:06.777264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1441/2869] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:06 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:06.782275 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb24a85-1bb2-4631-a823-1de228ef2d4e service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:06.792396 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb24a85-1bb2-4631-a823-1de228ef2d4e service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:06.797290 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd9177-7340-4b78-9a8e-64d05945c22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:06.797907 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd9177-7340-4b78-9a8e-64d05945c22b admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:06.798191 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd9177-7340-4b78-9a8e-64d05945c22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:06.798497 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd9177-7340-4b78-9a8e-64d05945c22b admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:06.799209 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd9177-7340-4b78-9a8e-64d05945c22b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:06.801128 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd9177-7340-4b78-9a8e-64d05945c22b admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:06.901927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1429/2870] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:42:06 2022] POST /identity/v3/projects => generated 405 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:42:06.906462 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0968c8a-9094-4589-8076-3c0bcfd978a6 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:06.918103 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0968c8a-9094-4589-8076-3c0bcfd978a6 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:06.980685 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346878f-6532-498e-b2d5-912de7f9e985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:06.981301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346878f-6532-498e-b2d5-912de7f9e985 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:06.981572 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346878f-6532-498e-b2d5-912de7f9e985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:06.981889 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346878f-6532-498e-b2d5-912de7f9e985 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:06.982518 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346878f-6532-498e-b2d5-912de7f9e985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:06.984472 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346878f-6532-498e-b2d5-912de7f9e985 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:07.094884 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:07.101124 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1442/2871] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:42:06 2022] POST /identity/v3/users => generated 309 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:42:07.106311 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd9177-7340-4b78-9a8e-64d05945c22b admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:07.123904 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd9177-7340-4b78-9a8e-64d05945c22b admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:07.129188 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9934e-a6ad-40f2-91a6-03623f20496a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:07.129808 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9934e-a6ad-40f2-91a6-03623f20496a admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:07.130083 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9934e-a6ad-40f2-91a6-03623f20496a admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:07.130351 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9934e-a6ad-40f2-91a6-03623f20496a admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:07.131023 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9934e-a6ad-40f2-91a6-03623f20496a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:07.132690 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9934e-a6ad-40f2-91a6-03623f20496a admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:07.144524 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1430/2872] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:42:07.151776 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346878f-6532-498e-b2d5-912de7f9e985 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:07.163099 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346878f-6532-498e-b2d5-912de7f9e985 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:07.168142 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d0532-b273-4330-84af-7cebd4940650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:07.169726 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d0532-b273-4330-84af-7cebd4940650 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:07.170059 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d0532-b273-4330-84af-7cebd4940650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:07.170335 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d0532-b273-4330-84af-7cebd4940650 admin admin] PATH_INFO: `/v3/projects/de5cd19a6def46ae9a4f38ad92788e53/users/a06fca07d1bb4e3e8a46e1b4b10a97b7/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:07.188248 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d0532-b273-4330-84af-7cebd4940650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5cd19a6def46ae9a4f38ad92788e53, user_id=a06fca07d1bb4e3e8a46e1b4b10a97b7, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:07.191021 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d0532-b273-4330-84af-7cebd4940650 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:07.305062 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1443/2873] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:42:07 2022] PUT /identity/v3/projects/de5cd19a6def46ae9a4f38ad92788e53/users/a06fca07d1bb4e3e8a46e1b4b10a97b7/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:07.309577 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9934e-a6ad-40f2-91a6-03623f20496a admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:07.315884 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:07.321994 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9934e-a6ad-40f2-91a6-03623f20496a admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:07.407029 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f14c7d-cb9e-44fa-bae8-19efcb03cedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:07.407638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f14c7d-cb9e-44fa-bae8-19efcb03cedb admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:07.407913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f14c7d-cb9e-44fa-bae8-19efcb03cedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:07.408193 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f14c7d-cb9e-44fa-bae8-19efcb03cedb admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:07.408816 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f14c7d-cb9e-44fa-bae8-19efcb03cedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:07.410398 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f14c7d-cb9e-44fa-bae8-19efcb03cedb admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:07.420625 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1431/2874] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 01:42:07.425509 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d0532-b273-4330-84af-7cebd4940650 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:07.436007 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d0532-b273-4330-84af-7cebd4940650 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:07.441208 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f8d29-53a2-403b-bbcd-a6c2fed94d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:07.441863 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f8d29-53a2-403b-bbcd-a6c2fed94d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:07.442138 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f8d29-53a2-403b-bbcd-a6c2fed94d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:07.442408 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f8d29-53a2-403b-bbcd-a6c2fed94d79 admin admin] PATH_INFO: `/v3/projects/de5cd19a6def46ae9a4f38ad92788e53/users/a06fca07d1bb4e3e8a46e1b4b10a97b7/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:07.444322 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f8d29-53a2-403b-bbcd-a6c2fed94d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5cd19a6def46ae9a4f38ad92788e53, user_id=a06fca07d1bb4e3e8a46e1b4b10a97b7, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:07.447127 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f8d29-53a2-403b-bbcd-a6c2fed94d79 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:07.458109 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1444/2875] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:42:07 2022] PUT /identity/v3/projects/de5cd19a6def46ae9a4f38ad92788e53/users/a06fca07d1bb4e3e8a46e1b4b10a97b7/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:42:08.946960 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8feff1-e5cf-4acf-bd87-5071f97c37c7 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:08.947539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8feff1-e5cf-4acf-bd87-5071f97c37c7 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:08.947539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8feff1-e5cf-4acf-bd87-5071f97c37c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:08.977938 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-4b8feff1-e5cf-4acf-bd87-5071f97c37c7 None None] MFA Rules not processed for user `a06fca07d1bb4e3e8a46e1b4b10a97b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:08.979200 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-4b8feff1-e5cf-4acf-bd87-5071f97c37c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:09.063669 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1432/2876] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:08 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:10.474094 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f8d29-53a2-403b-bbcd-a6c2fed94d79 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:10.556127 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f8d29-53a2-403b-bbcd-a6c2fed94d79 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:10.560673 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ff5ee-3caa-4677-9d19-2b9d54232dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:10.561344 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ff5ee-3caa-4677-9d19-2b9d54232dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:10.561662 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ff5ee-3caa-4677-9d19-2b9d54232dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:10.561954 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ff5ee-3caa-4677-9d19-2b9d54232dba admin admin] PATH_INFO: `/v3/users/eadbb583ac2a49c98906f0b39fcd5599` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:10.563110 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ff5ee-3caa-4677-9d19-2b9d54232dba admin admin] RBAC: Authorizing `identity:delete_user(user_id=eadbb583ac2a49c98906f0b39fcd5599)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:10.565049 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ff5ee-3caa-4677-9d19-2b9d54232dba admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:10.763919 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7a3ff5ee-3caa-4677-9d19-2b9d54232dba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eadbb583ac2a49c98906f0b39fcd5599'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:10.854407 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7a3ff5ee-3caa-4677-9d19-2b9d54232dba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eadbb583ac2a49c98906f0b39fcd5599'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:10.855038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7a3ff5ee-3caa-4677-9d19-2b9d54232dba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eadbb583ac2a49c98906f0b39fcd5599'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:10.863131 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7a3ff5ee-3caa-4677-9d19-2b9d54232dba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eadbb583ac2a49c98906f0b39fcd5599'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:10.863835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7a3ff5ee-3caa-4677-9d19-2b9d54232dba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eadbb583ac2a49c98906f0b39fcd5599'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:10.890367 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1445/2877] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:42:10 2022] DELETE /identity/v3/users/eadbb583ac2a49c98906f0b39fcd5599 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:11.227917 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8feff1-e5cf-4acf-bd87-5071f97c37c7 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:11.240111 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8feff1-e5cf-4acf-bd87-5071f97c37c7 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:11.306788 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacae31c-bb4e-4cf3-a04f-9de3b1d08fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:11.307509 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacae31c-bb4e-4cf3-a04f-9de3b1d08fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:11.307722 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacae31c-bb4e-4cf3-a04f-9de3b1d08fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:11.307994 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacae31c-bb4e-4cf3-a04f-9de3b1d08fdc admin admin] PATH_INFO: `/v3/projects/a238b019b4db43bea693ed62ec50f461` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:11.309155 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacae31c-bb4e-4cf3-a04f-9de3b1d08fdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a238b019b4db43bea693ed62ec50f461)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:11.311360 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacae31c-bb4e-4cf3-a04f-9de3b1d08fdc admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:11.410129 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:11.429238 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-dacae31c-bb4e-4cf3-a04f-9de3b1d08fdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a238b019b4db43bea693ed62ec50f461', 'request_id': 'req-dacae31c-bb4e-4cf3-a04f-9de3b1d08fdc'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:11.540001 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-dacae31c-bb4e-4cf3-a04f-9de3b1d08fdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a238b019b4db43bea693ed62ec50f461', 'request_id': 'req-dacae31c-bb4e-4cf3-a04f-9de3b1d08fdc'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:11.547881 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-dacae31c-bb4e-4cf3-a04f-9de3b1d08fdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a238b019b4db43bea693ed62ec50f461', 'request_id': 'req-dacae31c-bb4e-4cf3-a04f-9de3b1d08fdc'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:11.560578 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-dacae31c-bb4e-4cf3-a04f-9de3b1d08fdc admin admin] The token cache is being invalidate because project a238b019b4db43bea693ed62ec50f461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:42:11.560868 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-dacae31c-bb4e-4cf3-a04f-9de3b1d08fdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:11.561572 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-dacae31c-bb4e-4cf3-a04f-9de3b1d08fdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:11.563232 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1433/2878] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:42:11 2022] DELETE /identity/v3/projects/a238b019b4db43bea693ed62ec50f461 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:11.568298 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ff5ee-3caa-4677-9d19-2b9d54232dba admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:11.570654 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-7a3ff5ee-3caa-4677-9d19-2b9d54232dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:11.590220 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ff5ee-3caa-4677-9d19-2b9d54232dba admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:11.637845 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:11.660045 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7d1ea-8198-4f78-8c71-a6bd6b8377cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:11.660741 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7d1ea-8198-4f78-8c71-a6bd6b8377cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:11.661017 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7d1ea-8198-4f78-8c71-a6bd6b8377cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:11.661284 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7d1ea-8198-4f78-8c71-a6bd6b8377cb admin admin] PATH_INFO: `/v3/users/a06fca07d1bb4e3e8a46e1b4b10a97b7` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:11.662478 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e7d1ea-8198-4f78-8c71-a6bd6b8377cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a06fca07d1bb4e3e8a46e1b4b10a97b7)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:11.664550 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e7d1ea-8198-4f78-8c71-a6bd6b8377cb admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:11.842522 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e5e7d1ea-8198-4f78-8c71-a6bd6b8377cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a06fca07d1bb4e3e8a46e1b4b10a97b7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:11.952096 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e5e7d1ea-8198-4f78-8c71-a6bd6b8377cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a06fca07d1bb4e3e8a46e1b4b10a97b7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:11.953387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e5e7d1ea-8198-4f78-8c71-a6bd6b8377cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a06fca07d1bb4e3e8a46e1b4b10a97b7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:11.961993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e5e7d1ea-8198-4f78-8c71-a6bd6b8377cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a06fca07d1bb4e3e8a46e1b4b10a97b7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:11.963077 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-e5e7d1ea-8198-4f78-8c71-a6bd6b8377cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a06fca07d1bb4e3e8a46e1b4b10a97b7'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:11.985372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1446/2879] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:42:11 2022] DELETE /identity/v3/users/a06fca07d1bb4e3e8a46e1b4b10a97b7 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:12.269203 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacae31c-bb4e-4cf3-a04f-9de3b1d08fdc admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:12.270239 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-dacae31c-bb4e-4cf3-a04f-9de3b1d08fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:12.289481 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacae31c-bb4e-4cf3-a04f-9de3b1d08fdc admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:12.370889 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e716d-b95d-4528-98b5-cf397987e5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:12.371463 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e716d-b95d-4528-98b5-cf397987e5d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:12.371738 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e716d-b95d-4528-98b5-cf397987e5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:12.372014 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e716d-b95d-4528-98b5-cf397987e5d0 admin admin] PATH_INFO: `/v3/projects/de5cd19a6def46ae9a4f38ad92788e53` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:12.373262 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e716d-b95d-4528-98b5-cf397987e5d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5cd19a6def46ae9a4f38ad92788e53)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:12.375843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e716d-b95d-4528-98b5-cf397987e5d0 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:12.487306 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-6d8e716d-b95d-4528-98b5-cf397987e5d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5cd19a6def46ae9a4f38ad92788e53', 'request_id': 'req-6d8e716d-b95d-4528-98b5-cf397987e5d0'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:12.590178 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-6d8e716d-b95d-4528-98b5-cf397987e5d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5cd19a6def46ae9a4f38ad92788e53', 'request_id': 'req-6d8e716d-b95d-4528-98b5-cf397987e5d0'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:12.597079 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-6d8e716d-b95d-4528-98b5-cf397987e5d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5cd19a6def46ae9a4f38ad92788e53', 'request_id': 'req-6d8e716d-b95d-4528-98b5-cf397987e5d0'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:12.610564 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-6d8e716d-b95d-4528-98b5-cf397987e5d0 admin admin] The token cache is being invalidate because project de5cd19a6def46ae9a4f38ad92788e53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:42:12.611047 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-6d8e716d-b95d-4528-98b5-cf397987e5d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:12.611842 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-6d8e716d-b95d-4528-98b5-cf397987e5d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:12.613551 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1434/2880] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:42:12 2022] DELETE /identity/v3/projects/de5cd19a6def46ae9a4f38ad92788e53 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:12.618858 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfb922-1192-4ecb-ab11-30d668d3d3b3 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:12.619384 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfb922-1192-4ecb-ab11-30d668d3d3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:12.619384 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfb922-1192-4ecb-ab11-30d668d3d3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:12.641273 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-91bfb922-1192-4ecb-ab11-30d668d3d3b3 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:12.641539 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-91bfb922-1192-4ecb-ab11-30d668d3d3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:12.702656 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1447/2881] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:12.710536 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6eb00b-3d4e-49bc-b425-c167253bee8f None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:12.710846 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6eb00b-3d4e-49bc-b425-c167253bee8f None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:12.711223 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6eb00b-3d4e-49bc-b425-c167253bee8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:12.732527 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-9c6eb00b-3d4e-49bc-b425-c167253bee8f None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:12.735982 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-9c6eb00b-3d4e-49bc-b425-c167253bee8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:12.743372 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1435/2882] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:12.748040 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfb922-1192-4ecb-ab11-30d668d3d3b3 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:12.759073 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfb922-1192-4ecb-ab11-30d668d3d3b3 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:12.764175 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635bfd6d-caa9-44d1-a77f-59c5ae5d71de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:12.764799 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bfd6d-caa9-44d1-a77f-59c5ae5d71de admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:12.765074 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bfd6d-caa9-44d1-a77f-59c5ae5d71de admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:12.765340 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bfd6d-caa9-44d1-a77f-59c5ae5d71de admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:12.766003 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635bfd6d-caa9-44d1-a77f-59c5ae5d71de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:42:12.766301 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635bfd6d-caa9-44d1-a77f-59c5ae5d71de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:12.767983 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635bfd6d-caa9-44d1-a77f-59c5ae5d71de admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:12.782276 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1448/2883] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:42:12.787634 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6eb00b-3d4e-49bc-b425-c167253bee8f None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:12.798211 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6eb00b-3d4e-49bc-b425-c167253bee8f None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:12.803429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c7db0-4737-472e-b6b3-e8d920239237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:12.804089 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c7db0-4737-472e-b6b3-e8d920239237 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:12.804366 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c7db0-4737-472e-b6b3-e8d920239237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:12.804633 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c7db0-4737-472e-b6b3-e8d920239237 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:12.805269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c7db0-4737-472e-b6b3-e8d920239237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:12.807436 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c7db0-4737-472e-b6b3-e8d920239237 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:12.930054 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1436/2884] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:42:12 2022] POST /identity/v3/projects => generated 361 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:42:12.934461 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635bfd6d-caa9-44d1-a77f-59c5ae5d71de admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:12.947647 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635bfd6d-caa9-44d1-a77f-59c5ae5d71de admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:12.998341 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:13.011433 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fe226-57be-4ba8-b98d-50386d869fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:13.012042 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fe226-57be-4ba8-b98d-50386d869fcb admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:13.012344 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fe226-57be-4ba8-b98d-50386d869fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:13.012609 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fe226-57be-4ba8-b98d-50386d869fcb admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:13.013325 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fe226-57be-4ba8-b98d-50386d869fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:13.015303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fe226-57be-4ba8-b98d-50386d869fcb admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:13.089366 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1449/2885] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:42:12 2022] POST /identity/v3/users => generated 281 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:42:13.094311 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c7db0-4737-472e-b6b3-e8d920239237 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:13.105301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c7db0-4737-472e-b6b3-e8d920239237 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:13.110229 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86588347-9940-4510-949b-847d3607bca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:13.110892 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86588347-9940-4510-949b-847d3607bca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:13.111175 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86588347-9940-4510-949b-847d3607bca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:13.111450 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86588347-9940-4510-949b-847d3607bca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:13.112104 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86588347-9940-4510-949b-847d3607bca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:13.114239 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86588347-9940-4510-949b-847d3607bca2 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:13.125954 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1437/2886] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:42:13.130606 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fe226-57be-4ba8-b98d-50386d869fcb admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:13.141546 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fe226-57be-4ba8-b98d-50386d869fcb admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:13.149217 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfa1a3-3213-4a8e-a350-e77ae28a2fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:13.149843 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfa1a3-3213-4a8e-a350-e77ae28a2fde admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:13.150126 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfa1a3-3213-4a8e-a350-e77ae28a2fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:13.150400 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfa1a3-3213-4a8e-a350-e77ae28a2fde admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:13.151104 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfa1a3-3213-4a8e-a350-e77ae28a2fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:13.152748 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfa1a3-3213-4a8e-a350-e77ae28a2fde admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:13.164843 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1450/2887] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:42:13.169417 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86588347-9940-4510-949b-847d3607bca2 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:13.176191 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:13.180283 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86588347-9940-4510-949b-847d3607bca2 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:13.185090 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a3492-d13b-49c4-993f-5fc1d1187625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:13.197828 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a3492-d13b-49c4-993f-5fc1d1187625 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:13.197828 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a3492-d13b-49c4-993f-5fc1d1187625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:13.197828 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a3492-d13b-49c4-993f-5fc1d1187625 admin admin] PATH_INFO: `/v3/projects/67cc85e691514f8eb265f790ffeb4051/users/30f8b590a38b4502b2210882404745f2/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:13.209668 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a3492-d13b-49c4-993f-5fc1d1187625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67cc85e691514f8eb265f790ffeb4051, user_id=30f8b590a38b4502b2210882404745f2, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:13.212430 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a3492-d13b-49c4-993f-5fc1d1187625 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:13.276112 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1438/2888] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:42:13 2022] PUT /identity/v3/projects/67cc85e691514f8eb265f790ffeb4051/users/30f8b590a38b4502b2210882404745f2/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:42:13.288883 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6225a-052d-4abe-83c4-7c690556e613 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:13.289763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6225a-052d-4abe-83c4-7c690556e613 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:13.289763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6225a-052d-4abe-83c4-7c690556e613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:13.323056 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-21d6225a-052d-4abe-83c4-7c690556e613 None None] MFA Rules not processed for user `30f8b590a38b4502b2210882404745f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:13.324409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-21d6225a-052d-4abe-83c4-7c690556e613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:13.400913 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1451/2889] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:13.406206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a3492-d13b-49c4-993f-5fc1d1187625 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:13.475951 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a3492-d13b-49c4-993f-5fc1d1187625 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:13.480686 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4164aa-1dc9-4b4d-9e8f-c9dbc4257566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:13.481301 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4164aa-1dc9-4b4d-9e8f-c9dbc4257566 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:13.481579 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4164aa-1dc9-4b4d-9e8f-c9dbc4257566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:13.481847 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4164aa-1dc9-4b4d-9e8f-c9dbc4257566 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:13.483290 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4164aa-1dc9-4b4d-9e8f-c9dbc4257566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:13.484513 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4164aa-1dc9-4b4d-9e8f-c9dbc4257566 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:13.621725 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1439/2890] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:42:13 2022] POST /identity/v3/projects => generated 365 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:42:13.625775 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6225a-052d-4abe-83c4-7c690556e613 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:13.639803 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6225a-052d-4abe-83c4-7c690556e613 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:13.697146 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a569e2a-457d-4d18-9a9e-fb11c27a46f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:13.697759 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a569e2a-457d-4d18-9a9e-fb11c27a46f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:13.698192 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a569e2a-457d-4d18-9a9e-fb11c27a46f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:13.698413 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a569e2a-457d-4d18-9a9e-fb11c27a46f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:13.699091 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a569e2a-457d-4d18-9a9e-fb11c27a46f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:13.701034 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a569e2a-457d-4d18-9a9e-fb11c27a46f8 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:13.837671 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1452/2891] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:42:13 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:42:13.842119 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4164aa-1dc9-4b4d-9e8f-c9dbc4257566 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:13.856071 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4164aa-1dc9-4b4d-9e8f-c9dbc4257566 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:13.860830 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fdfc8-7e24-4e6c-868d-7975c6a11b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:13.861497 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fdfc8-7e24-4e6c-868d-7975c6a11b31 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:13.861775 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fdfc8-7e24-4e6c-868d-7975c6a11b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:13.862059 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fdfc8-7e24-4e6c-868d-7975c6a11b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:13.862757 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5fdfc8-7e24-4e6c-868d-7975c6a11b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:13.864390 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5fdfc8-7e24-4e6c-868d-7975c6a11b31 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:13.876334 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1440/2892] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:42:13.881291 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a569e2a-457d-4d18-9a9e-fb11c27a46f8 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:13.892602 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a569e2a-457d-4d18-9a9e-fb11c27a46f8 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:13.897543 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e7b53-8ad4-403a-93c9-7fc5d12441df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:13.898242 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e7b53-8ad4-403a-93c9-7fc5d12441df admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:13.898519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e7b53-8ad4-403a-93c9-7fc5d12441df admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:13.898895 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e7b53-8ad4-403a-93c9-7fc5d12441df admin admin] PATH_INFO: `/v3/projects/e7b0e5cf57044f4e9379d115ec13a724/users/9014309deb904cfc9a7c7001210c1736/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:13.916503 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e7b53-8ad4-403a-93c9-7fc5d12441df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b0e5cf57044f4e9379d115ec13a724, user_id=9014309deb904cfc9a7c7001210c1736, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:13.919210 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e7b53-8ad4-403a-93c9-7fc5d12441df admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:14.025173 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1453/2893] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:42:13 2022] PUT /identity/v3/projects/e7b0e5cf57044f4e9379d115ec13a724/users/9014309deb904cfc9a7c7001210c1736/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:14.029789 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fdfc8-7e24-4e6c-868d-7975c6a11b31 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:14.041015 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fdfc8-7e24-4e6c-868d-7975c6a11b31 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:14.105203 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be770604-aed4-49ae-b9a9-0633d4196c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:14.105778 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be770604-aed4-49ae-b9a9-0633d4196c8f admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:14.106056 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be770604-aed4-49ae-b9a9-0633d4196c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:14.106326 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be770604-aed4-49ae-b9a9-0633d4196c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:14.107024 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be770604-aed4-49ae-b9a9-0633d4196c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:14.108889 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be770604-aed4-49ae-b9a9-0633d4196c8f admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:14.120955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1441/2894] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:42:14.125608 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e7b53-8ad4-403a-93c9-7fc5d12441df admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:14.136745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e7b53-8ad4-403a-93c9-7fc5d12441df admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:14.142252 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5ef3e-3718-48e9-a7ff-2dbb6899f1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:14.142970 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5ef3e-3718-48e9-a7ff-2dbb6899f1a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:14.143250 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5ef3e-3718-48e9-a7ff-2dbb6899f1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:14.143523 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5ef3e-3718-48e9-a7ff-2dbb6899f1a5 admin admin] PATH_INFO: `/v3/projects/e7b0e5cf57044f4e9379d115ec13a724/users/9014309deb904cfc9a7c7001210c1736/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:14.145487 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5ef3e-3718-48e9-a7ff-2dbb6899f1a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b0e5cf57044f4e9379d115ec13a724, user_id=9014309deb904cfc9a7c7001210c1736, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:14.148163 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5ef3e-3718-48e9-a7ff-2dbb6899f1a5 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:14.160024 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1454/2895] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:42:14 2022] PUT /identity/v3/projects/e7b0e5cf57044f4e9379d115ec13a724/users/9014309deb904cfc9a7c7001210c1736/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 01:42:14.170710 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d71bd5-8ea3-46a8-8d05-30821714fef3 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:14.171127 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d71bd5-8ea3-46a8-8d05-30821714fef3 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:14.171539 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d71bd5-8ea3-46a8-8d05-30821714fef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:14.202030 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-44d71bd5-8ea3-46a8-8d05-30821714fef3 None None] MFA Rules not processed for user `9014309deb904cfc9a7c7001210c1736`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:14.203895 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-44d71bd5-8ea3-46a8-8d05-30821714fef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:14.245023 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:14.275142 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1442/2896] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:14.287521 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5ef3e-3718-48e9-a7ff-2dbb6899f1a5 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:14.289374 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-31c5ef3e-3718-48e9-a7ff-2dbb6899f1a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:14.299955 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:14.348848 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5ef3e-3718-48e9-a7ff-2dbb6899f1a5 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:14.352593 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4136b09-6791-4714-899f-dd4e7f737db0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:14.353204 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136b09-6791-4714-899f-dd4e7f737db0 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:14.353485 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136b09-6791-4714-899f-dd4e7f737db0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:14.353756 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136b09-6791-4714-899f-dd4e7f737db0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:14.363201 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4136b09-6791-4714-899f-dd4e7f737db0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:14.364649 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4136b09-6791-4714-899f-dd4e7f737db0 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:14.375914 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1455/2897] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:42:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:42:14.633749 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d71bd5-8ea3-46a8-8d05-30821714fef3 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:14.644998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d71bd5-8ea3-46a8-8d05-30821714fef3 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:14.648795 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229debe-d771-4cc7-8c6c-142c86c28133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:14.649453 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229debe-d771-4cc7-8c6c-142c86c28133 service cinder] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:14.649769 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229debe-d771-4cc7-8c6c-142c86c28133 service cinder] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:14.650133 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229debe-d771-4cc7-8c6c-142c86c28133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:14.712441 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229debe-d771-4cc7-8c6c-142c86c28133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:14.713957 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229debe-d771-4cc7-8c6c-142c86c28133 service cinder] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:14.725521 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1443/2898] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:42:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:42:18.646142 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4136b09-6791-4714-899f-dd4e7f737db0 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:18.711770 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4136b09-6791-4714-899f-dd4e7f737db0 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:18.716604 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ca2ea-9031-4f36-8e89-b5e864dc819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:18.717269 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ca2ea-9031-4f36-8e89-b5e864dc819a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:18.717559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ca2ea-9031-4f36-8e89-b5e864dc819a admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:18.717833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ca2ea-9031-4f36-8e89-b5e864dc819a admin admin] PATH_INFO: `/v3/users/30f8b590a38b4502b2210882404745f2` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:18.719029 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ca2ea-9031-4f36-8e89-b5e864dc819a admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f8b590a38b4502b2210882404745f2)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:18.727303 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ca2ea-9031-4f36-8e89-b5e864dc819a admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:18.925463 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f59ca2ea-9031-4f36-8e89-b5e864dc819a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f8b590a38b4502b2210882404745f2'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:18.991123 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f59ca2ea-9031-4f36-8e89-b5e864dc819a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f8b590a38b4502b2210882404745f2'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:18.992115 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f59ca2ea-9031-4f36-8e89-b5e864dc819a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f8b590a38b4502b2210882404745f2'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:19.000648 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f59ca2ea-9031-4f36-8e89-b5e864dc819a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f8b590a38b4502b2210882404745f2'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:19.002253 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-f59ca2ea-9031-4f36-8e89-b5e864dc819a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f8b590a38b4502b2210882404745f2'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:19.021387 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1456/2899] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:42:18 2022] DELETE /identity/v3/users/30f8b590a38b4502b2210882404745f2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:19.026090 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35309196-fddf-41e8-8e5c-5cbbc026d557 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:19.026742 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35309196-fddf-41e8-8e5c-5cbbc026d557 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:19.026742 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35309196-fddf-41e8-8e5c-5cbbc026d557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:19.048087 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-35309196-fddf-41e8-8e5c-5cbbc026d557 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:19.049312 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-35309196-fddf-41e8-8e5c-5cbbc026d557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:19.122198 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1444/2900] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:19.134395 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ca2ea-9031-4f36-8e89-b5e864dc819a admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:19.135923 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-f59ca2ea-9031-4f36-8e89-b5e864dc819a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:19.175952 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:19.203468 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ca2ea-9031-4f36-8e89-b5e864dc819a admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:19.207359 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17589ef2-0845-4cc4-8c01-f37d4a4d23f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:19.207993 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17589ef2-0845-4cc4-8c01-f37d4a4d23f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:19.208267 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17589ef2-0845-4cc4-8c01-f37d4a4d23f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:19.208537 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17589ef2-0845-4cc4-8c01-f37d4a4d23f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:19.223447 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17589ef2-0845-4cc4-8c01-f37d4a4d23f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:19.225210 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17589ef2-0845-4cc4-8c01-f37d4a4d23f9 service neutron] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:19.237080 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1457/2901] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:42:19.741000 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35309196-fddf-41e8-8e5c-5cbbc026d557 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:19.742796 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-35309196-fddf-41e8-8e5c-5cbbc026d557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:19.756672 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35309196-fddf-41e8-8e5c-5cbbc026d557 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:19.763949 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea6837-3380-461e-adc1-90267439843e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:19.764972 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea6837-3380-461e-adc1-90267439843e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:19.765359 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea6837-3380-461e-adc1-90267439843e admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:19.765760 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea6837-3380-461e-adc1-90267439843e admin admin] PATH_INFO: `/v3/projects/67cc85e691514f8eb265f790ffeb4051` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:19.767419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea6837-3380-461e-adc1-90267439843e admin admin] RBAC: Authorizing `identity:delete_project(project_id=67cc85e691514f8eb265f790ffeb4051)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:19.770963 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea6837-3380-461e-adc1-90267439843e admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:19.898477 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-aaea6837-3380-461e-adc1-90267439843e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67cc85e691514f8eb265f790ffeb4051', 'request_id': 'req-aaea6837-3380-461e-adc1-90267439843e'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:19.997445 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-aaea6837-3380-461e-adc1-90267439843e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67cc85e691514f8eb265f790ffeb4051', 'request_id': 'req-aaea6837-3380-461e-adc1-90267439843e'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:20.004065 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-aaea6837-3380-461e-adc1-90267439843e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67cc85e691514f8eb265f790ffeb4051', 'request_id': 'req-aaea6837-3380-461e-adc1-90267439843e'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:20.011638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:20.017337 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-aaea6837-3380-461e-adc1-90267439843e admin admin] The token cache is being invalidate because project 67cc85e691514f8eb265f790ffeb4051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:42:20.017647 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-aaea6837-3380-461e-adc1-90267439843e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:20.018323 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-aaea6837-3380-461e-adc1-90267439843e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:20.019858 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1445/2902] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:42:19 2022] DELETE /identity/v3/projects/67cc85e691514f8eb265f790ffeb4051 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:20.024279 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17589ef2-0845-4cc4-8c01-f37d4a4d23f9 service neutron] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:20.036564 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17589ef2-0845-4cc4-8c01-f37d4a4d23f9 service neutron] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:20.102456 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e49d9-e4fe-48c3-a48b-b2a62e74c0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:20.103144 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e49d9-e4fe-48c3-a48b-b2a62e74c0a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:20.103418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e49d9-e4fe-48c3-a48b-b2a62e74c0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:20.103688 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e49d9-e4fe-48c3-a48b-b2a62e74c0a8 admin admin] PATH_INFO: `/v3/users/9014309deb904cfc9a7c7001210c1736` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:20.105070 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e49d9-e4fe-48c3-a48b-b2a62e74c0a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9014309deb904cfc9a7c7001210c1736)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:20.107248 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e49d9-e4fe-48c3-a48b-b2a62e74c0a8 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:20.377559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-164e49d9-e4fe-48c3-a48b-b2a62e74c0a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9014309deb904cfc9a7c7001210c1736'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:20.453931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-164e49d9-e4fe-48c3-a48b-b2a62e74c0a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9014309deb904cfc9a7c7001210c1736'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:20.454612 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-164e49d9-e4fe-48c3-a48b-b2a62e74c0a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9014309deb904cfc9a7c7001210c1736'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:20.462425 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-164e49d9-e4fe-48c3-a48b-b2a62e74c0a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9014309deb904cfc9a7c7001210c1736'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:20.463186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-164e49d9-e4fe-48c3-a48b-b2a62e74c0a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9014309deb904cfc9a7c7001210c1736'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:20.483089 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1458/2903] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:42:20 2022] DELETE /identity/v3/users/9014309deb904cfc9a7c7001210c1736 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:20.940544 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea6837-3380-461e-adc1-90267439843e admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:20.942464 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-aaea6837-3380-461e-adc1-90267439843e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:20.956826 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea6837-3380-461e-adc1-90267439843e admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:21.022661 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5e70b-dbd1-4f26-b92a-898ce4030249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:21.023666 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5e70b-dbd1-4f26-b92a-898ce4030249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:21.023947 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5e70b-dbd1-4f26-b92a-898ce4030249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:21.024221 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5e70b-dbd1-4f26-b92a-898ce4030249 admin admin] PATH_INFO: `/v3/projects/e7b0e5cf57044f4e9379d115ec13a724` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:21.025401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5e70b-dbd1-4f26-b92a-898ce4030249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7b0e5cf57044f4e9379d115ec13a724)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:21.027345 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5e70b-dbd1-4f26-b92a-898ce4030249 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:21.188888 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-b6c5e70b-dbd1-4f26-b92a-898ce4030249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7b0e5cf57044f4e9379d115ec13a724', 'request_id': 'req-b6c5e70b-dbd1-4f26-b92a-898ce4030249'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:21.305656 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-b6c5e70b-dbd1-4f26-b92a-898ce4030249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7b0e5cf57044f4e9379d115ec13a724', 'request_id': 'req-b6c5e70b-dbd1-4f26-b92a-898ce4030249'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:21.311988 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-b6c5e70b-dbd1-4f26-b92a-898ce4030249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7b0e5cf57044f4e9379d115ec13a724', 'request_id': 'req-b6c5e70b-dbd1-4f26-b92a-898ce4030249'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:21.324298 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-b6c5e70b-dbd1-4f26-b92a-898ce4030249 admin admin] The token cache is being invalidate because project e7b0e5cf57044f4e9379d115ec13a724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:42:21.332909 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-b6c5e70b-dbd1-4f26-b92a-898ce4030249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:21.332909 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-b6c5e70b-dbd1-4f26-b92a-898ce4030249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:21.332909 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1446/2904] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:42:20 2022] DELETE /identity/v3/projects/e7b0e5cf57044f4e9379d115ec13a724 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:21.333340 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2cb6a-e39e-45c5-b9e1-b3f6168873e4 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:21.333800 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2cb6a-e39e-45c5-b9e1-b3f6168873e4 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:21.333910 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2cb6a-e39e-45c5-b9e1-b3f6168873e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:21.354372 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-95b2cb6a-e39e-45c5-b9e1-b3f6168873e4 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:21.355692 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-95b2cb6a-e39e-45c5-b9e1-b3f6168873e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:21.404076 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:21.420561 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1459/2905] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:21.430679 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7595c-5e3c-4f3a-83f0-a986b77d125d None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:21.431001 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7595c-5e3c-4f3a-83f0-a986b77d125d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:21.431254 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7595c-5e3c-4f3a-83f0-a986b77d125d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:21.452691 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-dbd7595c-5e3c-4f3a-83f0-a986b77d125d None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:21.453738 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-dbd7595c-5e3c-4f3a-83f0-a986b77d125d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:21.461986 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1447/2906] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:21.470206 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2cb6a-e39e-45c5-b9e1-b3f6168873e4 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:21.485612 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2cb6a-e39e-45c5-b9e1-b3f6168873e4 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:21.490500 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c308527-ab22-4cf7-ac16-3d4a8e33145e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:21.491146 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c308527-ab22-4cf7-ac16-3d4a8e33145e admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:21.491681 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c308527-ab22-4cf7-ac16-3d4a8e33145e admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:21.491946 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c308527-ab22-4cf7-ac16-3d4a8e33145e admin admin] PATH_INFO: `/v3/domains` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:21.492591 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c308527-ab22-4cf7-ac16-3d4a8e33145e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:42:21.492888 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c308527-ab22-4cf7-ac16-3d4a8e33145e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:21.494667 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c308527-ab22-4cf7-ac16-3d4a8e33145e admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:21.507238 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1460/2907] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:42:21.511973 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7595c-5e3c-4f3a-83f0-a986b77d125d None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:21.522391 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7595c-5e3c-4f3a-83f0-a986b77d125d None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:21.527419 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc065c19-b92e-45a8-90a5-58ffdc9651e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:21.528062 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc065c19-b92e-45a8-90a5-58ffdc9651e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:21.528473 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc065c19-b92e-45a8-90a5-58ffdc9651e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:21.528742 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc065c19-b92e-45a8-90a5-58ffdc9651e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:21.529408 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc065c19-b92e-45a8-90a5-58ffdc9651e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:21.531923 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc065c19-b92e-45a8-90a5-58ffdc9651e7 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:21.644429 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1448/2908] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:42:21 2022] POST /identity/v3/projects => generated 389 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:42:21.649038 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c308527-ab22-4cf7-ac16-3d4a8e33145e admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:21.660911 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c308527-ab22-4cf7-ac16-3d4a8e33145e admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:21.719879 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1dc24-9c70-4101-b385-8d00f8074c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:21.720412 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1dc24-9c70-4101-b385-8d00f8074c8a admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:21.720695 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1dc24-9c70-4101-b385-8d00f8074c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:21.720971 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1dc24-9c70-4101-b385-8d00f8074c8a admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:21.721694 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1dc24-9c70-4101-b385-8d00f8074c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:21.724047 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1dc24-9c70-4101-b385-8d00f8074c8a admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:21.820759 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1461/2909] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:42:21 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:42:21.825765 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc065c19-b92e-45a8-90a5-58ffdc9651e7 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:21.837315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc065c19-b92e-45a8-90a5-58ffdc9651e7 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:21.842444 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75457bf1-7dc8-4389-b915-d18e7f2c3116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:21.843182 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75457bf1-7dc8-4389-b915-d18e7f2c3116 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:21.843455 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75457bf1-7dc8-4389-b915-d18e7f2c3116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:21.843723 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75457bf1-7dc8-4389-b915-d18e7f2c3116 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:21.844369 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75457bf1-7dc8-4389-b915-d18e7f2c3116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:21.846010 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75457bf1-7dc8-4389-b915-d18e7f2c3116 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:21.857416 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1449/2910] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:42:21.861836 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1dc24-9c70-4101-b385-8d00f8074c8a admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:21.875273 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1dc24-9c70-4101-b385-8d00f8074c8a admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:21.879932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8ed5b-f48d-43d9-b542-01fc1f747553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:21.880559 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8ed5b-f48d-43d9-b542-01fc1f747553 admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:21.880835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8ed5b-f48d-43d9-b542-01fc1f747553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:21.881113 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8ed5b-f48d-43d9-b542-01fc1f747553 admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:21.881771 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8ed5b-f48d-43d9-b542-01fc1f747553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:21.883460 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8ed5b-f48d-43d9-b542-01fc1f747553 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:21.895885 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1462/2911] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:42:21.900090 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75457bf1-7dc8-4389-b915-d18e7f2c3116 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:21.910410 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75457bf1-7dc8-4389-b915-d18e7f2c3116 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:21.915210 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce11a4-9b04-4653-9327-54799411d390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:21.915875 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce11a4-9b04-4653-9327-54799411d390 admin admin] REQUEST_METHOD: `PUT` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:21.916144 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce11a4-9b04-4653-9327-54799411d390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:21.916410 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce11a4-9b04-4653-9327-54799411d390 admin admin] PATH_INFO: `/v3/projects/86565e42850f4534abae23eaf9cf2ec8/users/79762eb906064fb98c32130dfe4d1a6c/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:21.933387 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce11a4-9b04-4653-9327-54799411d390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86565e42850f4534abae23eaf9cf2ec8, user_id=79762eb906064fb98c32130dfe4d1a6c, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:21.936124 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce11a4-9b04-4653-9327-54799411d390 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:22.021197 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1450/2912] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:42:21 2022] PUT /identity/v3/projects/86565e42850f4534abae23eaf9cf2ec8/users/79762eb906064fb98c32130dfe4d1a6c/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:22.088264 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bd182-8373-48b0-93fb-2565cf2542e6 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:22.088535 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bd182-8373-48b0-93fb-2565cf2542e6 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:22.088839 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bd182-8373-48b0-93fb-2565cf2542e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:22.120428 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-b39bd182-8373-48b0-93fb-2565cf2542e6 None None] MFA Rules not processed for user `79762eb906064fb98c32130dfe4d1a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:22.121675 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-b39bd182-8373-48b0-93fb-2565cf2542e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:22.193388 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1463/2913] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:22.198064 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce11a4-9b04-4653-9327-54799411d390 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:22.227828 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:22.268599 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce11a4-9b04-4653-9327-54799411d390 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:22.280212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099f714-2cc0-44f2-9647-4bf0ac9ce66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:22.280212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099f714-2cc0-44f2-9647-4bf0ac9ce66f admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:22.280212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099f714-2cc0-44f2-9647-4bf0ac9ce66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:22.280212 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099f714-2cc0-44f2-9647-4bf0ac9ce66f admin admin] PATH_INFO: `/v3/projects` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:22.280792 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099f714-2cc0-44f2-9647-4bf0ac9ce66f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:22.280792 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099f714-2cc0-44f2-9647-4bf0ac9ce66f admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:22.409685 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1451/2914] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:42:22 2022] POST /identity/v3/projects => generated 389 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:42:22.415195 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bd182-8373-48b0-93fb-2565cf2542e6 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:22.427565 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bd182-8373-48b0-93fb-2565cf2542e6 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:22.476353 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:22.492280 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd259d-2087-40b4-9bfb-062eec13e087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:22.492951 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd259d-2087-40b4-9bfb-062eec13e087 admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:22.493281 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd259d-2087-40b4-9bfb-062eec13e087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:22.493557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd259d-2087-40b4-9bfb-062eec13e087 admin admin] PATH_INFO: `/v3/users` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:22.494202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd259d-2087-40b4-9bfb-062eec13e087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:22.496256 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd259d-2087-40b4-9bfb-062eec13e087 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:22.610197 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1464/2915] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:42:22 2022] POST /identity/v3/users => generated 301 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:42:22.615717 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099f714-2cc0-44f2-9647-4bf0ac9ce66f admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:22.628315 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099f714-2cc0-44f2-9647-4bf0ac9ce66f admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:22.633103 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1812bed-0c75-408e-8c2f-016062743304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:22.633712 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1812bed-0c75-408e-8c2f-016062743304 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:22.633991 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1812bed-0c75-408e-8c2f-016062743304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:22.634264 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1812bed-0c75-408e-8c2f-016062743304 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:22.634955 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1812bed-0c75-408e-8c2f-016062743304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:22.636567 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1812bed-0c75-408e-8c2f-016062743304 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:22.648652 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1452/2916] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:42:22.659025 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd259d-2087-40b4-9bfb-062eec13e087 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:22.670147 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd259d-2087-40b4-9bfb-062eec13e087 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:22.675743 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f06b3-3ef4-425d-be54-a61411a4ce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:22.676444 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f06b3-3ef4-425d-be54-a61411a4ce57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:22.676725 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f06b3-3ef4-425d-be54-a61411a4ce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:22.677003 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f06b3-3ef4-425d-be54-a61411a4ce57 admin admin] PATH_INFO: `/v3/projects/f556dd2ff1f84f34993109a582034c09/users/686333ea3992439caa17d6029a08d2d5/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:22.694809 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f06b3-3ef4-425d-be54-a61411a4ce57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f556dd2ff1f84f34993109a582034c09, user_id=686333ea3992439caa17d6029a08d2d5, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:22.697617 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f06b3-3ef4-425d-be54-a61411a4ce57 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:22.803614 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1465/2917] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:42:22 2022] PUT /identity/v3/projects/f556dd2ff1f84f34993109a582034c09/users/686333ea3992439caa17d6029a08d2d5/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:22.807701 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1812bed-0c75-408e-8c2f-016062743304 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:22.819441 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1812bed-0c75-408e-8c2f-016062743304 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:22.884402 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e691dfa-3600-47b0-95a2-c6b201bcebc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:22.885095 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e691dfa-3600-47b0-95a2-c6b201bcebc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:22.885516 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e691dfa-3600-47b0-95a2-c6b201bcebc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:22.885860 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e691dfa-3600-47b0-95a2-c6b201bcebc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:22.886601 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e691dfa-3600-47b0-95a2-c6b201bcebc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:22.888638 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e691dfa-3600-47b0-95a2-c6b201bcebc3 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:22.899996 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1453/2918] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:42:22.904485 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f06b3-3ef4-425d-be54-a61411a4ce57 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:22.915682 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f06b3-3ef4-425d-be54-a61411a4ce57 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:22.920496 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1577a-eb6b-442e-877c-3215ca5f90d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:22.921694 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1577a-eb6b-442e-877c-3215ca5f90d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:22.921974 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1577a-eb6b-442e-877c-3215ca5f90d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:22.922245 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1577a-eb6b-442e-877c-3215ca5f90d5 admin admin] PATH_INFO: `/v3/projects/f556dd2ff1f84f34993109a582034c09/users/686333ea3992439caa17d6029a08d2d5/roles/d365054bc34046c5829cd1355f3a31ac` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:22.924250 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1577a-eb6b-442e-877c-3215ca5f90d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f556dd2ff1f84f34993109a582034c09, user_id=686333ea3992439caa17d6029a08d2d5, role_id=d365054bc34046c5829cd1355f3a31ac)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:22.926977 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1577a-eb6b-442e-877c-3215ca5f90d5 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:22.938449 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1466/2919] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:42:22 2022] PUT /identity/v3/projects/f556dd2ff1f84f34993109a582034c09/users/686333ea3992439caa17d6029a08d2d5/roles/d365054bc34046c5829cd1355f3a31ac => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:22.948644 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ad5de-bceb-4f5e-b3ed-0b1862efcf52 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:22.948959 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ad5de-bceb-4f5e-b3ed-0b1862efcf52 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:22.949237 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ad5de-bceb-4f5e-b3ed-0b1862efcf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:22.978598 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-149ad5de-bceb-4f5e-b3ed-0b1862efcf52 None None] MFA Rules not processed for user `686333ea3992439caa17d6029a08d2d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:22.979820 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-149ad5de-bceb-4f5e-b3ed-0b1862efcf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:23.055077 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1454/2920] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:22 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:23.067000 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1577a-eb6b-442e-877c-3215ca5f90d5 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:23.068718 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-9ef1577a-eb6b-442e-877c-3215ca5f90d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:23.128067 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1577a-eb6b-442e-877c-3215ca5f90d5 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:23.131728 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494412b1-0dbf-4a06-bfb4-c63c276ea734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:23.132328 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494412b1-0dbf-4a06-bfb4-c63c276ea734 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:23.132602 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494412b1-0dbf-4a06-bfb4-c63c276ea734 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:23.132871 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494412b1-0dbf-4a06-bfb4-c63c276ea734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:23.142329 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494412b1-0dbf-4a06-bfb4-c63c276ea734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:23.143746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494412b1-0dbf-4a06-bfb4-c63c276ea734 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:23.153128 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1467/2921] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:42:23 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:42:23.294998 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ad5de-bceb-4f5e-b3ed-0b1862efcf52 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:23.316583 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:23.360290 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ad5de-bceb-4f5e-b3ed-0b1862efcf52 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:23.365019 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfae25-69e0-4536-8892-42a000ec3c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:23.367746 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfae25-69e0-4536-8892-42a000ec3c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:23.367746 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfae25-69e0-4536-8892-42a000ec3c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:23.367746 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfae25-69e0-4536-8892-42a000ec3c8e admin admin] PATH_INFO: `/v3/users/79762eb906064fb98c32130dfe4d1a6c` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:23.367746 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfae25-69e0-4536-8892-42a000ec3c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=79762eb906064fb98c32130dfe4d1a6c)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:23.369660 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfae25-69e0-4536-8892-42a000ec3c8e admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:23.565583 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-54bfae25-69e0-4536-8892-42a000ec3c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79762eb906064fb98c32130dfe4d1a6c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:23.578696 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-54bfae25-69e0-4536-8892-42a000ec3c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79762eb906064fb98c32130dfe4d1a6c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:23.642274 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-54bfae25-69e0-4536-8892-42a000ec3c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79762eb906064fb98c32130dfe4d1a6c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:23.642913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-54bfae25-69e0-4536-8892-42a000ec3c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79762eb906064fb98c32130dfe4d1a6c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:23.651130 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-54bfae25-69e0-4536-8892-42a000ec3c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79762eb906064fb98c32130dfe4d1a6c'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:23.658578 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1455/2922] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:42:23 2022] DELETE /identity/v3/users/79762eb906064fb98c32130dfe4d1a6c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:23.663836 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be7b55-27ec-4549-ad44-e4cf77a2cca7 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:23.664429 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be7b55-27ec-4549-ad44-e4cf77a2cca7 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:23.664429 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be7b55-27ec-4549-ad44-e4cf77a2cca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:23.683454 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-44be7b55-27ec-4549-ad44-e4cf77a2cca7 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:23.684654 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-44be7b55-27ec-4549-ad44-e4cf77a2cca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:23.744876 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1468/2923] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:23.754836 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfae25-69e0-4536-8892-42a000ec3c8e admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:23.756466 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-54bfae25-69e0-4536-8892-42a000ec3c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:23.816655 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfae25-69e0-4536-8892-42a000ec3c8e admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:23.820400 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df494f44-bad2-4b40-a88d-41367c880aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:23.821459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df494f44-bad2-4b40-a88d-41367c880aca service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:23.821459 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df494f44-bad2-4b40-a88d-41367c880aca service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:23.821741 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df494f44-bad2-4b40-a88d-41367c880aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:23.831917 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df494f44-bad2-4b40-a88d-41367c880aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:23.839467 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df494f44-bad2-4b40-a88d-41367c880aca service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:23.843980 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1456/2924] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:42:24.359268 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be7b55-27ec-4549-ad44-e4cf77a2cca7 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:24.360745 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-44be7b55-27ec-4549-ad44-e4cf77a2cca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:24.373236 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be7b55-27ec-4549-ad44-e4cf77a2cca7 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:24.378557 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f2350-53f8-4639-9a8e-3d423b07af23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:24.380661 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f2350-53f8-4639-9a8e-3d423b07af23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:24.380661 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f2350-53f8-4639-9a8e-3d423b07af23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:24.380661 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f2350-53f8-4639-9a8e-3d423b07af23 admin admin] PATH_INFO: `/v3/projects/86565e42850f4534abae23eaf9cf2ec8` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:24.380987 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f2350-53f8-4639-9a8e-3d423b07af23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86565e42850f4534abae23eaf9cf2ec8)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:24.382807 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f2350-53f8-4639-9a8e-3d423b07af23 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:24.481571 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:24.490399 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1b9f2350-53f8-4639-9a8e-3d423b07af23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86565e42850f4534abae23eaf9cf2ec8', 'request_id': 'req-1b9f2350-53f8-4639-9a8e-3d423b07af23'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:24.579912 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1b9f2350-53f8-4639-9a8e-3d423b07af23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86565e42850f4534abae23eaf9cf2ec8', 'request_id': 'req-1b9f2350-53f8-4639-9a8e-3d423b07af23'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:24.586474 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1b9f2350-53f8-4639-9a8e-3d423b07af23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86565e42850f4534abae23eaf9cf2ec8', 'request_id': 'req-1b9f2350-53f8-4639-9a8e-3d423b07af23'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:24.597691 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1b9f2350-53f8-4639-9a8e-3d423b07af23 admin admin] The token cache is being invalidate because project 86565e42850f4534abae23eaf9cf2ec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:42:24.598032 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1b9f2350-53f8-4639-9a8e-3d423b07af23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:24.598765 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-1b9f2350-53f8-4639-9a8e-3d423b07af23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:24.600947 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1469/2925] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:42:24 2022] DELETE /identity/v3/projects/86565e42850f4534abae23eaf9cf2ec8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:24.605321 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df494f44-bad2-4b40-a88d-41367c880aca service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:24.615636 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df494f44-bad2-4b40-a88d-41367c880aca service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:24.657819 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:24.675408 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d86a93-7a4c-4c01-b878-772596fb31f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:24.676049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d86a93-7a4c-4c01-b878-772596fb31f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:24.676328 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d86a93-7a4c-4c01-b878-772596fb31f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:24.676599 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d86a93-7a4c-4c01-b878-772596fb31f4 admin admin] PATH_INFO: `/v3/users/686333ea3992439caa17d6029a08d2d5` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:24.677726 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d86a93-7a4c-4c01-b878-772596fb31f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=686333ea3992439caa17d6029a08d2d5)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:24.679983 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d86a93-7a4c-4c01-b878-772596fb31f4 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:24.896613 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-31d86a93-7a4c-4c01-b878-772596fb31f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '686333ea3992439caa17d6029a08d2d5'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:24.909787 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-31d86a93-7a4c-4c01-b878-772596fb31f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '686333ea3992439caa17d6029a08d2d5'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:25.002888 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-31d86a93-7a4c-4c01-b878-772596fb31f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '686333ea3992439caa17d6029a08d2d5'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:25.003515 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-31d86a93-7a4c-4c01-b878-772596fb31f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '686333ea3992439caa17d6029a08d2d5'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:25.011250 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-31d86a93-7a4c-4c01-b878-772596fb31f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '686333ea3992439caa17d6029a08d2d5'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:25.017599 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1457/2926] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:42:24 2022] DELETE /identity/v3/users/686333ea3992439caa17d6029a08d2d5 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:25.478827 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f2350-53f8-4639-9a8e-3d423b07af23 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:25.480840 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-1b9f2350-53f8-4639-9a8e-3d423b07af23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:25.496426 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f2350-53f8-4639-9a8e-3d423b07af23 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:25.555980 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a5601-e933-4261-b27f-a51f8883c237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:25.556620 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a5601-e933-4261-b27f-a51f8883c237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:25.556902 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a5601-e933-4261-b27f-a51f8883c237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:25.557170 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a5601-e933-4261-b27f-a51f8883c237 admin admin] PATH_INFO: `/v3/projects/f556dd2ff1f84f34993109a582034c09` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:25.558305 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a5601-e933-4261-b27f-a51f8883c237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f556dd2ff1f84f34993109a582034c09)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:25.560337 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a5601-e933-4261-b27f-a51f8883c237 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:25.677708 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-6b0a5601-e933-4261-b27f-a51f8883c237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f556dd2ff1f84f34993109a582034c09', 'request_id': 'req-6b0a5601-e933-4261-b27f-a51f8883c237'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:25.768995 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-6b0a5601-e933-4261-b27f-a51f8883c237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f556dd2ff1f84f34993109a582034c09', 'request_id': 'req-6b0a5601-e933-4261-b27f-a51f8883c237'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:25.775513 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-6b0a5601-e933-4261-b27f-a51f8883c237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f556dd2ff1f84f34993109a582034c09', 'request_id': 'req-6b0a5601-e933-4261-b27f-a51f8883c237'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:25.787273 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-6b0a5601-e933-4261-b27f-a51f8883c237 admin admin] The token cache is being invalidate because project f556dd2ff1f84f34993109a582034c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:42:25.787563 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-6b0a5601-e933-4261-b27f-a51f8883c237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:25.788220 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-6b0a5601-e933-4261-b27f-a51f8883c237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:25.789705 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1470/2927] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:42:25 2022] DELETE /identity/v3/projects/f556dd2ff1f84f34993109a582034c09 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:25.796547 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51b9f0-7e55-4fdb-acdc-11e16b19e975 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:25.797401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51b9f0-7e55-4fdb-acdc-11e16b19e975 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:25.797401 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51b9f0-7e55-4fdb-acdc-11e16b19e975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:25.817500 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-8d51b9f0-7e55-4fdb-acdc-11e16b19e975 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:25.818748 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-8d51b9f0-7e55-4fdb-acdc-11e16b19e975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:25.888102 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1458/2928] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:25.897200 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a6ded-65ea-41d4-b8f2-5b80d841d984 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:25.897483 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a6ded-65ea-41d4-b8f2-5b80d841d984 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:25.897863 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a6ded-65ea-41d4-b8f2-5b80d841d984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:25.918058 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-145a6ded-65ea-41d4-b8f2-5b80d841d984 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:25.919327 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-145a6ded-65ea-41d4-b8f2-5b80d841d984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:25.928307 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1471/2929] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:25.932899 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51b9f0-7e55-4fdb-acdc-11e16b19e975 None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:25.943695 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51b9f0-7e55-4fdb-acdc-11e16b19e975 None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:25.950702 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03d5a2-eca4-4161-ba66-a171520dbfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:25.951418 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03d5a2-eca4-4161-ba66-a171520dbfc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:25.951716 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03d5a2-eca4-4161-ba66-a171520dbfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:25.952559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03d5a2-eca4-4161-ba66-a171520dbfc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:25.953244 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03d5a2-eca4-4161-ba66-a171520dbfc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 01:42:25.953574 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03d5a2-eca4-4161-ba66-a171520dbfc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:25.955249 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03d5a2-eca4-4161-ba66-a171520dbfc8 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:25.972138 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1459/2930] 10.222.0.83 () {58 vars in 1153 bytes} [Fri Sep 23 01:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 01:42:25.975577 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a6ded-65ea-41d4-b8f2-5b80d841d984 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:25.986079 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a6ded-65ea-41d4-b8f2-5b80d841d984 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:25.990835 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb79db-c048-498c-9588-836e6ae18e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:25.991692 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb79db-c048-498c-9588-836e6ae18e1d admin admin] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:25.991971 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb79db-c048-498c-9588-836e6ae18e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:25.992246 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb79db-c048-498c-9588-836e6ae18e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:25.992871 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb79db-c048-498c-9588-836e6ae18e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:25.994856 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb79db-c048-498c-9588-836e6ae18e1d admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:26.163554 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1472/2931] 10.222.0.83 () {60 vars in 1153 bytes} [Fri Sep 23 01:42:25 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:42:26.167700 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03d5a2-eca4-4161-ba66-a171520dbfc8 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:26.177902 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03d5a2-eca4-4161-ba66-a171520dbfc8 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:26.224327 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:26.236057 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c3beb-f056-40fe-84de-4567fc68f044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:26.236674 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c3beb-f056-40fe-84de-4567fc68f044 admin admin] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:26.236954 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c3beb-f056-40fe-84de-4567fc68f044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:26.237225 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c3beb-f056-40fe-84de-4567fc68f044 admin admin] PATH_INFO: `/v3/users` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:26.237871 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c3beb-f056-40fe-84de-4567fc68f044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:26.240207 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c3beb-f056-40fe-84de-4567fc68f044 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:26.352213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1460/2932] 10.222.0.83 () {60 vars in 1144 bytes} [Fri Sep 23 01:42:26 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 01:42:26.356370 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb79db-c048-498c-9588-836e6ae18e1d admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:26.367165 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb79db-c048-498c-9588-836e6ae18e1d admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:26.371763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7276cdf-ec44-4f18-be46-a763d160370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:26.372363 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7276cdf-ec44-4f18-be46-a763d160370f admin admin] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:26.372633 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7276cdf-ec44-4f18-be46-a763d160370f admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:26.372999 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7276cdf-ec44-4f18-be46-a763d160370f admin admin] PATH_INFO: `/v3/roles` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:26.373569 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7276cdf-ec44-4f18-be46-a763d160370f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:26.375772 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7276cdf-ec44-4f18-be46-a763d160370f admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:26.386611 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1473/2933] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:42:26.391343 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c3beb-f056-40fe-84de-4567fc68f044 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:26.401913 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c3beb-f056-40fe-84de-4567fc68f044 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:26.406631 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d6561-db26-4f67-b4a5-360813be55b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:26.407247 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d6561-db26-4f67-b4a5-360813be55b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:26.407528 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d6561-db26-4f67-b4a5-360813be55b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:26.407802 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d6561-db26-4f67-b4a5-360813be55b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:26.408451 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d6561-db26-4f67-b4a5-360813be55b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:26.410045 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d6561-db26-4f67-b4a5-360813be55b8 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:26.421118 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1461/2934] 10.222.0.83 () {58 vars in 1122 bytes} [Fri Sep 23 01:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 01:42:26.425362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7276cdf-ec44-4f18-be46-a763d160370f admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:26.435223 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7276cdf-ec44-4f18-be46-a763d160370f admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:26.440287 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baaf47-9d0c-411b-80c7-6d942975b979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:26.440931 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baaf47-9d0c-411b-80c7-6d942975b979 admin admin] REQUEST_METHOD: `PUT` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:26.441204 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baaf47-9d0c-411b-80c7-6d942975b979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:26.441472 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baaf47-9d0c-411b-80c7-6d942975b979 admin admin] PATH_INFO: `/v3/projects/47c3b95851394457baaa96e5f38fb1b2/users/bad019613cc1481bb66cfd50e74ad31a/roles/986891361f4f4893a1cb2d0e0b523bff` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:26.453928 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:26.457129 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80baaf47-9d0c-411b-80c7-6d942975b979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c3b95851394457baaa96e5f38fb1b2, user_id=bad019613cc1481bb66cfd50e74ad31a, role_id=986891361f4f4893a1cb2d0e0b523bff)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:26.459904 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80baaf47-9d0c-411b-80c7-6d942975b979 admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:26.574445 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1474/2935] 10.222.0.83 () {60 vars in 1483 bytes} [Fri Sep 23 01:42:26 2022] PUT /identity/v3/projects/47c3b95851394457baaa96e5f38fb1b2/users/bad019613cc1481bb66cfd50e74ad31a/roles/986891361f4f4893a1cb2d0e0b523bff => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:26.585363 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d6f6-aa98-4f72-ab50-5d6431afee0c None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:26.585991 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d6f6-aa98-4f72-ab50-5d6431afee0c None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:26.586269 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d6f6-aa98-4f72-ab50-5d6431afee0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:26.615716 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-c251d6f6-aa98-4f72-ab50-5d6431afee0c None None] MFA Rules not processed for user `bad019613cc1481bb66cfd50e74ad31a`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:26.617192 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-c251d6f6-aa98-4f72-ab50-5d6431afee0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:26.683272 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1462/2936] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:26.695439 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baaf47-9d0c-411b-80c7-6d942975b979 admin admin] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:26.697174 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-80baaf47-9d0c-411b-80c7-6d942975b979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:26.753713 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baaf47-9d0c-411b-80c7-6d942975b979 admin admin] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:26.758016 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa8860-81d6-442c-9ec9-9ba393198ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f71db705b08460996a729a88c82bb63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:26.758647 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa8860-81d6-442c-9ec9-9ba393198ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:26.758932 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa8860-81d6-442c-9ec9-9ba393198ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:26.759205 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa8860-81d6-442c-9ec9-9ba393198ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:26.768067 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa8860-81d6-442c-9ec9-9ba393198ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:26.769510 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa8860-81d6-442c-9ec9-9ba393198ee2 service cinder] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:26.778490 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1475/2937] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:42:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:42:28.755295 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdfe31-3249-42c3-ad6c-8cbe63d6b0ce None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:28.755877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdfe31-3249-42c3-ad6c-8cbe63d6b0ce None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:28.755877 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdfe31-3249-42c3-ad6c-8cbe63d6b0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:28.777092 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-edbdfe31-3249-42c3-ad6c-8cbe63d6b0ce None None] MFA Rules not processed for user `bad019613cc1481bb66cfd50e74ad31a`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:28.778099 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-edbdfe31-3249-42c3-ad6c-8cbe63d6b0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:28.785145 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1463/2938] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:36.774409 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:38.771889 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=47,keystone:INSERT=3 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:39.820623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa8860-81d6-442c-9ec9-9ba393198ee2 service cinder] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:39.823224 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-1baa8860-81d6-442c-9ec9-9ba393198ee2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:39.915678 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa8860-81d6-442c-9ec9-9ba393198ee2 service cinder] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:39.921805 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3582b2-8763-4f6d-8f19-a5e29ed14ce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824648d693af4b44ae5df853a3d258f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:39.922418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3582b2-8763-4f6d-8f19-a5e29ed14ce8 service nova] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:39.922742 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3582b2-8763-4f6d-8f19-a5e29ed14ce8 service nova] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:39.923013 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3582b2-8763-4f6d-8f19-a5e29ed14ce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:39.924784 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-6c3582b2-8763-4f6d-8f19-a5e29ed14ce8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:39.937532 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3582b2-8763-4f6d-8f19-a5e29ed14ce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:39.939227 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3582b2-8763-4f6d-8f19-a5e29ed14ce8 service nova] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:39.950420 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1476/2939] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:42:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 01:42:48.959739 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7baaec-ac05-4bd8-b5da-0bd8391e316c None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:48.960251 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7baaec-ac05-4bd8-b5da-0bd8391e316c None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:48.960251 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7baaec-ac05-4bd8-b5da-0bd8391e316c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:48.980810 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-fc7baaec-ac05-4bd8-b5da-0bd8391e316c None None] MFA Rules not processed for user `f2cea4c08f324769bf6dcea58c9394b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:48.982011 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-fc7baaec-ac05-4bd8-b5da-0bd8391e316c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:49.039190 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1464/2940] 10.222.0.83 () {58 vars in 1009 bytes} [Fri Sep 23 01:42:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:49.199573 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3582b2-8763-4f6d-8f19-a5e29ed14ce8 service nova] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:49.201002 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-6c3582b2-8763-4f6d-8f19-a5e29ed14ce8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:49.281215 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3582b2-8763-4f6d-8f19-a5e29ed14ce8 service nova] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:49.286875 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ddc58-08a3-47ce-a5c4-ccb118b7aa60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526c7ad227943d1a2bba7b5e2e039e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:49.287834 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ddc58-08a3-47ce-a5c4-ccb118b7aa60 service swift] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:49.288324 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ddc58-08a3-47ce-a5c4-ccb118b7aa60 service swift] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:49.288833 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ddc58-08a3-47ce-a5c4-ccb118b7aa60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:49.299086 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ddc58-08a3-47ce-a5c4-ccb118b7aa60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:49.300677 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ddc58-08a3-47ce-a5c4-ccb118b7aa60 service swift] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:49.308747 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1477/2941] 10.222.0.83 () {60 vars in 1384 bytes} [Fri Sep 23 01:42:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 01:42:50.131560 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12b467-2e0d-4408-8692-3a46c64b2741 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:50.132031 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12b467-2e0d-4408-8692-3a46c64b2741 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:50.132126 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12b467-2e0d-4408-8692-3a46c64b2741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:50.151213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-dc12b467-2e0d-4408-8692-3a46c64b2741 None None] MFA Rules not processed for user `f2cea4c08f324769bf6dcea58c9394b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:50.152420 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-dc12b467-2e0d-4408-8692-3a46c64b2741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:50.160172 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1465/2942] 10.222.0.83 () {58 vars in 967 bytes} [Fri Sep 23 01:42:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:50.173355 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ddc58-08a3-47ce-a5c4-ccb118b7aa60 service swift] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:50.184423 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ddc58-08a3-47ce-a5c4-ccb118b7aa60 service swift] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:50.189623 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9878c6e-52e3-4c3f-92f4-e044346d5daa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526c7ad227943d1a2bba7b5e2e039e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:50.190225 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9878c6e-52e3-4c3f-92f4-e044346d5daa service swift] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:50.190519 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9878c6e-52e3-4c3f-92f4-e044346d5daa service swift] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:50.190819 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9878c6e-52e3-4c3f-92f4-e044346d5daa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:50.199313 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9878c6e-52e3-4c3f-92f4-e044346d5daa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:50.200905 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9878c6e-52e3-4c3f-92f4-e044346d5daa service swift] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:50.209362 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1478/2943] 10.222.0.83 () {60 vars in 1384 bytes} [Fri Sep 23 01:42:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 01:42:50.996543 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6739237-6314-49b7-80cc-1b456e55fe94 None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:50.996927 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6739237-6314-49b7-80cc-1b456e55fe94 None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:50.997106 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6739237-6314-49b7-80cc-1b456e55fe94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:51.017118 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-e6739237-6314-49b7-80cc-1b456e55fe94 None None] MFA Rules not processed for user `f2cea4c08f324769bf6dcea58c9394b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:51.018335 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-e6739237-6314-49b7-80cc-1b456e55fe94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:51.026029 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1466/2944] 10.222.0.83 () {58 vars in 1009 bytes} [Fri Sep 23 01:42:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:51.037954 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9878c6e-52e3-4c3f-92f4-e044346d5daa service swift] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:51.048574 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9878c6e-52e3-4c3f-92f4-e044346d5daa service swift] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:51.053591 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b90d18-0f60-4b05-a7ac-11d8245b90c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526c7ad227943d1a2bba7b5e2e039e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:51.054182 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b90d18-0f60-4b05-a7ac-11d8245b90c0 service swift] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:51.054461 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b90d18-0f60-4b05-a7ac-11d8245b90c0 service swift] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:51.054763 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b90d18-0f60-4b05-a7ac-11d8245b90c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:51.063202 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b90d18-0f60-4b05-a7ac-11d8245b90c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:51.064909 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b90d18-0f60-4b05-a7ac-11d8245b90c0 service swift] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:51.074599 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1479/2945] 10.222.0.83 () {60 vars in 1384 bytes} [Fri Sep 23 01:42:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 01:42:51.744547 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0b87f-e0d4-4361-8345-2cc8e214c97d None None] REQUEST_METHOD: `POST` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:51.745049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0b87f-e0d4-4361-8345-2cc8e214c97d None None] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:51.745049 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0b87f-e0d4-4361-8345-2cc8e214c97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:51.764443 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.auth.core [None req-58d0b87f-e0d4-4361-8345-2cc8e214c97d None None] MFA Rules not processed for user `f2cea4c08f324769bf6dcea58c9394b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:51.765627 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-58d0b87f-e0d4-4361-8345-2cc8e214c97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:51.772751 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1467/2946] 10.222.0.83 () {58 vars in 967 bytes} [Fri Sep 23 01:42:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 01:42:51.785898 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b90d18-0f60-4b05-a7ac-11d8245b90c0 service swift] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:51.796727 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b90d18-0f60-4b05-a7ac-11d8245b90c0 service swift] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:51.802625 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb99071-1dac-4335-a454-58a569860a4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526c7ad227943d1a2bba7b5e2e039e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:51.803257 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb99071-1dac-4335-a454-58a569860a4b service swift] REQUEST_METHOD: `GET` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:51.803532 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb99071-1dac-4335-a454-58a569860a4b service swift] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:51.803917 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb99071-1dac-4335-a454-58a569860a4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:51.812418 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb99071-1dac-4335-a454-58a569860a4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:51.814003 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb99071-1dac-4335-a454-58a569860a4b service swift] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:51.822077 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1480/2947] 10.222.0.83 () {60 vars in 1384 bytes} [Fri Sep 23 01:42:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 01:42:54.619646 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0b87f-e0d4-4361-8345-2cc8e214c97d None None] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:54.696952 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0b87f-e0d4-4361-8345-2cc8e214c97d None None] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:54.702037 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d6998-cbf0-427c-bfed-4577fd08d002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:54.702793 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d6998-cbf0-427c-bfed-4577fd08d002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:54.703141 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d6998-cbf0-427c-bfed-4577fd08d002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:54.703434 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d6998-cbf0-427c-bfed-4577fd08d002 admin admin] PATH_INFO: `/v3/users/bad019613cc1481bb66cfd50e74ad31a` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:54.704678 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d6998-cbf0-427c-bfed-4577fd08d002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bad019613cc1481bb66cfd50e74ad31a)` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:54.706720 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d6998-cbf0-427c-bfed-4577fd08d002 admin admin] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:54.920346 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-bd7d6998-cbf0-427c-bfed-4577fd08d002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bad019613cc1481bb66cfd50e74ad31a'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:54.933211 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-bd7d6998-cbf0-427c-bfed-4577fd08d002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bad019613cc1481bb66cfd50e74ad31a'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:55.013736 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-bd7d6998-cbf0-427c-bfed-4577fd08d002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bad019613cc1481bb66cfd50e74ad31a'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:55.014358 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-bd7d6998-cbf0-427c-bfed-4577fd08d002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bad019613cc1481bb66cfd50e74ad31a'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:55.022206 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.notifications [None req-bd7d6998-cbf0-427c-bfed-4577fd08d002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bad019613cc1481bb66cfd50e74ad31a'} {{(pid=81923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:55.028247 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1468/2948] 10.222.0.83 () {58 vars in 1224 bytes} [Fri Sep 23 01:42:54 2022] DELETE /identity/v3/users/bad019613cc1481bb66cfd50e74ad31a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:42:55.033001 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fc9e6-009c-465c-9d34-97add66c3263 None None] REQUEST_METHOD: `POST` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:55.033479 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fc9e6-009c-465c-9d34-97add66c3263 None None] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:55.033577 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fc9e6-009c-465c-9d34-97add66c3263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:55.054853 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.auth.core [None req-583fc9e6-009c-465c-9d34-97add66c3263 None None] MFA Rules not processed for user `41222441d92243a6917a027e72480f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 01:42:55.058027 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-583fc9e6-009c-465c-9d34-97add66c3263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:55.077158 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=100 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:55.116570 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1481/2949] 10.222.0.83 () {58 vars in 958 bytes} [Fri Sep 23 01:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 01:42:55.126716 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d6998-cbf0-427c-bfed-4577fd08d002 admin admin] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:55.128154 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-bd7d6998-cbf0-427c-bfed-4577fd08d002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:55.135559 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:55.188260 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d6998-cbf0-427c-bfed-4577fd08d002 admin admin] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:55.191983 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969f798-421b-4093-abf4-f78c961c276e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2b2806686c4a15b1ace8b6245c4e28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:55.193141 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969f798-421b-4093-abf4-f78c961c276e service neutron] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:55.193416 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969f798-421b-4093-abf4-f78c961c276e service neutron] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:55.193688 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969f798-421b-4093-abf4-f78c961c276e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:55.204986 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969f798-421b-4093-abf4-f78c961c276e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:55.207042 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969f798-421b-4093-abf4-f78c961c276e service neutron] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:55.216848 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1469/2950] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:42:55.459204 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fc9e6-009c-465c-9d34-97add66c3263 None None] Authenticating user token {{(pid=81924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:42:55.461186 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.fernet_utils [None req-583fc9e6-009c-465c-9d34-97add66c3263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:42:55.475032 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fc9e6-009c-465c-9d34-97add66c3263 None None] Validating token access rules against request {{(pid=81924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:42:55.479738 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c920a86-ea67-493c-8b6c-236be02142bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41222441d92243a6917a027e72480f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb2e67cab7234c2983ce58824e8c7d2f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:42:55.480383 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c920a86-ea67-493c-8b6c-236be02142bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:42:55.480659 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c920a86-ea67-493c-8b6c-236be02142bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:42:55.480926 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c920a86-ea67-493c-8b6c-236be02142bd admin admin] PATH_INFO: `/v3/projects/47c3b95851394457baaa96e5f38fb1b2` {{(pid=81924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:42:55.482142 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c920a86-ea67-493c-8b6c-236be02142bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=47c3b95851394457baaa96e5f38fb1b2)` {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:42:55.484036 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c920a86-ea67-493c-8b6c-236be02142bd admin admin] RBAC: Authorization granted {{(pid=81924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:42:55.596430 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7c920a86-ea67-493c-8b6c-236be02142bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47c3b95851394457baaa96e5f38fb1b2', 'request_id': 'req-7c920a86-ea67-493c-8b6c-236be02142bd'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:55.665360 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7c920a86-ea67-493c-8b6c-236be02142bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47c3b95851394457baaa96e5f38fb1b2', 'request_id': 'req-7c920a86-ea67-493c-8b6c-236be02142bd'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:55.671584 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7c920a86-ea67-493c-8b6c-236be02142bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47c3b95851394457baaa96e5f38fb1b2', 'request_id': 'req-7c920a86-ea67-493c-8b6c-236be02142bd'} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:55.683746 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7c920a86-ea67-493c-8b6c-236be02142bd admin admin] The token cache is being invalidate because project 47c3b95851394457baaa96e5f38fb1b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 01:42:55.684034 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7c920a86-ea67-493c-8b6c-236be02142bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:55.684731 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG keystone.notifications [None req-7c920a86-ea67-493c-8b6c-236be02142bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 01:42:55.686215 dv-cinder-849143-7-smb devstack@keystone.service[81924]: [pid: 81924|app: 0|req: 1482/2951] 10.222.0.83 () {58 vars in 1233 bytes} [Fri Sep 23 01:42:55 2022] DELETE /identity/v3/projects/47c3b95851394457baaa96e5f38fb1b2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 01:43:05.223132 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=24 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:43:05.680696 dv-cinder-849143-7-smb devstack@keystone.service[81924]: DEBUG dbcounter [-] [81924] Writing DB stats keystone:SELECT=43,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:44:04.702213 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969f798-421b-4093-abf4-f78c961c276e service neutron] Authenticating user token {{(pid=81923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 01:44:04.703843 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-2969f798-421b-4093-abf4-f78c961c276e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:44:04.775672 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969f798-421b-4093-abf4-f78c961c276e service neutron] Validating token access rules against request {{(pid=81923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 01:44:04.837128 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85a1f2-83cd-4a51-8ef7-e06eaeeaf2c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eab2cbff5984fa6a8e715ed6553db82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78d0895fea004a02b1d8338f5fb0250c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 01:44:04.837778 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85a1f2-83cd-4a51-8ef7-e06eaeeaf2c7 service placement] REQUEST_METHOD: `GET` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 01:44:04.838060 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85a1f2-83cd-4a51-8ef7-e06eaeeaf2c7 service placement] SCRIPT_NAME: `/identity` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 01:44:04.838335 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85a1f2-83cd-4a51-8ef7-e06eaeeaf2c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 01:44:04.840179 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.fernet_utils [None req-5a85a1f2-83cd-4a51-8ef7-e06eaeeaf2c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 01:44:04.852570 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85a1f2-83cd-4a51-8ef7-e06eaeeaf2c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 01:44:04.854271 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85a1f2-83cd-4a51-8ef7-e06eaeeaf2c7 service placement] RBAC: Authorization granted {{(pid=81923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 01:44:04.864895 dv-cinder-849143-7-smb devstack@keystone.service[81923]: [pid: 81923|app: 0|req: 1470/2952] 10.222.0.83 () {60 vars in 1365 bytes} [Fri Sep 23 01:44:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 01:44:14.860153 dv-cinder-849143-7-smb devstack@keystone.service[81923]: DEBUG dbcounter [-] [81923] Writing DB stats keystone:SELECT=58 {{(pid=81923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}